Apache Hudi: Large Scale Data Systems with Vinoth Chandar

May 13, 2021 by SED

Apache Hudi is an open-source data management framework used to simplify incremental data processing and data pipeline development. This framework more efficiently manages business requirements like data lifecycle and improves data quality. Some common use cases for Hudi is record-level insert, update, and delete, simplified file management and near real-time data access, and simplified CDC data pipeline development (AWS.amazon.com).

In this episode we speak to Vinoth Chandar, VP of Apache Hudi. Vinoth is the creator of the Hudi project at Uber. He continues to lead its evolution at the Apache Software Foundation. Previously he was a Principal Engineer at Confluent, and a Sr Staff Engineer/Manager at Uber before that. We discuss building large scale distributed and data systems.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Transcript

Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com to get 15% off the first three months of audio editing and transcription services with code: SED. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.

Thanks to our sponsors

This episode is brought to you by:

triplebyte.com/sedaily
With Triplebyte, you do one online interview, and then you get to go straight to final interviews at hundreds of companies (from tech giants like Dropbox to exciting startups). It’s like the Common App for software engineers. No resume needed. Apply now at triplebyte.com/sedaily. If you take a job through Triplebyte, you’ll get a $1000 signing bonus.
cloud.google.com/devops
Today’s podcast is brought to you by Google Cloud and DORA research team. The team recently launched a survey to collect insights for the 2021 State of DevOps report and would love your input! The State of DevOps report is the largest and longest running research of its kind, providing insight into how we can improve software delivery performance with DevOps. By completing the survey, you get to shape the conversation on DevOps along with over 30 thousand software professionals who took the survey over the past six years. So what are you waiting for? Take the survey at cloud.google.com/devops!
oracle.com/goto/sedaily
Oracle for Startups delivers enterprise cloud at a startup price tag, with free cloud credits and 70% off industry-leading cloud services to help you reel in the big fish—confidently. And, with multi-cloud support and no vendor lock-in, you’re free to keep building in any way you choose. Your partnerships should be assets, not roadblocks to your success. To learn more, visit oracle.com/goto/sedaily.
COXAUTOTECH.COM
Cox Automotive is looking for software engineers, data engineers, scrum masters, and a variety of other positions to help push the technology forward. If you want to innovate in the world of car buying, selling, and ownership, check out COXAUTOTECH.COM to find out more about career opportunities and what it’s like working at Cox Automotive. Cox Automotive isn’t a car company. They are a technology company that’s transforming the automotive industry.

Transcript

triplebyte.com/sedaily

cloud.google.com/devops

oracle.com/goto/sedaily

COXAUTOTECH.COM

Subscribe to the newsletter

Related episodes

Subscribe
to the newsletter