Airbyte: Open Source Data Integrations with Michel Tricot and John Lafleur
Podcast: Play in new window | Download
Subscribe: RSS
ELT, or “Extract, Load, and Transform,” is the process that modern data pipelines use to replicate data from a source and load it into a target system such as a cloud data warehouse. ELT is a more flexible evolution of the traditional “Extract, Load, Transform” workflow used in pre-cloud systems. The power of ELT relies on flexible integrations between data sources and their targets, called connectors. The wide variety of data sources available to a cloud application today means that an ELT platform needs to handle a vast, and growing set of use cases for its connectors.
Airbyte is an open-source ELT platform built with the “long tail of integrations” in mind. Airbyte is secure, extensible, and simple to set up. Developers can use Airbyte’s platform to build the connectors they need for their specific use case, without worrying about scheduling, orchestrating, or monitoring.
Michel Tricot and John Lafleur are co-founders of Airbyte. Previously, Michel was Head of Integrations at Liveramp building data ingestion connectors, while John was the co-founder of StreamNation, Anaxi, and CEO of CodinGame. Michel and John join the show today to talk about why ELT has changed the way organizations manage and store their data, what technical challenges exist in the world of data integration, and how Airbyte can give your infrastructure “superpowers.”
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Transcript
Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com/sed to get 20% off the first two months of audio editing and transcription services. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.
Sponsors
If you want to build with modern frontend frameworks like React, Vue, Next.js, and Eleventy you need a place to host your content. Sanity.io is a platform that lets you treat content as data and use next generation APIs to integrate it with websites and apps. Finally you don’t have to choose between great developer experience and great workflows for authors. It’s free to get started, but we also doubled the included monthly usage. Try it out now for your project at sanity.io/sedaily.
O’Reilly is known for its animal books, which have helped tech professionals stay ahead for over forty years. Today, its online learning platform at oreilly.com takes learning tech to the next level. With live online sessions, your teams learn from the biggest brains in AI, software architecture, cloud, data, programming, and more. They can even prep for tech certification exams with official materials and interactive practice tests. It’s why sixty-six percent of all Fortune one hundred companies give their teams O’Reilly online learning. Get a demo today at oreilly.com.
strongDM lets you manage and audit access to servers, databases, and Kubernetes clusters, no matter where your employees are. With strongDM, you can easily extend your identity provider to manage infrastructure access. You can automate onboarding, offboarding, and moving people within roles. strongDM. Manage and audit remote access to infrastructure. Start your free 14 day trial today at: strongdm.com/SEDaily
At Accenture, you can build your specializations through various learning paths, trainings, and certifications we offer. Accenture is hiring experienced AWS developers and architects. Accenture offers opportunities for you to channel your AWS experience into breakthrough innovations. At Accenture, you can benefit from limitless opportunities to expand your knowledge while gaining hands-on AWS experience. Search and apply at softwareengineeringdaily.com/accenture.
