RudderStack Engineering with Soumaydeb Mitra

Mar 16, 2022 by SED

Customer data pipelines power the backend of many successful web platforms. In a customer data pipeline, data is collected from sources such as mobile apps and cloud SaaS tools, transformed and munged using data engineering, stored in data warehouses, and piped to analytics, advertising platforms, and data infrastructure.

RudderStack is an open source customer data pipeline system that pulls together this disparate functionality. In a previous episode, we covered the basics of RudderStack. In today’s show, we dive deeper into the engineering of RudderStack with returning guest CEO Soumyadeb Mitra.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Transcript

Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com to get 15% off the first three months of audio editing and transcription services with code: SED. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.

Thanks to our sponsors

This episode is brought to you by:

influxdata.com/sedaily
Act in Time with InfluxData. Easy to start, easy to scale. InfluxDB, is THE open source time series database. Purpose-built to handle the massive volumes of time-stamped data produced by IoT devices, applications, networks, containers and computers. Programmable and performant, InfluxDB gives you high granularity, high scale, and high availability. Capture, analyze, and store millions of points per second to see across all your data sources. For more information and to try it for free, visit influxdata.com/sedaily
strongdm.com/SEDaily
strongDM lets you manage and audit access to servers, databases, and Kubernetes clusters, no matter where your employees are. With strongDM, you can easily extend your identity provider to manage infrastructure access. You can automate onboarding, offboarding, and moving people within roles. strongDM. Manage and audit remote access to infrastructure. Start your free 14 day trial today at: strongdm.com/SEDaily
https://getstream.io/
Stream provides an easy-to-integrate chat solution for any application. With robust SDKs and an API built for ease of use, scalability, reliability, and security, product teams can focus on what makes their app unique rather than spending months on building a chat infrastructure. Stream’s feature-rich products include robust client-side SDKs for Angular, iOS, iOS Swift/UI, Android, Compose, React, React Native, Flutter, and Unreal support for the most commonly used server-side languages; scalable and secure APIs; and a beautiful UI kit. Check it out at https://getstream.io/
softwareengineeringdaily.com/montecarlodata
Data engineers struggling with unreliable data rely on Monte Carlo, the world’s first end-to-end, fully automated Data Observability Platform! Monte Carlo enables data teams with visibility into the quality and reliability of their analytical data to maximize business impact. Start trusting your data with Monte Carlo today! Visit softwareengineeringdaily.com/montecarlodata
to learn more.
COXAUTOTECH.COM
Cox Automotive is looking for software engineers, data engineers, scrum masters, and a variety of other positions to help push the technology forward. If you want to innovate in the world of car buying, selling, and ownership, check out COXAUTOTECH.COM to find out more about career opportunities and what it’s like working at Cox Automotive. Cox Automotive isn’t a car company. They are a technology company that’s transforming the automotive industry.