Lyft Data Discovery with Tao Feng and Mark Grover
Lyft is a ridesharing company with petabytes of data. Within Lyft, many different employees can use those data sets to build useful applications.
A business analyst creates a dashboard to see how driver satisfaction is changing over time. An economist studies the pricing data to ensure that Lyft’s prices are competitive. A data scientist creates a report of how the speed of a ride correlates with 5 star ratings. A machine learning engineer trains a model to detect fraud on the platform.
All of these use cases make sense–and in each of them, the employee at Lyft needs to find the necessary data sets within the company to build their application. Amundsen is a tool for finding and discovering data sets within the company.
Tao Feng and Mark Grover are engineers at Lyft and join the show to talk about the problem of data discovery and the tools they have built at Lyft.
Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com/sed to get 20% off the first two months of audio editing and transcription services. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.
Vettery is an online hiring marketplace that connects highly qualified job-seekers with inspiring companies. Once you’re accepted to Vettery, companies reach out directly to you. Sign up on vettery.com/sedaily and get a $500 bonus if you accept a job through Vettery.
Netlify is a modern way to build and manage fast, modern websites that run without the need for addressable web servers. Netlify is “serverless.” Automatic forms, identity management, and tools to manage and transform large images and media. Learn more about Netlify’s powerful platform at netlify.com/sedaily.