Lyft Data Discovery with Tao Feng and Mark Grover

RECENT UPDATES:

Podsheets is our open source set of tools for managing podcasts and podcast businesses

New version of Software Daily, our app and ad-free subscription service

Software Daily is looking for help with Android engineering, QA, machine learning, and more

FindCollabs Hackathon has ended–winners will probably be announced by the time this episode airs; we will be announcing our next hackathon in a few weeks, so stay tuned

Lyft is a ridesharing company with petabytes of data. Within Lyft, many different employees can use those data sets to build useful applications.

A business analyst creates a dashboard to see how driver satisfaction is changing over time. An economist studies the pricing data to ensure that Lyft’s prices are competitive. A data scientist creates a report of how the speed of a ride correlates with 5 star ratings. A machine learning engineer trains a model to detect fraud on the platform.

All of these use cases make sense–and in each of them, the employee at Lyft needs to find the necessary data sets within the company to build their application. Amundsen is a tool for finding and discovering data sets within the company.

Tao Feng and Mark Grover are engineers at Lyft and join the show to talk about the problem of data discovery and the tools they have built at Lyft.

Transcript

Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com/sed to get 20% off the first two months of audio editing and transcription services. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.


Sponsors

Vettery is an online hiring marketplace that connects highly qualified job-seekers with inspiring companies. Once you’re accepted to Vettery, companies reach out directly to you. Sign up on vettery.com/sedaily and get a $500 bonus if you accept a job through Vettery.

Flatiron School can teach you the skills you need to build a career that you will love. Flatiron School has immersive programming courses on JavaScript and Ruby–everything you need to become a full stack developer. Flatiron School also has courses on Python, SQL, and machine learning, for data scientists in training. You can learn in-person or online–and you can find everything you need to get started by going to flatironschool.com/sedaily.

Netlify is a modern way to build and manage fast, modern websites that run without the need for addressable web servers. Netlify is “serverless.” Automatic forms, identity management, and tools to manage and transform large images and media. Learn more about Netlify’s powerful platform at netlify.com/sedaily.

Get ready to build content-rich websites and professional web applications with Wix Code. Store and manage unlimited data with built-in databases, create dynamic pages, make custom forms and take full control of your site’s functionality with Wix Code APIs and JavaScript. Plus, now you can get 10-percent off your Premium plan. Go to Wix.com/SED.

Software Weekly

Software Weekly

Subscribe to Software Weekly, a curated weekly newsletter featuring the best and newest from the software engineering community.