Machine Learning Labeling and Tooling with Lukas Biewald

CrowdFlower was a company started in 2007 by Lukas Biewald, an entrepreneur and computer scientist. CrowdFlower solved some of the data labeling problems that were not being solved by Amazon Mechanical Turk. A decade after starting CrowdFlower, the company was sold for several hundred million dollars.

Today, data labeling has only grown in volume and scope. But Lukas has moved on to a different part of the machine learning stack: tooling for hyperparameter search and machine learning monitoring.

Lukas Biewald joins the show to talk about the problems he was solving with CrowdFlower, the solutions that he developed as part of that company, and the efforts with his current focus: Weights and Biases, a machine learning tooling company.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Transcript

Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com/sed to get 20% off the first two months of audio editing and transcription services. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.


Sponsors

From their recent report on serverless adoption and trends, Datadog found half of their customer base using EC2s have now adopted AWS Lambda. You can easily monitor all your serverless functions in one place and generate serverless metrics straight from Datadog. Check it out yourself by signing up for a free 14-day trial and get a free t-shirt at softwareengineeringdaily.com/datadog

Bridgecrew makes cloud security accessible to developers by integrating earlier in the development lifecycle via CI/CD pipelines and implementing fixes directly back into developer workflows via pull requests. In addition to helping teams address cloud resources in production, Bridgecrew shifts cloud security left by scanning for, fixing, and preventing misconfigurations at the infrastructure-as-code level. Find out more at bridgecrew.io/sedaily

Teleport is open-source, written in Go, and is a drop-in replacement for OpenSSH. Plus, it has a native support for Kubernetes. Gravitational’s  Teleport provides identity-aware access using short-lived certificates with SSO, session recording, and other features that ensure compliance and audit requirements. Go give it a try by going to try.gravitational.com/sed, where there are links to downloads, documentation, and, of course, the GitHub repository.

Spending too much time debugging in production? The days of endless logging and debugging sessions should be long gone. Give your engineers 48% of their time back and fetch data instantly from production systems with Rookout. Visit rookout.com/sedaily today.

Software Weekly

Software Weekly

Subscribe to Software Weekly, a curated weekly newsletter featuring the best and newest from the software engineering community.