Responsibly Deploy AI in Production with Anupam Datta

Once a machine learning model is trained and validated, it often feels like a major milestone has been achieved.  In reality, it’s more like the first lap in a relay race.  Deploying ML to production bears many similarities to a typical software release process, but brings several novel challenges like failing to generalize as expected or model drift.

AI Quality management is the biggest challenge in AI today.  In this episode, I interview Anupam Datta, the co-founder at TruEra.  TruEra has a solution aimed at helping with AI performance, monitoring, and model explainability.  We talk about some of the challenges of modern machine learning deployment in production and how companies are succeeding with ML Ops.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Transcript

Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com to get 15% off the first three months of audio editing and transcription services with code: SED. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.


Sponsors

Your development team’s time is a scarce resource. Don’t waste it reinventing the wheel. With Auth0 you can save hundreds or thousands of hours in implementation and maintenance. With this premier solution for identity, you can configure advanced features like social login, single sign-on, and multi-factor authentication. Focus on what you’re good at and let Auth0 manage what they’re best at – helping you deliver the best, safest user experience possible. Make login their problem, not yours. Visit auth0.com to learn more.

From startups to enterprises, engineering teams use ClickUp to collaborate on code, docs, goals, sprints, bug tracking, roadmaps, and more. You can also connect your favorite developer tools like GitHub, Bitbucket, and Gitlab to manage your code and team in one place. Don’t get stuck with Jira. Sprint through Agile with ClickUp and save one day every week. Try ClickUp for free today at ClickUp.com/sedaily!

Looking to optimize your cloud costs with keen visibility and smart management? Meet Yotascale, for a dynamic, centralized view of your total spend across AWS, Azure, containers, and Kubernetes. Perform sharp budgeting and forecasting, and create actionable recommendations and earn 50% or greater savings on cloud cost.
Ask our customers like Hulu, Zoom, and Compass about their major savings with Yotascale. Then visit yotascale.com/sedaily for details and receive our newly released white paper titled, “You Need True Multi-Cloud Cost Management. Here’s Why.”

Get the full coding and design freedom to create anything your clients need, along with the tools to manage and collaborate with your team seamlessly from anywhere. And when it comes to growing your business – you can get matched with new leads every day, and earn revenue share for every website you create. Head over to Wix.com/Partners and reimagine what your agency can accomplish. 

Spend less time debugging and more time shipping new features. Quickly find discrepancies between how you think your code is supposed to work and how it really works in the real world. Stop using 3 separate pillars and unify your view of production. Sign up for free Honeycomb at softwareengineeringdaily.com/honeycomb

Software Daily

Software Daily

Subscribe to Software Daily, a curated newsletter featuring the best and newest from the software engineering community.