Hyperparameter Tuning with Richard Liaw

Hyperparameters define the strategy for exploring a space in which a machine learning model is being developed. Whereas the parameters of a machine learning model are the actual data coming into a system, the hyperparameters define how those data points are fed into the training process for building a model to be used by an end consumer.

A different set of hyperparameters will yield a different model. Thus, it is important to try different hyperparameter configurations to see which models end up performing better for a given application. Hyperparameter tuning is an art and a science.

Richard Liaw is an engineer and researcher, and the creator of Tune, a library for scalable hyperparameter tuning. Richard joins the show to talk through hyperparameters and the software that he has built for tuning them.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Transcript

Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com/sed to get 20% off the first two months of audio editing and transcription services. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.


Sponsors

Bridgecrew makes cloud security accessible to developers by integrating earlier in the development lifecycle via CI/CD pipelines and implementing fixes directly back into developer workflows via pull requests. In addition to helping teams address cloud resources in production, Bridgecrew shifts cloud security left by scanning for, fixing, and preventing misconfigurations at the infrastructure-as-code level. Find out more at bridgecrew.io/sedaily

From their recent report on serverless adoption and trends, Datadog found half of their customer base using EC2s have now adopted AWS Lambda. You can easily monitor all your serverless functions in one place and generate serverless metrics straight from Datadog. Check it out yourself by signing up for a free 14-day trial and get a free t-shirt at softwareengineeringdaily.com/datadog

Code doesn’t always behave as you expect, and your team is wasting time trying to understand why. Empower your engineers with Rookout. Get the data you need from live systems instantly, and start shipping better software, faster. Visit rookout.com/sedaily today.

Chaos Conf is a free, online conference taking place on October 6-8. You can register for free at chaosconf.io. This year’s keynote speakers are Gene Kim, author of the Phoenix Project and Adrian Cockroft, VP of Cloud Architecture Strategy at AWS.  There will be 20 sessions for all experience levels focusing on the practice of reliability, completing the DevOps loop, and how to build a data-driven culture of reliability. Register for free at chaosconf.io. The first 1,000 registrants will receive a limited edition swag pack. Claim yours at chaosconf.io

Software Weekly

Software Weekly

Subscribe to Software Weekly, a curated weekly newsletter featuring the best and newest from the software engineering community.