Ray Applications with Richard Liaw

Ray is a general purpose distributed computing framework. At a low level, Ray provides fault-tolerant primitives that support applications running across multiple processors. At a higher level, Ray supports scalable reinforcement learning, including the common problem of hyperparameter tuning.

In a previous episode, we explored the primitives of Ray as well as Anyscale, the business built around Ray and reinforcement learning. In today’s episode, Richard Liaw explores some of the libraries and applications that sit on top of Ray. 

RLlib gives APIs for reinforcement learning such as policy serving and multi-agent environments. Tune gives developers an easy way to do scalable hyperparameter tuning, which is necessary for exploring different types of deep learning configurations. In a future show, we will explore Tune in more detail.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com


Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com/sed to get 20% off the first two months of audio editing and transcription services. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.


strongDM lets you manage and audit access to servers, databases, and Kubernetes clusters, no matter where your employees are. With strongDM, you can easily extend your identity provider to manage infrastructure access. You can automate onboarding, offboarding, and moving people within roles. strongDM. Manage and audit remote access to infrastructure. Start your free 14 day trial today at: strongdm.com/SEDaily

Springboard is an online education program that gives you hands-on experience with creating and deploying machine learning models into production. Listeners can get $500 in scholarship if they use the code AISPRINGBOARD–this scholarship is for 20 students who enroll by going softwareengineeringdaily.com/springboard and enter the code AISPRINGBOARD. It takes about 10 minutes to apply, it’s free, and it’s awarded on a first come first serve basis.

Honeybadger combines error monitoring, uptime monitoring and chron monitoring into a single, easy to use platform, for less cost than you’re probably paying now. Software Engineering Daily listeners get 30% off for 6 months. Simply mention Software Engineering Daily when signing up and they’ll apply the discount to your account; no credit card required.

Sentry.io can quickly triage and resolve issues in real-time. Sentry works for every major language and framework, from Rails, C#, Java, or React Native for example–install the SDKs, and integrate it with your application. If you are building an application and want to monitor errors and performance, try Sentry by visiting Sentry.io/signup. New users can use code SEDAILY for 2 free months.