Automatic Database Tuning with Andy Pavlo

The default configuration in most databases is meant for broad compatibility rather than performance. Database tuning is a process in which the configurations of a database are modified to achieve optimal performance. Databases have hundreds of configuration knobs that control various factors, such as the amount of memory to use for caches or how often the data is written to the storage.

The problem with these knobs is that

  • they are not standardized (i.e., two databases may have a different name for the same knob),
  •  not independent (i.e., changing one knob can impact others), 
  • and not universal (i.e., what works for one application may be suboptimal for another). 

In reality, information about the effects of the knobs typically comes only from (expensive) experience.

OtterTune is automatic database tuning software that promises to overcome these problems. It uses machine learning to tune the configuration knobs of your database automatically to improve performance.

In this episode, we interview Andy Pavlo. Andy is a Database Professor at Carnegie Mellon and Co-Founder of OtterTune.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Transcript

Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com to get 15% off the first three months of audio editing and transcription services with code: SED. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.

 


Sponsors

WorkOS is a developer platform to make your app enterprise-ready. With a few simple APIs, you can immediately add common enterprise features like Single Sign-On, SAML, SCIM user provisioning, and more. Developers will find beautiful docs and SDKs that make integration a breeze. WorkOS is kind of like “Stripe for enterprise features.” WorkOS powers apps like Webflow, Hopin, Vercel, and more than 100 others. The platform is rock solid, fully SOC-2 compliant, and ready for even the largest enterprise environments. So what are you waiting for? Integrate WorkOS today and make your app enterprise-ready. To learn more and get started, go to softwareengineeringdaily.com/workos

All those points and miles can feel pretty pointless if they expire or go unused every year.
It’s time to reboot your credit card with Apple Card.
Apple Card gives you unlimited cash back every day, on every purchase. It’s real cash you can spend right away, however you want. No need to wait … and wait to use. Apply now in the Wallet app on iPhone and start using it right away.
Subject to credit approval. Daily cash is available via an Apple Cash card or as a statement credit. See Apple Card customer agreement for terms and conditions. Apple Cash card is issued by Green Dot Bank, Member FDIC.

To a cybercriminal, the most desirable credentials are the ones with full access to an organization’s most sensitive data. Yet these highly sensitive credentials are almost always hardcoded into source code, CI/CD systems or config files.
Keeper Secrets Manger is a fully managed, cloud-based and zero-knowledge platform for securing infrastructure secrets such as API keys, database passwords, access keys, certificates, and confidential data.
Organizations can get Keeper Secrets Manager up and running in about 20 minutes, which is less than the time it would take just to download traditional solutions’ appliances,
Manage your infrastructure secrets without any added complexity, maintenance or security issues.
Try Keeper Secrets Manager for free today.

Get started by visiting https://www.keepersecurity.com/

Data engineers struggling with unreliable data rely on Monte Carlo, the world’s first end-to-end, fully automated Data Observability Platform! Monte Carlo enables data teams with visibility into the quality and reliability of their analytical data to maximize business impact. Start trusting your data with Monte Carlo today! Visit softwareengineeringdaily.com/montecarlodata to learn more.

Software Daily

Software Daily

 
Subscribe to Software Daily, a curated newsletter featuring the best and newest from the software engineering community.