Using LLMs for Training Data Preparation with Nihit Desai

Apr 30, 2024 by SED

Machine learning models learn patterns and relationships from data to make predictions or decisions. The quality of the data influences how well these models can represent and generalize from the data.

Nihit Desai is the Co-founder and CTO at Refuel.ai. The company is using LLMs for tasks such as data labeling, cleaning, and enrichment. He joins the show to talk about the platform, and how to manage data in the current AI era.

Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .

Please click here to see the transcript of this episode.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Thanks to our sponsors

This episode is brought to you by:

Hackerone.com/ai.
As a listener of Software Engineering Daily you understand the impact of generative AI. On the podcast, we’ve covered many exciting aspects of GenAI technologies, as well as the new vulnerabilities and risks they bring.
HackerOne’s AI red teaming addresses the novel challenges of AI safety and security for businesses launching new AI deployments. Their approach involves stress-testing AI models and deployments to make sure they can’t be tricked into providing information beyond their intended use, and that security flaws can’t be exploited to access confidential data or systems.
Within the HackerOne community, over 750 active hackers specialize in prompt hacking and other AI security and safety testing. In a single recent engagement, a team of 18 HackerOne hackers quickly identified 26 valid findings within the initial 24 hours and accumulated over 100 valid findings in the two-week engagement.
HackerOne offers strategic flexibility, rapid deployment, and a hybrid talent strategy. Learn more at Hackerone.com/ai.
softwareengineeringdaily.com/workos
WorkOS is a developer platform to make your app enterprise-ready. With a few simple APIs, you can immediately add common enterprise features like Single Sign-On, SAML, SCIM user provisioning, and more. Developers will find beautiful docs and SDKs that make integration a breeze. WorkOS is kind of like “Stripe for enterprise features.” WorkOS powers apps like Webflow, Hopin, Vercel, and more than 100 others. The platform is rock solid, fully SOC-2 compliant, and ready for even the largest enterprise environments. So what are you waiting for? Integrate WorkOS today and make your app enterprise-ready. To learn more and get started, go to softwareengineeringdaily.com/workos
RudderStack.com/SED
Join The RudderStack Transformation Challenge today for a chance to win a $1,000 cash prize just by submitting a Transformation to the open-source RudderStack Transformation library. Visit RudderStack.com/SED to learn more.

Hackerone.com/ai.

softwareengineeringdaily.com/workos

RudderStack.com/SED

Subscribe to the newsletter

Related episodes

Subscribe
to the newsletter