Prophecy: Apple of Data Engineering with Raj Bains
Podcast: Play in new window | Download
Subscribe: RSS
Prophecy is a complete Low-Code Data Engineering Platform for the Enterprise. Prophecy enables all your teams on Apache Spark with a unique low-code designer. While you visually build your Dataflows – Prophecy generates high-quality Spark code on Git. Then, you can schedule Spark workflows with Prophecy’s low-code Airflow. Not only that, Prophecy provides end-to-end visibility into your dataflows with Metadata Search and Column Level Lineage.
For Enterprises, in addition to developing new workflows, data teams also need to migrate thousands of old proprietary ETL workflows to the cloud. For that, Prophecy has built a Transpiler that automatically converts AbInitio, Informatica, SSIS and Alteryx workflows to high-quality Spark code. Learn more at www.prophecy.io.
In this episode, we speak with Raj Bains, who is the founder & CEO of Prophecy.
Previously, Raj was the product manager of Apache Hive at Hortonworks through the IPO. He also headed product management and marketing for a NewSQL database startup.
Raj continues to actively code in compiler and database technologies. His engineering roles include developing a NewSQL database, building CUDA at NVIDIA as a founding engineer, and working as a compiler engineer for Microsoft Visual Studio.
Full disclosure: Prophecy is a sponsor of Software Engineering Daily.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Transcript
Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com to get 15% off the first three months of audio editing and transcription services with code: SED. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.
Sponsors
Oracle wants to help you land those big customers, so they’re offering preferred pricing on enterprise cloud for startups. Free cloud credits and 70% off their cloud services, and with multi-cloud support and no vendor lock-in, you can build it out any way you want. Oracle for Startups doesn’t want you wheezing on the side of the road. They want you to have enough power to scale and land your dream customer. Visit oracle.com/go/sedaily.
Join GitLab August 3 – 4 for its free, virtual user community event, Commit. Software professionals at any organizational level are invited to learn more about how modern DevOps transforms companies of all sizes and pushes teams to drive innovation to the market. During this two-day conference, attendees across all time zones will learn how they can instil modern DevOps practices at their organizations through in-depth training and workshops, hear firsthand digital transformation stories from some of the most well-known companies, and gain insight into cutting-edge CI/CD and security technologies that bring companies to the next level. Get ready to Innovate Together during this free, immersive learning and networking event that will help you commit to better DevOps. To register or learn more about GitLab Commit 2021, visit softwareengineeringdaily.com/commit
Rockset is a real-time indexing database that indexes your data, so you get sub-second search, aggregations and joins on any type of data. It’s a cloud service for real-time analytics. Rockset is purpose-built for real-time analytics. It’s a real-time indexing database that powers sub-second analytical queries including search, aggregations and joins at cloud scale. Deliver real-time interactive analytics in your application in record time. Try now with a free 14-day trial: softwareengineeringdaily.com/rockset.
ClickUp is no-code project management software that brings all of your engineering work into one place, and they guarantee to save you one day every week by consolidating your tools. Engineers use ClickUp to collaborate on code, docs, sprints, bug tracking, roadmaps, and chat. So code smarter, not harder with ClickUp. Try ClickUp for Free today at ClickUp.com/sedaily and use code SED to get 30% off Unlimited and 15% off Business plans.
As former founders and operators, Vertex Ventures has scaled trail-blazing technology companies around the world. They understand the struggle and the risks it takes to build an enduring company, despite the odds. So, they partner closely with fearless engineers and founders like yourself and turn something of promise into a company of consequence. If that sounds like you, talk to them: softwareengineeringdaily.com/vertex
