Data Engineering with Pete Soderling

In the last five years, companies started hiring data engineers. A data engineer creates the systems that manage and access the huge volumes of data that are accumulating on cheap cloud servers. As the saying goes, “it’s more expensive to throw out the data than to store it.”

Pete Soderling joins the show to discuss the rise of the data engineer, and how that role interacts with data scientists, software engineers, and machine learning experts. Pete runs Hakka Labs, a site that aggregates material for data science and data engineering. He also organizes DataEngConf, a conference for data engineering.

 

Sponsors



Hired.com is the job marketplace for software engineers. Go to hired.com/softwareengineeringdaily to get a $600 bonus upon landing a job through Hired.



MongoDB Atlas is the easiest way to get access to MongoDB without having to run the database yourself. To try MongoDB Atlas today, go to mongodb.com/sedaily and use code goAtlas25 to get $25 in free credit.



Jamf Now is a cloud-based Mobile Device Management solution for the iPads, iPhones, and Macs in your workplace. Manage your first 3 devices for free. Add more for just $2/device/month. Create your free account today at jamf.com/SEDaily!

 

Software Daily

Software Daily

 
Subscribe to Software Daily, a curated newsletter featuring the best and newest from the software engineering community.