Druid: Event-Driven Data with Eric Tschetter

Aug 16, 2021 by SED

Whether sending messages, shopping in an app, or watching videos, modern consumers expect information and responsiveness to be near-instant in their apps and devices. From a developer’s perspective, this means clean code and a fast database.

Apache Druid is a database built to power real-time analytic workloads for event-driven data, like user-facing applications, streaming, and anything else that requires instant data visibility. Druid offers lower latency for OLAP-style queries, time-based partitioning, fast search and filter, and out-of-the-box integration with Apache Kafka, AWS Kinesis, HDFS, AWS S3, and more (Druid.apache.org).

In this episode we talk with Eric Tschetter, Field CTO at Imply, Fellow at Splunk, and experience developing large swaths of backend infrastructure largely focusing on Druid. We discuss the use cases and power of Apache Druid.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Transcript

Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com to get 15% off the first three months of audio editing and transcription services with code: SED. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.

Thanks to our sponsors

This episode is brought to you by:

prophecy.io/sedaily
Prophecy makes Enterprise data teams productive with new workflows – but what about existing workflows that are stuck in old proprietary ETL formats? For that, Prophecy has a Transpiler that automatically converts AbInitio, Informatica, SSIS, and Alteryx workflows to high-quality Spark code. See how Prophecy can modernize your data engineering with a free account at prophecy.io/sedaily.
jetbrains.space
JetBrains Space is a unified platform for the entire software development pipeline and for team collaboration. It combines Git hosting, code reviews, CI/CD, packages, planning tools, issues, documents, chats, teams, calendars, and blogs – all in one place. Space allows integration with IntelliJ-based IDEs, making the developer experience more productive and enjoyable. Bring your software teams together to communicate and deliver high-quality code faster. Space is available with a free cloud plan for unlimited users. Get started for free today at jetbrains.space.
softwareengineeringdaily.com/g2i
G2i is a hiring platform run by engineers that matches you with React, React Native, GraphQL, and mobile engineers who you can trust. Whether you are a new company building your first product or an established company that wants additional engineering help, G2i has the talent you need to accomplish your goals. Go to softwareengineeringdaily.com/g2i
softwareengineeringdaily.com/datadogsecurity
Security threats in cloud-native environments move fast, which means that security teams need to have the same visibility into their infrastructure, network, and applications as developers and operations. With Datadog Security Monitoring, engineering teams can easily detect malicious activity in real-time before it affects their customers. Use OOTB detection rules and detailed observability data in one, unified platform to investigate security attacks. See it in action by signing up for a live security demo and receive a Datadog T-shirt by visiting softwareengineeringdaily.com/datadogsecurity
linode.com/sedaily
Simplify your cloud infrastructure with Linode’s Linux virtual machines and develop, deploy, and scale your modern applications faster and easier. Get started on Linode today with a $100 in free credit for listeners of Software Engineering Daily. You can find all the details at linode.com/sedaily