Druid: Event-Driven Data with Eric Tschetter

Whether sending messages, shopping in an app, or watching videos, modern consumers expect information and responsiveness to be near-instant in their apps and devices. From a developer’s perspective, this means clean code and a fast database. 

Apache Druid is a database built to power real-time analytic workloads for event-driven data, like user-facing applications, streaming, and anything else that requires instant data visibility. Druid offers lower latency for OLAP-style queries, time-based partitioning, fast search and filter, and out-of-the-box integration with Apache Kafka, AWS Kinesis, HDFS, AWS S3, and more (Druid.apache.org).

In this episode we talk with Eric Tschetter, Field CTO at Imply, Fellow at Splunk, and experience developing large swaths of backend infrastructure largely focusing on Druid. We discuss the use cases and power of Apache Druid.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Transcript

Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com to get 15% off the first three months of audio editing and transcription services with code: SED. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.


Sponsors

Prophecy makes Enterprise data teams productive with new workflows – but what about existing workflows that are stuck in old proprietary ETL formats? For that, Prophecy has a Transpiler that automatically converts AbInitio, Informatica, SSIS, and Alteryx workflows to high-quality Spark code. See how Prophecy can modernize your data engineering with a free account at prophecy.io/sedaily.

JetBrains Space is a unified platform for the entire software development pipeline and for team collaboration. It combines Git hosting, code reviews, CI/CD, packages, planning tools, issues, documents, chats, teams, calendars, and blogs – all in one place. Space allows integration with IntelliJ-based IDEs, making the developer experience more productive and enjoyable. Bring your software teams together to communicate and deliver high-quality code faster. Space is available with a free cloud plan for unlimited users. Get started for free today at jetbrains.space.

G2i is the only marketplace just for pre-vetted JavaScript developers. Hire React, React Native, & Node.js developers you can trust on a contract or full-time basis. G2i will match you with pre-vetted developers within three days of your onboarding call. You’ll be able to review their technical profiles and set up interviews with candidates you like. You get a detailed technical profile that provides the developer’s assessment scores in each category, a copy of their code challenge, and a recording of their technical interview. Test a working relationship with no risk! The first week is free if you decide your developer isn’t a good fit. G2i’s litmus test is simple: can this developer make an impact in your code base within their first week? Go to softwareengineeringdaily.com/g2i to get started.

With infrastructure monitoring, distributed tracing, and logs, Datadog provides end-to-end visibility into the health and performance of modern applications. Datadog’s distributed tracing and APM generates detailed flame graphs from real requests, enabling you to visualize how requests propagate through your distributed infrastructure. See which services or calls are generating errors or contributing to overall latency, and dive deeper into your production code with an always-on code profiler to pinpoint the root cause and optimize your application faster at no additional overhead, regardless of your scale. Start monitoring your applications with a free trial and Datadog will send you a free T-shirt! softwareengineeringdaily.com/datadog

From Linode’s award-winning support (offered 24/7/365 to every level of user) to ease of use and setup; it’s clear why developers have been trusting Linode for projects both big and small since 2003. Linode makes cloud computing  simple, affordable, and accessible, allowing you to focus on your customers, not your infrastructure. Visit linode.com/sedaily, create a free account with your google or github account or your email address and you’ll get $100 in credit.

Software Weekly

Software Weekly

Subscribe to Software Weekly, a curated weekly newsletter featuring the best and newest from the software engineering community.