Pravega: Storage for Streams with Flavio Junquiera

“Data stream” is a word that can be used in multiple ways. A stream can refer to data in motion or data at rest. 

When a stream is data in motion, an endpoint is receiving new pieces of data on a continual basis. Each new data point is sent over the wire and captured by the other end. Another way a stream can be represented is as a sequence of events that have been written to a storage medium. This is a stream at rest.

Pravega is a system for storing large streams of data. Pravega can be used as an alternative to systems like Apache Kafka or Apache Pulsar. Flavio Junquiera is an engineer at Dell EMC who works on Pravega. He joins the show to talk about the history of stream processing and his work on Pravega.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

Transcript

Transcript provided by We Edit Podcasts. Software Engineering Daily listeners can go to weeditpodcasts.com/sed to get 20% off the first two months of audio editing and transcription services. Thanks to We Edit Podcasts for partnering with SE Daily. Please click here to view this show’s transcript.


Sponsors

G2i is a hiring platform run by engineers that matches you with React, React Native, GraphQL, and mobile engineers who you can trust. Whether you are a new company building your first product or an established company that wants additional engineering help, G2i has the talent you need to accomplish your goals. Go to softwareengineeringdaily.com/g2i

JFrog Container Registry is a comprehensive registry that supports Docker containers and Helm Chart repositories for your Kubernetes deployments. It supports not only local storage for your artifacts, but also proxying remote registries and repositories, and virtual repositories to simplify configuration. Use JFrog Container Registry to search the custom metadata of your repositories. To find out more about JFrog Container Registry, visit softwareengineeringdaily.com/jfrog

strongDM lets you manage and audit access to servers, databases, and Kubernetes clusters, no matter where your employees are. With StrongDM, you can easily extend your identity provider to manage infrastructure access. You can automate onboarding, offboarding, and moving people within roles. strongDM. Manage and audit remote access to infrastructure. Start your free 14 day trial today at: strongdm.com/SEDaily

The Uptake is a new show on all things tech and community. Host Anna Chu will be traveling and introducing you to people all over the world as she follows the path of Microsoft Ignite The Tour. The show covers topics in the world of tech, as well as uncovers people’s journeys – and how-tos – of professional learning, development and community building. You will meet inspiring people in the community of tech and get inspired to be part of a vast and expanding community in your area and beyond. Subscribe today.

Software Weekly

Software Weekly

Subscribe to Software Weekly, a curated weekly newsletter featuring the best and newest from the software engineering community.