CoreOS with Brandon Philips

Play

Podcast: Play in new window | Download Google’s infrastructure has been the source inspiration for research papers, software projects, and entire companies. Google pioneered the idea that we care less about the individual machines we are running our applications on, and more about the applications themselves.   Containers are the abstraction we use to separate the concerns of the application from those of the underlying hardware. CoreOS is an operating system

Continue reading…

Artificial Intelligence with Oren Etzioni

Play

Podcast: Play in new window | Download Research in artificial intelligence takes place mostly at universities and large corporations, but both of these types of institutions have constraints that cause the research to proceed a certain way. In a university, basic research might be hindered by lack of funding. At a big corporation, the researcher might be encouraged to study a domain that is not squarely in the interest of

Continue reading…

Uber’s Ringpop with Jeff Wolski

Play

Podcast: Play in new window | Download Uber has a software architecture with unique requirements. Uber does not have the firehose of user engagement data that Twitter or Facebook has, but each transaction on Uber is both high value and time-sensitive. Users are paying for transportation that they expect to be available and reasonably close by. When Uber’s system is trying to match a rider with a driver, availability is

Continue reading…

Kubernetes Migration with Sheriff Mohamed

Play

Podcast: Play in new window | DownloadKubernetes is a cluster management tool open sourced by Google. On Software Engineering Daily, we’ve done numerous shows on how Kubernetes works in theory. Today’s episode is a case study in how to deploy Kubernetes to production at a company with existing infrastructure.   GolfNow is a fifteen year-old application written in C# .NET. It is a successful, growing business that is a division

Continue reading…

Distributed Tracing with Reshmi Krishna

Play

Podcast: Play in new window | Download In a microservices architecture, a user request will often make its way through several different services before it returns a result to the end user. If a user experiences a failed request, the root cause could be in any of the services along that request path. Even more problematic is the challenge of debugging latency in this kind of request chain.   Reshmi

Continue reading…

Serverless Architecture with Mike Roberts

Play

Podcast: Play in new window | Download “Serverless” usually refers to an architectural pattern where the server side logic is run in stateless compute containers that are event-triggered and ephemeral. Mike Roberts has written a series of articles about serverless computing, in which he discusses theories and patterns around serverless architecture. In this episode, Mike and I discuss how to reimagine our software architecture using functions-as-a-service. We go into the

Continue reading…

Akka Reactive Streams with Konrad Malawski

Play

Podcast: Play in new window | Download Akka is a toolkit for building concurrent, distributed, message-driven applications on the JVM. Akka provides an implementation of the actor model of concurrency, which simplifies concurrency by adding a lighter weight abstraction than threads and thread pools.   Konrad Malawski joins the show today to discuss Akka and reactive streams. Reactive streams is an initiative to provide a standard for asynchronous stream processing.

Continue reading…

Apache Beam with Frances Perry

Play

Podcast: Play in new window | Download Unbounded data streams create difficult challenges for our application architectures. The data never stops coming, and we are forced to assume that we will never know if or when we have seen all of our data. Some streaming systems give us the tools to deal partially with unbounded data streams, but we have to complement those streaming systems with batch processing, in a

Continue reading…

TensorFlow in Practice with Rajat Monga

Play

Podcast: Play in new window | Download TensorFlow is Google’s open source machine learning library. Rajat Monga is the engineering director for TensorFlow. In this episode, we cover how to use TensorFlow, including an example of how to build a machine learning model to identify whether a picture contains a cat or not.   TensorFlow was built with the mission of simplifying the process of deploying a machine learning model

Continue reading…

Data Validation with Dan Morris

Play

Podcast: Play in new window | Download Data Validation is the process of ensuring that data is accurate. In many software domains, an application is pulling in large quantities of data from external sources. That data will eventually be exposed to users, and it needs to be correct. Radius Intelligence is a company that aggregates data on small businesses. In order to ensure that business addresses and phone numbers are

Continue reading…

Machine Learning for Sales with Per Harald Borgen

Play

Podcast: Play in new window | Download Machine learning has become simplified. Similar to how Ruby on Rails made web development approachable, scikit-learn takes away much of the frustrating aspects of machine learning, and lets the developer focus on building functionality with high-level APIs.   Per Harald Borgen is a developer at Xeneta. He started programming fairly recently, but has already built a machine learning application that cuts down on

Continue reading…

Flexport Engineering with Amos Elliston

Play

Podcast: Play in new window | Download Flexport is a technology company that makes logistics, supply chain management, and freight forwarding software. Shipping freight across the world requires container ships, airplanes, trains, warehouses, and trucks. Flexport’s software integrates with many of these different shipping companies, and provides a dashboard for the end user to understand how their products are being shipped around the world.   Amos Elliston is the CTO

Continue reading…

Data Breaches with Troy Hunt

Play

Podcast: Play in new window | Download When you hear about massive data breaches like the recent ones from LinkedIn, MySpace, or Ashley Madison, how can you find out whether your own data was compromised?   Troy Hunt created the website HaveIBeenPwned.com to answer this question. When a major data breach occurs, Troy acquires a copy of the stolen data and provides a safe way for individuals to check if

Continue reading…

unikernels and unik with Scott Weiss

Play

Podcast: Play in new window | Download The Linux kernel of many popular operating system distributions contains 200-500 million lines of code. The average user never touches many of the libraries that are contained in these operating system distributions. For example, if you spin up a virtual machine on a cloud service provider, the virtual machine will have a USB driver. This is wasted space, because you can’t even interact

Continue reading…

Prometheus Monitoring with Brian Brazil

Play

Podcast: Play in new window | Download Prometheus is a tool for monitoring our distributed applications. It allows us to focus on the services we are deploying rather than the individual machines that make up instances of that service.   The monitoring service itself is a portion of a distributed system that is treated differently than the services we are monitoring. We don’t want to use a consensus-based tool like

Continue reading…

Podcast Infrastructure with Mikael Emtinger

Play

Podcast: Play in new window | Download The technology underlying podcasts is simple–a podcaster publishes mp3 files to an RSS feed, and the listener subscribes to that feed, receiving mp3s whenever the feed is updated. Unfortunately, the simplicity of podcasts makes it difficult to build automated advertising infrastructure on top of that simple RSS model. This lack of rich automated advertising has kept podcasting from flourishing. aCast is a company

Continue reading…

GraphQL as a Service with Scaphold.io

Play

Podcast: Play in new window | Download GraphQL was open sourced out of Facebook, and gave developers a way to unify their different data sources into a single endpoint. Although the promise of GraphQL is appealing, the process of setting up a GraphQL server that can communicate with each disparate data source can prove to be complex. Scaphold.io provides GraphQL as a service, and today’s guests are the creators of

Continue reading…

You Are Not A Commodity

Play

Podcast: Play in new window | DownloadMost episodes of Software Engineering Daily are interviews with an expert about a technical software concept. Occasionally I write editorials, and also record them as a podcast. The first editorial was about 10 Philosophies for Engineers, the second was about how poker relates to software engineering, and the third was about music and software engineering. Today’s episode is called “You Are Not A Commodity”. Since it

Continue reading…

Industries of the Future with Alec Ross

Play

Podcast: Play in new window | Download Alec Ross worked in the White House as a Senior Policy Advisor to Hillary Clinton. His book Industries of the Future explores the biggest technological opportunities and threats to our society. The industries addressed in his book include robotics, genetics, and cybersecurity. Technological familiarity is increasingly correlated with an individual’s optimism. Cyberwarfare presents attack vectors that are difficult to insulate against. Arguments about

Continue reading…

Clojure with Alex Miller

Play

Podcast: Play in new window | Download Clojure is a dynamically typed functional language that runs on the JVM. Today’s guest Alex Miller gives us an overview of Clojure’s core functionality. Alex is a developer of Cognitect, and a founder of the the Strange Loop conference.     We discuss the data structures, garbage collection, and concurrency support. How does Clojure compare to other JVM languages like Scala and Groovy? How

Continue reading…