Slack Security with Ryan Huber

http://traffic.libsyn.com/sedaily/Slack_Security_edited.mp3Podcast: Play in new window | Download Security for the popular chat application Slack is a major focus for the company. A corporate Slack account is as valuable to a hacker as a corporate email account. In today’s episode, Ryan Huber and I talk through Slack’s approach to security–from philosophical discussions of how to company approaches security to the technical practices of logging and monitoring, and why Slack has a

Continue reading…

Tech Leadership with Jeff Norris

http://traffic.libsyn.com/sedaily/Techleadership_Edited.mp3Podcast: Play in new window | Download The role of “tech lead” is a combination of a software engineer, a project manager, and an architect. A tech lead might spend 30% of her time coding and 70% managing a project, resolving conflicts, and planning.   In today’s episode, we discuss the structure of software teams, and when it might make sense to have a tech lead on your team, in

Continue reading…

Devoxx4Kids with Arun Gupta

http://traffic.libsyn.com/sedaily/Devoxx4Kids_edited.mp3Podcast: Play in new window | Download Devoxx4Kids is an organization that is inspiring children through robotics, programming, and engineering. Kids who attend a Devoxx4Kids workshop are exposed to entertaining and educational activities, such as writing a Minecraft mod or programming an Arduino.   Arun Gupta is a software engineer and the president of the board for Devoxx4Kids USA. In this episode we discuss coding education for kids, and what

Continue reading…

Cloud Clients with Jon Skeet

http://traffic.libsyn.com/sedaily/CloudClients_edited.mp3Podcast: Play in new window | Download Google builds cloud services for developers, such as PubSub, Cloud Storage, BigQuery, and Cloud DataStore. On Software Engineering Daily, we’ve done lots of shows about how these types of services are built. In this episode, we are zooming in on the interaction between the developer using a cloud service and the design and engineering of the client APIs.   To build a useful

Continue reading…

Electronic Frontier Foundation with Nate Cardozo

http://traffic.libsyn.com/sedaily/EFF_Nate_Edited.mp3Podcast: Play in new window | Download When the US government hacks its own citizens, The Electronic Frontier Foundation is often the best source of reporting to find out what laws the government has broken. When a change to the privacy policy of Google or Facebook is made, the Electronic Frontier Foundation is the best place to find out how that change in privacy exploits users. The Electronic Frontier Foundation

Continue reading…

Cloud Dataflow with Eric Anderson

http://traffic.libsyn.com/sedaily/Google_Cloud_Edited.mp3Podcast: Play in new window | Download Batch and stream processing systems have been evolving for the past decade. From MapReduce to Apache Storm to Dataflow, the best practices for large volume data processing have become more sophisticated as the industry and open source communities have iterated on them.   Dataflow and Apache Beam are projects that present a unified batch and stream processing system. A previous episode with Frances

Continue reading…

Commodity Discussion with Preethi Kasireddy

http://traffic.libsyn.com/sedaily/Commodity_Discussion_Edited.mp3Podcast: Play in new window | Download A previous episode of Software Engineering Daily called “You Are Not A Commodity” received a lot of feedback, both negative and positive. The episode was a monologue I wrote about why engineers should build products on their own as a default career path, rather than work at a large corporation as a default career path.   A reddit thread about the episode was

Continue reading…

Unikernels with Idit Levine

http://traffic.libsyn.com/sedaily/Unikernels_Edited.mp3Podcast: Play in new window | Download Unikernels allow us to specify the minimum features of an operating system we need to deploy our applications. We’ve had many shows about containers, which allow you to deploy your application on top of a segregated portion of an operating system. Unikernels are different because they can be deployed directly to bare metal or to a hypervisor.   Idit Levine works on Unikernels

Continue reading…

Microsoft Antitrust with Harry First

http://traffic.libsyn.com/sedaily/MSFT_Legal_edited.mp3Podcast: Play in new window | Download Microsoft was the dominant technology company in the 1990’s, until it came under fire for anticompetitive practices. Internet Explorer was tightly coupled to the Windows operating system, which prevented Netscape Navigator–a competing browser–from reaching users on the dominant platform.   This episode is about antitrust–what businesses can and cannot do in the name of competition, what the impact of Microsoft’s legal battles in

Continue reading…

Slack’s Architecture with Keith Adams

http://traffic.libsyn.com/sedaily/Slack_Architecture.mp3Podcast: Play in new window | Download Slack is a chat application that is rapidly growing in popularity. The focus of Slack is to create a polished, responsive tool for productivity that cuts down on the emailing, context switching, and useless meetings that take place at a typical enterprise.   Keith Adams, the chief architect at Slack, joins the show to explain how those high level principles translate into engineering

Continue reading…

Uber’s Postgres Problems with Evan Klitzke

http://traffic.libsyn.com/sedaily/Uber_DBs.mp3Podcast: Play in new window | Download When a company switches the relational database it uses, you wouldn’t expect the news of the switch to go viral. Most engineers are not interested in the subtle differences between MySQL and Postgres, right?   Uber recently switched from having Postgres as its main relational database to using MySQL. Evan Klitzke wrote a detailed blog post about the migration, and post got very

Continue reading…

Relational Databases with Craig Kerstiens

http://traffic.libsyn.com/sedaily/RelationalDBs.mp3Podcast: Play in new window | Download Relational databases are used by most applications. MySQL, Postgres, Microsoft SQL Server, and other products implement the core features of a relational database in different ways. A developer who has never studied this space in detail may not know the differences between these databases, and in this episode we describe some tradeoffs that relational databases can make. Craig Kerstiens is an engineer at

Continue reading…

The Recurse Center with Nick Bergson-Shilcock

http://traffic.libsyn.com/sedaily/Recurse_edited_fixed.mp3Podcast: Play in new window | Download Learning to program is about self-driven exploration. Universities help guide you, coding boot camps provide a rigorous environment to work in, and online coding courses provide content for you to study. But none of this will turn you into a great programmer unless you have the drive to improve and the curiosity to explore.   The Recurse Center is a place where people

Continue reading…

Facebook Relationship Algorithms with Jon Kleinberg

http://traffic.libsyn.com/sedaily/Facebook_Relationships_Fixed_Edited.mp3Podcast: Play in new window | Download Facebook users provide lots of information about the structure of their relationship graph. Facebook uses that information to provide content and services that are expected to be important to users. If Facebook knows who the most important people in my life are, Facebook can use that knowledge to serve me content that is more relevant to me.   Jon Kleinberg studied Facebook network

Continue reading…

Drones with Buddy Michini

http://traffic.libsyn.com/sedaily/Drones_with_Airware_Edited.mp3Podcast: Play in new window | Download Drones will become a central part of our lives. Drones are delivering packages, surveying cell phone towers, providing wi-fi, or fertilizing crops. Drones are assisting humans in dangerous work, and serving as an entirely new computing platform, providing services that were previously nonexistent.   Airware is a company that is building a full-stack drone platform. In this episode, Buddy Michini takes us through

Continue reading…

Music Deep Learning with Feynman Liang

http://traffic.libsyn.com/sedaily/Bachbot_Edited.mp3Podcast: Play in new window | Download Machine learning can be used to generate music. In the case of Feynman Liang’s research project BachBot, the machine learning model is seeded with the music of famous composer Bach. The music that BachBot creates sounds remarkably similar to Bach, although it has been generated by an algorithm, not by a human.   BachBot is a research project on computational creativity. Feynman Liang

Continue reading…

Automated Content with Robbie Allen

http://traffic.libsyn.com/sedaily/wordsmith_edited.mp3Podcast: Play in new window | Download You have probably read a news article that was written by a machine. When earnings reports come out, or a series of sports events like the Olympics occurs, there are so many small stories that need to be written that a news organization like the Associated Press would have to use all of its resources to write enough content to cover it all.

Continue reading…

Haskell in Production with Carl Baatz

http://traffic.libsyn.com/sedaily/Haskell_in_Production_Edited.mp3Podcast: Play in new window | Download The Haskell programming language is often thought of as an academic tool, useful for teaching students about monads and functors, but not much else. But there are advantages to using Haskell as a production backend language.   Better is a company built with Haskell on the backend, and Carl Baatz wrote a blog post detailing his experiences using Haskell. He joins the show

Continue reading…

CoreOS with Brandon Philips

http://traffic.libsyn.com/sedaily/CoreOS_Edited_2.mp3Podcast: Play in new window | Download Google’s infrastructure has been the source inspiration for research papers, software projects, and entire companies. Google pioneered the idea that we care less about the individual machines we are running our applications on, and more about the applications themselves.   Containers are the abstraction we use to separate the concerns of the application from those of the underlying hardware. CoreOS is an operating system

Continue reading…

Artificial Intelligence with Oren Etzioni

http://traffic.libsyn.com/sedaily/AI_Research_Edited_2.mp3Podcast: Play in new window | Download Research in artificial intelligence takes place mostly at universities and large corporations, but both of these types of institutions have constraints that cause the research to proceed a certain way. In a university, basic research might be hindered by lack of funding. At a big corporation, the researcher might be encouraged to study a domain that is not squarely in the interest of

Continue reading…

Uber’s Ringpop with Jeff Wolski

http://traffic.libsyn.com/sedaily/Ringpop_edited.mp3Podcast: Play in new window | Download Uber has a software architecture with unique requirements. Uber does not have the firehose of user engagement data that Twitter or Facebook has, but each transaction on Uber is both high value and time-sensitive. Users are paying for transportation that they expect to be available and reasonably close by. When Uber’s system is trying to match a rider with a driver, availability is

Continue reading…

Kubernetes Migration with Sheriff Mohamed

http://traffic.libsyn.com/sedaily/sheriff_mohamed_fixed_edited.mp3Podcast: Play in new window | DownloadKubernetes is a cluster management tool open sourced by Google. On Software Engineering Daily, we’ve done numerous shows on how Kubernetes works in theory. Today’s episode is a case study in how to deploy Kubernetes to production at a company with existing infrastructure.   GolfNow is a fifteen year-old application written in C# .NET. It is a successful, growing business that is a division

Continue reading…

Distributed Tracing with Reshmi Krishna

http://traffic.libsyn.com/sedaily/distributed_tracing_edited_fixed.mp3Podcast: Play in new window | Download In a microservices architecture, a user request will often make its way through several different services before it returns a result to the end user. If a user experiences a failed request, the root cause could be in any of the services along that request path. Even more problematic is the challenge of debugging latency in this kind of request chain.   Reshmi

Continue reading…

Serverless Architecture with Mike Roberts

http://traffic.libsyn.com/sedaily/ServerlessArticle_Edited.mp3Podcast: Play in new window | Download “Serverless” usually refers to an architectural pattern where the server side logic is run in stateless compute containers that are event-triggered and ephemeral. Mike Roberts has written a series of articles about serverless computing, in which he discusses theories and patterns around serverless architecture. In this episode, Mike and I discuss how to reimagine our software architecture using functions-as-a-service. We go into the

Continue reading…

Akka Reactive Streams with Konrad Malawski

http://traffic.libsyn.com/sedaily/ReactiveStreams_edited_fixed.mp3Podcast: Play in new window | Download Akka is a toolkit for building concurrent, distributed, message-driven applications on the JVM. Akka provides an implementation of the actor model of concurrency, which simplifies concurrency by adding a lighter weight abstraction than threads and thread pools.   Konrad Malawski joins the show today to discuss Akka and reactive streams. Reactive streams is an initiative to provide a standard for asynchronous stream processing.

Continue reading…

Apache Beam with Frances Perry

http://traffic.libsyn.com/sedaily/Apache_Beam__Edited.mp3Podcast: Play in new window | Download Unbounded data streams create difficult challenges for our application architectures. The data never stops coming, and we are forced to assume that we will never know if or when we have seen all of our data. Some streaming systems give us the tools to deal partially with unbounded data streams, but we have to complement those streaming systems with batch processing, in a

Continue reading…

TensorFlow in Practice with Rajat Monga

http://traffic.libsyn.com/sedaily/TensorFlow_with_Rajat__Edited.mp3Podcast: Play in new window | Download TensorFlow is Google’s open source machine learning library. Rajat Monga is the engineering director for TensorFlow. In this episode, we cover how to use TensorFlow, including an example of how to build a machine learning model to identify whether a picture contains a cat or not.   TensorFlow was built with the mission of simplifying the process of deploying a machine learning model

Continue reading…

Data Validation with Dan Morris

http://traffic.libsyn.com/sedaily/datavalidation_edited_2.mp3Podcast: Play in new window | Download Data Validation is the process of ensuring that data is accurate. In many software domains, an application is pulling in large quantities of data from external sources. That data will eventually be exposed to users, and it needs to be correct. Radius Intelligence is a company that aggregates data on small businesses. In order to ensure that business addresses and phone numbers are

Continue reading…

Machine Learning for Sales with Per Harald Borgen

http://traffic.libsyn.com/sedaily/Xeneta.mp3Podcast: Play in new window | Download Machine learning has become simplified. Similar to how Ruby on Rails made web development approachable, scikit-learn takes away much of the frustrating aspects of machine learning, and lets the developer focus on building functionality with high-level APIs.   Per Harald Borgen is a developer at Xeneta. He started programming fairly recently, but has already built a machine learning application that cuts down on

Continue reading…

Flexport Engineering with Amos Elliston

http://traffic.libsyn.com/sedaily/Flexport_Edited.mp3Podcast: Play in new window | Download Flexport is a technology company that makes logistics, supply chain management, and freight forwarding software. Shipping freight across the world requires container ships, airplanes, trains, warehouses, and trucks. Flexport’s software integrates with many of these different shipping companies, and provides a dashboard for the end user to understand how their products are being shipped around the world.   Amos Elliston is the CTO

Continue reading…

Data Breaches with Troy Hunt

http://traffic.libsyn.com/sedaily/Troy_Hunt_Edited_2.mp3Podcast: Play in new window | Download When you hear about massive data breaches like the recent ones from LinkedIn, MySpace, or Ashley Madison, how can you find out whether your own data was compromised?   Troy Hunt created the website HaveIBeenPwned.com to answer this question. When a major data breach occurs, Troy acquires a copy of the stolen data and provides a safe way for individuals to check if

Continue reading…

unikernels and unik with Scott Weiss

http://traffic.libsyn.com/sedaily/unik_edited_fixed.mp3Podcast: Play in new window | Download The Linux kernel of many popular operating system distributions contains 200-500 million lines of code. The average user never touches many of the libraries that are contained in these operating system distributions. For example, if you spin up a virtual machine on a cloud service provider, the virtual machine will have a USB driver. This is wasted space, because you can’t even interact

Continue reading…

Prometheus Monitoring with Brian Brazil

http://traffic.libsyn.com/sedaily/prometheusbrian_edited_fixed.mp3Podcast: Play in new window | Download Prometheus is a tool for monitoring our distributed applications. It allows us to focus on the services we are deploying rather than the individual machines that make up instances of that service.   The monitoring service itself is a portion of a distributed system that is treated differently than the services we are monitoring. We don’t want to use a consensus-based tool like

Continue reading…

Podcast Infrastructure with Mikael Emtinger

http://traffic.libsyn.com/sedaily/Podcast-tech_Edited.mp3Podcast: Play in new window | Download The technology underlying podcasts is simple–a podcaster publishes mp3 files to an RSS feed, and the listener subscribes to that feed, receiving mp3s whenever the feed is updated. Unfortunately, the simplicity of podcasts makes it difficult to build automated advertising infrastructure on top of that simple RSS model. This lack of rich automated advertising has kept podcasting from flourishing. aCast is a company

Continue reading…

GraphQL as a Service with Scaphold.io

http://traffic.libsyn.com/sedaily/Scaphold.io_Edited.mp3Podcast: Play in new window | Download GraphQL was open sourced out of Facebook, and gave developers a way to unify their different data sources into a single endpoint. Although the promise of GraphQL is appealing, the process of setting up a GraphQL server that can communicate with each disparate data source can prove to be complex. Scaphold.io provides GraphQL as a service, and today’s guests are the creators of

Continue reading…

You Are Not A Commodity

http://traffic.libsyn.com/sedaily/You_Are_Not_A_Commodity.mp3Podcast: Play in new window | DownloadMost episodes of Software Engineering Daily are interviews with an expert about a technical software concept. Occasionally I write editorials, and also record them as a podcast. The first editorial was about 10 Philosophies for Engineers, the second was about how poker relates to software engineering, and the third was about music and software engineering. Today’s episode is called “You Are Not A Commodity”. Since it

Continue reading…

Industries of the Future with Alec Ross

http://traffic.libsyn.com/sedaily/Industries_Edited.mp3Podcast: Play in new window | Download Alec Ross worked in the White House as a Senior Policy Advisor to Hillary Clinton. His book Industries of the Future explores the biggest technological opportunities and threats to our society. The industries addressed in his book include robotics, genetics, and cybersecurity. Technological familiarity is increasingly correlated with an individual’s optimism. Cyberwarfare presents attack vectors that are difficult to insulate against. Arguments about

Continue reading…

Clojure with Alex Miller

http://traffic.libsyn.com/sedaily/Clojure_edited_fixed.mp3Podcast: Play in new window | Download Clojure is a dynamically typed functional language that runs on the JVM. Today’s guest Alex Miller gives us an overview of Clojure’s core functionality. Alex is a developer of Cognitect, and a founder of the the Strange Loop conference.     We discuss the data structures, garbage collection, and concurrency support. How does Clojure compare to other JVM languages like Scala and Groovy? How

Continue reading…

Odd Networks with Kris Walker

http://traffic.libsyn.com/sedaily/Odd_Networks_Edited.mp3Podcast: Play in new window | Download Odd Networks is building a platform for anyone to launch their own over-the-top streaming video service. With Odd Networks, you can deploy your own video channel using a Roku, Amazon Fire TV, Apple TV, and other services. Creating a streaming video service with interoperability between these different platforms presents numerous technical challenges, and today’s guest Kris Walker explains how Odd Networks is addressing

Continue reading…

Mobycraft with Aditya Gupta

http://traffic.libsyn.com/sedaily/Mobycraft_edited_fixed.mp3Podcast: Play in new window | Download MobyCraft is a client-side Minecraft mod to manage and visualize Docker containers. MobyCraft was created by Aditya Gupta. I met him at DockerCon, where he gave a presentation about his project. He also discussed his interaction with the Netflix team, who integrated MobyCraft with their container management tool called Titus.   You can watch a video online of Titus managing hundreds of 3-D

Continue reading…

Prometheus with Julius Volz

http://traffic.libsyn.com/sedaily/Prometheus_Edited.mp3Podcast: Play in new window | Download Prometheus is an open-source monitoring tool built at SoundCloud. It can be used to produce detailed time-series data about a distributed architecture. Prometheus is based on the monitoring system inside Google’s infrastructure, called Borgmon.   Julius Volz is the creator of Prometheus, and he joins the show to explain why he built Prometheus and how it differs from previous monitoring tools. Prometheus is

Continue reading…

The Art of Monitoring with James Turnbull

http://traffic.libsyn.com/sedaily/The_Art_of_Monitoring_Edited.mp3Podcast: Play in new window | Download Monitoring translates machine data into actionable business metrics, and is a key component of a modern software company. James Turnbull’s new book “The Art of Monitoring” describes how organizations can build their monitoring infrastructure.     James joins the show today to outline the strategies that a company can use to proactively monitor their systems. We talk about pull- vs. push-based monitoring, events,

Continue reading…

Fintech Hiring with Ed Donner

http://traffic.libsyn.com/sedaily/untapt_edited_fixed.mp3Podcast: Play in new window | Download Financial technology has changed significantly in the last decade, and companies both new and old are adapting to that change. Newer companies like TransferWise and Stripe are often called “fintech” companies–short for “financial technology”. Established companies like banks may not refer to themselves as fintech companies, but the way that they do business is changing, due to technological advances like blockchain. Ed Donner

Continue reading…

Scaling github with Sam Lambert

http://traffic.libsyn.com/sedaily/github_edited_fixed.mp3Podcast: Play in new window | Download github has grown to have 10 million users and 30 million repositories. Getting to this scale has required innovation in many places–github has significantly altered the code for git itself, and has built unique infrastructure and written low level code to architect for git repository management at scale.   Despite the need for cutting-edge technologies to support github, the development culture at github

Continue reading…

Pixar in a Box with Kitt Hirasaki

http://traffic.libsyn.com/sedaily/Pixar_in_a_Box_Edited.mp3Podcast: Play in new window | Download Pixar has made some of the most successful movies of all time: Toy Story, WALL-E, Monsters Inc, and many others.   These movies are made with cutting-edge computer animation techniques that Pixar often has to invent in order to tell the story it wants to tell. Pixar has teamed up with Khan Academy to teach anyone who wants to learn the basics of

Continue reading…

Open Source Culture with Rachel Roumeliotis

http://traffic.libsyn.com/sedaily/OSCON_edited.mp3Podcast: Play in new window | Download Open source software has become the rule for how software is written rather than the exception. OSCON is O’Reilly’s open source conference, where companies and individuals talk about where the open-source world is going.   Rachel Roumeliotis is the chair of OSCON, and she joins the show today to talk about the state of open source, and how the conference has developed since

Continue reading…

Android on iPhone with Nick Lee

http://traffic.libsyn.com/sedaily/android_on_iphone_fixed.mp3Podcast: Play in new window | Download Finally–the Android operating system has been put on an iPhone, and today’s guest is Nick Lee, who accomplished that feat. Nick works at Tendigi, a design and engineering firm.   In the past, Nick has put Windows 95 on an Apple Watch. Why would you do something like this? In today’s interview with Nick, we talk about the technical challenges of bringing Nick’s

Continue reading…

Kubernetes Origins with Craig Mcluckie

http://traffic.libsyn.com/sedaily/Kubernetes_Origins_Edited.mp3Podcast: Play in new window | Download The container management system Kubernetes was open sourced by Google with the intention of creating a cloud service based on the project. Today, the Kubernetes ecosystem is looking similar to the Android ecosystem, with different vendors providing different ways to use Kubernetes, from RedHat’s OpenShift to Google Container Engine.   Craig Mcluckie was a member of the team who originally devised Kubernetes, and

Continue reading…

Container Platforms with Darren Shepherd

http://traffic.libsyn.com/sedaily/rancherlabs_Edited.mp3Podcast: Play in new window | Download Container management systems like Kubernetes and Docker Swarm give us a higher level management tool for architectures built out of distributed containers.   Container platforms like Rancher provide a higher layer of usability, and today’s guest Darren Shepherd of Rancher Labs takes us through what a container platform is. This interview is part of our continued coverage of Kubernetes, Docker, and the other

Continue reading…

Peter Bailis on the Data Community’s Identity Crisis

http://traffic.libsyn.com/sedaily/database_crisis_edited_fixed.mp3Podcast: Play in new window | Download Breakthroughs in modern data research tend to come from companies like Google, Facebook, and Amazon, with projects like MapReduce, Cassandra, and Dynamo.   Twenty years ago, this types of breakthroughs would be happening in academia, which causes today’s guest Peter Bailis to ask: is the academic data community having an identity crisis?   Peter is an assistant professor at Stanford University, where he

Continue reading…

Apache Arrow with Uwe Korn

http://traffic.libsyn.com/sedaily/arrow_edited_fixed.mp3Podcast: Play in new window | Download In a typical data analytics system, there are a variety of technologies interacting. HDFS for storing files, Spark for distributed machine learning, pandas for data analysis in Python–each of these different technologies has a different format for how data is represented.   Serialization and deserialization between these different formats causes significant latency across the overall system. Apache Arrow is a tool for improving

Continue reading…

Economics of Software with Russ Roberts

http://traffic.libsyn.com/sedaily/Economics_Edited.mp3Podcast: Play in new window | Download EconTalk is a weekly economics podcast that has been going for a decade. On EconTalk, Russ Roberts brings on writers, intellectuals, and entrepreneurs for engaging conversations about the world as seen through the lens of economics.   Russ Roberts is today’s guest, and it is a treat because I have been listening to EconTalk since 2006 and it was a central point of

Continue reading…

IoT Analytics with Jean-Christophe Cimono

http://traffic.libsyn.com/sedaily/IOT_Analytics_edited.mp3Podcast: Play in new window | Download On smart thermostats, sensor-driven assembly lines, and electronically monitored farms, the internet of things is producing huge volumes of data.   To take advantage of that data, an application needs tools for storing and analyzing that data. Today’s guest is Jean-Cristophe Cimono, the CTO of mnubo, a cloud platform for connected objects. Today we walk through the architecture of mnubo and the use

Continue reading…

Cassandra Data Modeling with Jon Haddad

http://traffic.libsyn.com/sedaily/Cassandra_jon_haddad_Edited.mp3Podcast: Play in new window | Download Data modeling is the process of creating relationships and rules about objects, so that we can decide how to store them in a database. Data modeling defines how we store and query our database systems.   Today’s episode features a discussion of data modeling in Cassandra with Jon Haddad, an evangelist at Datastax. The distributed nature of Cassandra creates some unique rules around

Continue reading…

Salary Negotiation with Haseeb Qureshi

http://traffic.libsyn.com/sedaily/Negotiation_Edited.mp3Podcast: Play in new window | Download Negotiation is an important skill for software engineers. The salary you negotiate at the beginning of your job could be a difference of tens of thousands of dollars over the course of an engineer’s career, but intimidating recruiters and exploding offers scare many engineers from negotiating at all.   Today, Haseeb Qureshi returns to the show to discuss his epic story of salary

Continue reading…

Platforms with Bridget Kromhout

http://traffic.libsyn.com/sedaily/Platforms.mp3Podcast: Play in new window | Download At software conferences, I like to walk around the vendor booths and talk to the representatives from different companies. By talking to the vendors about their marketing pitches, I get an idea of how those companies are positioning themselves for the future, and the complex business landscape of software becomes slightly easier to understand.   At recent conferences, many of the big vendors have

Continue reading…

Scalable Architecture with Lee Atchison

http://traffic.libsyn.com/sedaily/Scalable_Architecture.mp3Podcast: Play in new window | Download Lee Atchison spent seven years at Amazon working in retail, software distribution, and Amazon Web Services. He then moved to New Relic, where he has spent four years scaling the company’s internal architecture. From his decade of experience at fast growing web technology companies, Lee has written the book Architecting for Scale, from O’Reilly.   As an application scales, it becomes significantly more

Continue reading…

Schedulers with Adrian Cockcroft

http://traffic.libsyn.com/sedaily/Schedulers_Edited.mp3Podcast: Play in new window | Download Scheduling is the method by which work is assigned to resources to complete that work. At the operating system level, this can mean scheduling of threads and processes. At the data center level, this can mean scheduling Hadoop jobs or other workflows that require the orchestration of a network of computers.   Adrian Cockcroft worked on scheduling at Sun Microsystems, eBay, and Netflix.

Continue reading…

Security and Machine Learning in the Call Center with Pindrop Security’s Chris Halaschek

http://traffic.libsyn.com/sedaily/Pindrop_Edited.mp3Podcast: Play in new window | Download Call centers are a vulnerable point of attack for large enterprises. Fraud accounts for more than $20 billion in lost money every year, and a significant portion of that fraud is due to customer service representatives being fraudulent social engineering attacks.   Chris Halaschek joins the show today to discuss how Pindrop Security is addressing this attack vector. Every phone call that gets

Continue reading…

Cloud Providers with Don Pezet

http://traffic.libsyn.com/sedaily/Cloud_Providers_Edited.mp3Podcast: Play in new window | Download In 1999, it took $50,000 to buy a server. Once you bought that server, you had to know how to operate and maintain it. Today, cloud service providers have changed how we build software. Servers, load balancers, networking, storage–these hardware concerns have been turned into software. Don Pezet joins the show today to discuss the fundamentals of a cloud service provider. These are

Continue reading…

KubeCloud: Tangible Cloud Computing with Kasper Nissen and Martin Jensen

http://traffic.libsyn.com/sedaily/KubeCloud_Edited.mp3Podcast: Play in new window | Download At most universities, there is not a course titled “cloud computing”. Most students leave college without an understanding of distributed systems, cloud service providers, and the fundamentals of how a data center works. Kasper Nissen and Martin Jensen are changing that with KubeCloud, a small tangible cloud computing cluster that runs on Raspberry Pis.   Kasper and Martin started KubeCloud as a masters

Continue reading…

Container Management with Alexis Richardson

http://traffic.libsyn.com/sedaily/Weave_Edited.mp3Podcast: Play in new window | Download Twenty years ago, Bill Joy talked about the eight fallacies of distributed computing–these are things such as “the network is reliable”, and “latency is zero”, and “bandwidth is infinite”, and these fallacies are even more relevant today. With the popularity of Docker containers, the networks of distributed systems that we deal with have become even more complex, and with this growing complexity comes

Continue reading…

P2P Money Transfer with TransferWise’s Harsh Sinha

http://traffic.libsyn.com/sedaily/Transferwise_Edited.mp3Podcast: Play in new window | Download Transferring money from one country to another is expensive, and the banks that facilitate money transfer have tricked us into believing that it should be expensive. On today’s show, Harsh Sinha explains the peer-to-peer system of transferring money with TransferWise, where he works as VP of engineering. Harsh also discusses the larger picture of FinTech companies. The emergence of so many companies at

Continue reading…

Cassandra Compliant ScyllaDB with Dor Laor

http://traffic.libsyn.com/sedaily/ScyllaDB_Edited.mp3Podcast: Play in new window | Download Apache Cassandra is a distributed database that can handle large amounts of data with no single point of failure. Since 2008, Cassandra has been widely adopted and the software and the community around it have grown steadily. A software developer interacting with Cassandra uses CQL, the Cassandra Query Language. ScyllaDB is another open-source database that has been created to be totally compatible with

Continue reading…

Apache Guacamole and Remote Desktop with Mike Jumper

http://traffic.libsyn.com/sedaily/Guacamole_Edited.mp3Podcast: Play in new window | Download In order to use a remote desktop experience, software engineers have a limited number of options, and most of them are proprietary, like VMWare or Oracle. Remote desktop is a functionality that many engineers use every day, so it is surprising that the open source world has taken awhile to displace the functionality of proprietary software. In 2010, Mike Jumper started working on

Continue reading…

Cloud.gov with Aidan Feldman

http://traffic.libsyn.com/sedaily/cloudgov_fixed.mp3Podcast: Play in new window | Download 18F is an organization that is building the 21st century digital government. In order to build online government services that have the high quality of modern cloud applications, 18F built Cloud.gov, a platform-as-a-service that can be used to stand up web applications for divisions of the government. Aidan Feldman helped build Cloud.gov, and on today’s episode he dissects its architecture. Cloud.gov is built

Continue reading…

Death and Distributed Systems with Pieter Hintjens

http://traffic.libsyn.com/sedaily/Zeromq_Edited.mp3Podcast: Play in new window | Download Pieter Hintjens grew up writing software by himself. The act of writing code brought him great pleasure, but the isolated creative process disconnected him from the rest of the world. As his life progressed he became involved in open source communities, and he discovered a passion for human interaction. Open source software succeeds or fails on the strength of the community. One story

Continue reading…

Scaling Twitter with Buoyant.io’s William Morgan

http://traffic.libsyn.com/sedaily/Bouyant_Edited.mp3Podcast: Play in new window | Download Six years ago, Twitter was experiencing outages due to high traffic. Back in 2010 Twitter was built as a monolithic Ruby on Rails application. Twitter migrated to a microservices architecture to fix these problems. During this migration, the engineers at Twitter learned how to build and scale highly distributed microservice architectures. William Morgan was an engineer at Twitter during that time, and he

Continue reading…

Manufacturing and Microservices with Cimpress’ Jim Sokoloff and Maarten Wensveen

http://traffic.libsyn.com/sedaily/Cimpress_Edited_2.mp3Podcast: Play in new window | DownloadMass customization is the process of making customized, personalized products that are accessible to individuals and small businesses. The process involves manufacturing, assembly lines, supply chains, and software at every step along the way. Today’s guests are Jim Sokoloff and Maarten Wensveen, who work on infrastructure and technology at Cimpress, a mass customization platform. Cimpress has t shirt printers, warehousing machines, supply chain management

Continue reading…

Serverless Code with Ryan Scott Brown

http://traffic.libsyn.com/sedaily/Serverless_Code_Edited.mp3Podcast: Play in new window | Download The unit of computation has evolved from on premise servers to virtual machines in the cloud to containers running in those virtual machines. Serverless computation is another stage in the evolution of computational unit management. With a serverless architecture, a function call to the cloud spins up a transient container, calls the function on that container, and then spins down the container. Ryan

Continue reading…

Algorithm Marketplace with Diego Oppenheimer of Algorithmia

http://traffic.libsyn.com/sedaily/Algorithmia_Edited.mp3Podcast: Play in new window | Download Algorithmia is marketplace for algorithms. A software engineer who writes an algorithm for image processing or spam detection or TF-IDF can turn that algorithm into a RESTful API to be consumed by other developers. Different algorithms can be composed together to build even higher level applications. Diego Oppenheimer is the CEO of Algorithmia, and he joins the show today to explain how Algorithmia

Continue reading…

Internet of Things with Azure’s Steve Busby

http://traffic.libsyn.com/sedaily/Azure-iot_Edited.mp3Podcast: Play in new window | Download The Internet of Things is becoming a reality. Factories are being outfitted with sensors, temperature monitors, and other data gathering devices. In agriculture, farms are becoming more efficient thanks to soil monitoring devices and automated pesticide regulation. In our homes, refrigerators, alarm clocks, and mirrors are becoming “smart”. Steve Busby joins the show today to talk about the big picture: how the Internet

Continue reading…

Secret Management and Vault with Hashicorp’s Seth Vargo

http://traffic.libsyn.com/sedaily/Vault_Edited.mp3Podcast: Play in new window | Download Every software application has secrets. User passwords and database credentials must be managed carefully, because poor access controls can lead to disaster scenarios. Vault is a tool for secret management, developed at Hashicorp, a company that builds software tools for application delivery and infrastructure management. Seth Vargo is a software engineer and open source advocate at Hashicorp, and in today’s episode he discusses

Continue reading…

Google’s Site Reliability Engineering with Todd Underwood

http://traffic.libsyn.com/sedaily/sre_google_edit3.mp3Podcast: Play in new window | Download Google’s site reliability engineers are responsible for maintaining the highly available services that power the Google software that we all use on a regular basis. O’Reilly recently published the book “Site Reliability Engineering: How Google Runs Production Systems”, and the book provides a comprehensive window into how the site reliability engineering role works. Todd Underwood is a director of site reliability engineering. On

Continue reading…

Female Pursuit of Computer Science with Jennifer Wang

http://traffic.libsyn.com/sedaily/gender_cs_google.mp3Podcast: Play in new window | Download Google researcher Jennifer Wang co-wrote a paper called “Gender Differences in Factors Influencing Pursuit of Computer Science and Related Fields”. The paper focuses on a survey of 1700 high school and college students, and takes a statistical approach to understanding why women are not pursuing computer science. In our conversation, Jennifer talks about the two influences that lead to fewer women in computer

Continue reading…

JavaScript Concurrency with Kyle Simpson

http://traffic.libsyn.com/sedaily/Getify_Edited.mp3Podcast: Play in new window | DownloadJavaScript programming usually is done through the use of frameworks, such as ReactJS, AngularJS, and EmberJS. These frameworks abstract away some of the messy details of JavaScript, and simplify web development so that engineers can build products at a faster pace. When we build software using JavaScript frameworks, we are missing out on some of the richness of the JavaScript language itself. Kyle Simpson

Continue reading…

Music

http://traffic.libsyn.com/sedaily/Music.mp3Podcast: Play in new window | DownloadMost episodes of Software Engineering Daily are interviews with an expert about a technical software concept. Over the past year I have done a few experiments that are more editorial in nature, and both were very popular. The first editorial was about 10 Philosophies for Engineers, and the second was about how poker relates to software engineering. Today’s episode is an editorial about the creative process

Continue reading…

Serverless Framework with Austen Collins

http://traffic.libsyn.com/sedaily/Serverless_Edited.mp3Podcast: Play in new window | Download Virtual machines were the unit of cloud computation for many years. Amazon Web Services pioneered the democratized model of allowing anyone to deploy a service to the cloud, running on a virtual machine on Amazon’s servers. After virtual machines, containers have become the unit of scale in the cloud. We break up our virtualized servers into even smaller units of computation called containers.

Continue reading…

Management and Hiring with Jon Emerson

http://traffic.libsyn.com/sedaily/Management.mp3Podcast: Play in new window | Download Engineering managers start out as engineers. Eventually, there is a fork in their career road where an engineer can choose to move up into management or continue on as an engineer in a more senior role. Changing to management involves an increase in responsibilities, a different set of goals to focus on. Jon Emerson was working at Google as an engineer when a

Continue reading…

Phone Spam with Truecaller CTO Umut Alp

http://traffic.libsyn.com/sedaily/Truecaller_Edited.mp3Podcast: Play in new window | Download The war against spam has been going on for decades. Email spam blockers and ad blockers help protect us from unwanted messages in our communication and browsing experience. These spam prevention tools are powered by machine learning, which catches most of the emails and ads that we don’t want to see. TrueCaller is a company that is bringing this quality of spam detection

Continue reading…

Tech Girls Movement with Jenine Beekhuyzen

http://traffic.libsyn.com/sedaily/Tech_G_Edited.mp3Podcast: Play in new window | Download The software industry has a severe lack of women. There are numerous root causes of this diversity problem. Families do not encourage women to enter math and science. The media portrays most programmers as white males. Our industry often picks up on the signals of the broader society and perpetuates them. Reversing this trend of low female involvement in computer science could have

Continue reading…

Google’s Polymer Project with Rob Dodson

http://traffic.libsyn.com/sedaily/Polymer_Edited.mp3Podcast: Play in new window | Download Smart phone apps have better performance than web apps. When we have an application that we use on a regular basis, we download that application to a smart phone rather than using the browser based version on our mobile browser. Google’s Polymer Project wants to improve the gap between native app performance and mobile web app performance. The key problem with mobile web

Continue reading…

Software Editorialism with Practical Dev’s Ben Halpern

http://traffic.libsyn.com/sedaily/Practical_Dev.mp3Podcast: Play in new window | Download Most programmers spend lots of their time reading content about software. Since our field changes so rapidly, engineers consume news and editorials voraciously, trying to keep up with the impossibly fast pace. The Practical Dev is a collection of blog posts, editorials, and interviews that was created to help with that end. Ben Halpern is the creator of Practical Dev, and he joins

Continue reading…

Scaling PostgreSQL with Citus Data’s Ozgun Erdogan

http://traffic.libsyn.com/sedaily/Citus_Data.mp3Podcast: Play in new window | Download Ten years ago, databases were much simpler. Most companies would only have one or two types of databases in production. Today, the age of one-size-fits-all is over. Companies have multiple databases to deal with different types of use cases, and databases have become distributed to multiple nodes in order to be scalable. Ozgun Erdogan of Citus Data joins the show to give us

Continue reading…

Kubernetes and OpenShift with Clayton Coleman

http://traffic.libsyn.com/sedaily/OpenShift_clayton_Edited.mp3Podcast: Play in new window | Download Kubernetes is the container management platform that came out of Google’s experiences managing data centers. Kubernetes abstracts away many of the frustrations of distributed systems management. OpenShift is a platform built on top of Kubernetes to provide an additional layer of usability. Clayton Coleman is the lead engineer of OpenShift, and in our conversation today, we start with the basics of Kubernetes, then

Continue reading…

Boot Camps, Mesosphere, and Open-Source with Kenny Tran

http://traffic.libsyn.com/sedaily/Purify_Edited.mp3Podcast: Play in new window | Download Coding boot camps are a subject of controversy. Critics of boot camps defend the conventional university system, and argue that boot camp graduates do not have enough experience to write quality software. But the reality is that some boot camp graduates have found success from this new educational path. After graduating high school, Kenny Tran attended one coding boot camp, then spent some

Continue reading…

Infrastructure as Code with SaltStack’s David Boucha

http://traffic.libsyn.com/sedaily/Saltstack_Edited.mp3Podcast: Play in new window | Download Infrastructure-as-code is a trend that has been popularized over the past decade, as cloud computing and distributed systems have become a part of every technology company. Tools like Salt, Puppet, Chef, and Ansible allow us to manage servers and processes from the command line. David Boucha works at SaltStack, the company that makes Salt. Salt is a platform that provides configuration management and

Continue reading…

Solar Investment and Architectural Strategy at Wunder Capital

http://traffic.libsyn.com/sedaily/Wunder_Capital_Edited.mp3Podcast: Play in new window | Download Solar energy is a growing market. Improvements in hardware have led to some people predicting that solar energy will be powering the world within the next few decades. Undoubtedly, a large percentage of our current energy infrastructure will be replaced by solar in the near future. Replacing our old, inefficient power grid requires massive investment. On Software Engineering Daily, the resources we usually

Continue reading…

Minecraft Programming with Gabriel Simmer

http://traffic.libsyn.com/sedaily/minecraft_final.mp3Podcast: Play in new window | Download Minecraft is a sandbox video game in which players build constructions out of 3-D cubes in a procedurally generated world. Minecraft is the best-selling PC game of all time. But Minecraft is not just a game. It is a platform for creativity, used by players within the game as well as programmers outside of it. Gabriel Simmer is a 16-year-old programmer who build

Continue reading…

Rust with Steve Klabnik

http://traffic.libsyn.com/sedaily/rust_edited.mp3Podcast: Play in new window | Download Rust is a systems programming language being developed at Mozilla. Rust has features of a high-level functional language like Scala and a low-level, performance-driven language like C++. Steve Klabnik is a developer program member with Mozilla. In this episode, he discusses how Rust looks at memory management, type safety, mutability, and concurrency. We also dive into a discussion of the low level virtual

Continue reading…

Kafka, Storm, and Cassandra: Keen IO’s Analytics Architecture with Dan Kador

http://traffic.libsyn.com/sedaily/Keen_Edited_3.mp3Podcast: Play in new window | Download The process of building a software project requires us to make so many architectural decisions. Which programming languages should be used? Which cloud service provider? Which database? A newer type of building block is the analytics platform. Companies need to track events, aggregate metrics, and change the user’s experience based on aggregated data. Dan Kador is a co-founder of Keen IO, and he

Continue reading…

Erlang Systems Design with Francesco Cesarini

http://traffic.libsyn.com/sedaily/erlang_book_edited.mp3Podcast: Play in new window | Download Erlang is a programming language with primitives that help software engineers build distributed systems. When a process is malfunctioning in Erlang, the philosophy of the language is to let the process crash–and in a distributed system where unexpected faults happen on a regular basis, this philosophy of “let it crash” simplifies how we reason about an Erlang system. Other distributed systems advantages of

Continue reading…

Google’s Microservices: Kubernetes and gRPC with Sandeep Dinesh

http://traffic.libsyn.com/sedaily/microservices_Edited.mp3Podcast: Play in new window | DownloadGoogle has built a microservices architecture on top of the internal container management system called Borg. These services communicate over an internal protocol known as Stubby. Borg and Stubby are tightly coupled to Google’s infrastructure–it would not make sense for Google to open source them–but Google has worked with the open source community to develop open source projects with the core functionality of Borg

Continue reading…

Netflix’s Data Pipeline with Steven Wu

http://traffic.libsyn.com/sedaily/Netflix.mp3Podcast: Play in new window | Download At Netflix, 500 billion events and 1.3 petabytes of data are ingested by the system per day.  This includes video viewing activities, error logs, and performance events. On today’s episode, we dive deep into the data pipeline of Netflix, and how it evolved from their 1.0 version to the modern 2.0 version. Before listening to this episode, check out the blog post that

Continue reading…

Dropbox’s Magic Pocket with James Cowling

http://traffic.libsyn.com/sedaily/Magic_Pocket.mp3Podcast: Play in new window | Download Dropbox has been storing files on Amazon Web Services for 8 years, and Dropbox’s core business is storing files. For the past three years, Dropbox has been working on a project to migrate its file storage from Amazon Web Services to its own custom built infrastructure. Magic Pocket is the name of Dropbox’s new infrastructure layer, and it gives Dropbox more control and

Continue reading…

Decentralization: Ethereum, Bitcoin, and IPFS with Karl Floersh

http://traffic.libsyn.com/sedaily/decentralization_Edited.mp3Podcast: Play in new window | Download Almost a year ago, Software Engineering Daily aired a week of shows about decentralized technologies like Bitcoin, Ethereum, and IPFS. Bitcoin has established itself as a stable network, but it can only be used for financial transactions. Ethereum is a global computer built on a blockchain, but it does not have the adoption of Bitcoin. IPFS is a distributed data store with an

Continue reading…

Distributed Systems Tradeoffs with Camille Fournier

http://traffic.libsyn.com/sedaily/Distributed_Tradeoffs_Edited.mp3Podcast: Play in new window | Download Distributed systems products are often marketed with terms like “real-time data” and “hassle-free scaling”, but what do those terms actually mean? Is data in a distributed system ever reliably “real time”? Do we ever have strong enough plans about our scalability strategy to say that scaling will be “hassle free”? Camille Fournier joins us today to discuss distributed systems in practice. Like everything

Continue reading…

Crate.io and Distributed SQL with Jodok Batlogg

http://traffic.libsyn.com/sedaily/Crate.mp3Podcast: Play in new window | Download Distributed databases are difficult to operate, and Crate.io wants to change that. Crate is a fast, scalable, easy-to-use SQL database that is built to run in containerized environments. An average software company runs several databases–MySQL for relational store, MongoDB for a document database, HDFS for blob storage and data warehouse, elastic search for search. On today’s show, Jodok Batlogg from Crate discuss the

Continue reading…

Azure Stream Analytics with Santosh Balasubramanian

http://traffic.libsyn.com/sedaily/azure_stream_final.mp3Podcast: Play in new window | Download Microsoft has built a suite of technologies on top of its Azure infrastructure as a service. Today, we discuss Azure Stream Analytics, a real-time event processing engine developed at Microsoft. Azure Streaming allows for constant querying of incoming data streams, and my guest Santosh Balasubramanian discusses Azure and the movement from batch processing to stream processing. Sponsors Hired.com is the job marketplace for

Continue reading…

Spark and Cassandra with Tim Berglund

http://traffic.libsyn.com/sedaily/Cassandra_Spark_Edited_2.mp3Podcast: Play in new window | Download Apache Spark is a framework for fast, distributed, in-memory analysis. Apache Cassandra is a distributed database management system that provides high availability and fast throughput. Today, we are collecting fast, big data streams from user behavior, smart phones and sensors, and the disk checkpointing of and query language of Hadoop MapReduce is no longer adequate.   Tim Berglund from Datastax came on Software

Continue reading…