Service Mesh Design with Oliver Gould

http://traffic.libsyn.com/sedaily/2018_01_19_ConduitProxy.mp3Podcast: Play in new window | Download Oliver Gould worked at Twitter from 2010 to 2014. Twitter’s popularity was taking off, and the engineering team was learning how to scale the product. During that time, Twitter adopted Apache Mesos, and began breaking up its monolithic architecture into different services. As more and more services were deployed, engineers at Twitter decided to standardize communications between those services with a tool called

Continue reading…

Kubernetes Storage with Bassam Tabbara

http://traffic.libsyn.com/sedaily/2018_01_18_RookKubernetesStorage.mp3Podcast: Play in new window | Download Modern applications store most of their data on hosted storage solutions. We use hosted block storage to back databases, hosted object storage for objects such as videos, and hosted file storage for file systems. Using a cloud provider for these storage systems can simplify scalability, durability, and availability–it can be less painful than taking care of storage yourself. One downside: the storage systems

Continue reading…

Kubernetes State Management with Niraj Tolia

http://traffic.libsyn.com/sedaily/2018_01_17_KubernetesDataNiraj.mp3Podcast: Play in new window | Download A common problem in a distributed system: how do you take a snapshot of the global state of that system? Snapshot is difficult because you need to tell every node in the system to simultaneously record its state. There are several reasons to take a snapshot. You might want to take a picture of the global state for the purposes of debugging. Or

Continue reading…

Kubernetes Operations with Brian Redbeard

http://traffic.libsyn.com/sedaily/2018_01_16_MulticloudKubernetes.mp3Podcast: Play in new window | DownloadIn the last four years, CoreOS has been at the center of enterprise adoption of containers. During that time, Brian Harrington (or “Redbeard”) has seen a lot of deployments. In this episode, Brian discusses the patterns he has seen among successful Kubernetes deployments–and the pitfalls of the less successful. How should you manage configuration? How can you avoid IP address overlap between containers? How

Continue reading…

FluentD with Eduardo Silva

http://traffic.libsyn.com/sedaily/2018_01_15_FluentD.mp3Podcast: Play in new window | Download A backend application can have hundreds of services written in different programming frameworks and languages. Across these different languages, log messages are produced in different formats. Some logging is produced in XML, some is produced in JSON, some is in other formats. These logs need to be unified into a common format, and centralized for any developer who wants to debug. The popularity

Continue reading…

The Gravity of Kubernetes

http://traffic.libsyn.com/sedaily/2018_01_13_GravityOfKubernetes.mp3Podcast: Play in new window | Download Kubernetes has become the standard way of deploying new distributed applications. Most new internet businesses started in the foreseeable future will leverage Kubernetes (whether they realize it or not). Many old applications are migrating to Kubernetes too. Before Kubernetes, there was no standardization around a specific distributed systems platform. Just like Linux became the standard server-side operating system for a single node, Kubernetes

Continue reading…

Kubernetes Vision with Brendan Burns

http://traffic.libsyn.com/sedaily/BrendanBurns.mp3Podcast: Play in new window | Download Kubernetes has become the standard system for deploying and managing clusters of containers. But the vision of the project goes beyond managing containers. The long-term goal is to democratize the ability to build distributed systems. Brendan Burns is a co-founder of the Kubernetes project. He recently announced an open source project called Metaparticle, a standard library for cloud-native development: Metaparticle builds on top

Continue reading…

High Volume Distributed Tracing with Ben Sigelman

http://traffic.libsyn.com/sedaily/DistributedTracing.mp3Podcast: Play in new window | Download You are requesting a car from a ridesharing service such as Lyft. Your request hits the Lyft servers and begins trying to get you a car. It takes your geolocation, and passes the geolocation to a service that finds cars that are nearby, and puts all those cars into a list. The list of nearby cars is sent to another service, which sorts

Continue reading…

Kubernetes on AWS with Arun Gupta

http://traffic.libsyn.com/sedaily/KubernetesonAWS.mp3Podcast: Play in new window | Download Since Kubernetes came out, engineers have been deploying clusters to Amazon. In the early years of Kubernetes, deploying to AWS meant that you had to manage the availability of the cluster yourself. You needed to configure etcd and your master nodes in a way that avoided having a single point of failure. Deploying Kubernetes on AWS became simpler with an open-source tool called

Continue reading…

Istio Motivations with Louis Ryan

http://traffic.libsyn.com/sedaily/IstioMotivations.mp3Podcast: Play in new window | Download A single user request hits Google’s servers. A user is looking for search results. In order to deliver those search results, that request will have to hit several different internal services on the way to getting a response. These different services work together to satisfy the user request. All of these services need to communicate efficiently, they need to scale, and they need

Continue reading…

Kubernetes Usability with Joe Beda

http://traffic.libsyn.com/sedaily/KubernetesUsability.mp3Podcast: Play in new window | Download Docker was released in 2013, and popularized the use of containers. A container is an abstraction for isolating a well-defined portion of an operating system. Developers quickly latched onto containers as a way to cut down on the cost of virtual machines–as well as isolate code and simplify deployments. Developers began deploying so many containers that they needed a centralized way to manage

Continue reading…

Cloud R&D with Onsi Fakhouri

http://traffic.libsyn.com/sedaily/CloudRD.mp3Podcast: Play in new window | Download In the first 10 years of cloud computing, a set of technologies emerge that every software enterprise needs; continuous delivery, version control, logging, monitoring, routing, data warehousing. These tools were built into the Cloud Foundry project, a platform for application deployment and management. As we enter the second decade of cloud computing, another new set of technologies are emerging as useful tools. Serverless

Continue reading…

Spring Data with John Blum

http://traffic.libsyn.com/sedaily/SpringData.mp3Podcast: Play in new window | Download In the 1980s and the 1990s, most applications used only a relational database for their data management. In the early 2000s, software projects started to use an ever increasing number of data sources. MongoDB popularized the document database, which allows storage of objects that do not have a consistent schema. The Hadoop distributed file system enabled the redundant storage and efficient querying of

Continue reading…

Cloud Foundry with Rupa Nandi

http://traffic.libsyn.com/sedaily/CloudFoundry.mp3Podcast: Play in new window | Download Cloud Foundry is an open-source platform as a service for deploying and managing web applications. Cloud Foundry is widely used by enterprises who are running applications that are built using Spring, a popular web framework for Java applications, but developers also use Cloud Foundry to manage apps built in Ruby, Node and any other programming language. Cloud Foundry includes routing, message brokering, service

Continue reading…

Dwarf Fortress with Tarn Adams Holiday Repeat

http://traffic.libsyn.com/sedaily/dwarffortress_ad_free.mp3Podcast: Play in new window | DownloadOriginally published October 22, 2015 “The official motto that we have in our help manual is ‘Losing is fun!’ ” Dwarf Fortress is a construction and management simulation computer game set in a procedurally generated fantasy world in which the player indirectly controls a group of dwarves, and attempts to construct a successful underground fortress. Tarn Adams works on Dwarf Fortress with his brother Zach.

Continue reading…

Language Design with Brian Kernighan Holiday Repeat

http://traffic.libsyn.com/sedaily/kernighan_ad_free.mp3Podcast: Play in new window | DownloadOriginally published January 6, 2016 “The best computer science is the kind where the theory is inspired by some practical problem, you develop a better theoretical understanding of what you want to do, and that feeds back into better practice.” Brian Kernighan is a professor of computer science at Princeton University and the author of several books, including The Go Programming Language and The

Continue reading…

Software and Entrepreneurship with Seth Godin Holiday Repeat

http://traffic.libsyn.com/sedaily/sethgodin_ad_free.mp3Podcast: Play in new window | DownloadOriginally published November 18, 2015 “The playing field has never ever been more leveled – that means everything you don’t build is your choice not to build it.” Seth Godin is a writer, speaker, and entrepreneur. He is the author of many books, including most recently, What To Do When It’s Your Turn. Questions How did your atypical computer science education shape you? What were

Continue reading…

Knowledge-Based Programming with Stephen Wolfram Holiday Repeat

http://traffic.libsyn.com/sedaily/wolfram_ad_free.mp3Podcast: Play in new window | DownloadOriginally published November 10, 2015 “The cloud as an environment – I had thought it was a purely utilitarian kind of thing. What I realized is that it’s a fascinating centralized repository of computation.” Wolfram Research makes computing software powered by the Wolfram language, a knowledge-based programming language that draws from symbolic and functional programming paradigms. Stephen Wolfram is the Founder and CEO of

Continue reading…

Machine Learning and Technical Debt with D. Sculley Holiday Repeat

http://traffic.libsyn.com/sedaily/ml_techdebt_ad_free.mp3Podcast: Play in new window | DownloadOriginally published November 17, 2015 “Changing anything changes everything.” Technical debt, referring to the compounding cost of changes to software architecture, can be especially challenging in machine learning systems. D. Sculley is a software engineer at Google, focusing on machine learning, data mining, and information retrieval. He recently co-authored the paper Machine Learning: The High Interest Credit Card of Technical Debt. Questions How do

Continue reading…

Modern War with Peter Warren Singer

http://traffic.libsyn.com/sedaily/Modern_War.mp3Podcast: Play in new window | Download Military force is powered by software. The drones that are used to kill suspected terrorists can identify those terrorists using the same computer vision tools that are used to identify who is in an Instagram picture. Nuclear facilities in Iran were physically disabled by the military-sponsored Stuxnet virus. National intelligence data is collected and processed using the MapReduce algorithm. The military keeps up

Continue reading…

React Components with Max Stoiber

http://traffic.libsyn.com/sedaily/ReactComponents.mp3Podcast: Play in new window | Download Modern frontend development is about components. Whether we are building an application in React, Vue, or Angular, components are the abstractions that we build our user interfaces out of. Today, this seems obvious, but if you think back five years ago, frontend development was much more chaotic–partly because we had not settled around this terminology of the component. React has become the most

Continue reading…

Managing Engineers with Ron Lichty

http://traffic.libsyn.com/sedaily/ManagingEngineers.mp3Podcast: Play in new window | Download “Management is about human beings. Its task is to make people capable of joint performance. To make their strengths effective and their weaknesses irrelevant.” That quote is from Peter Drucker. It is one of the many useful quotes collected in Ron Lichty’s book “Managing the Unmanageable”—and it illustrates why we work in teams. When we collaborate with each other, we make each other’s

Continue reading…

Hacker Noon with David Smooke

http://traffic.libsyn.com/sedaily/HackerNoon.mp3Podcast: Play in new window | Download The New York Times makes most of its money off of subscriptions. Facebook makes its money off of native advertising. Hacker News is funded by Y-Combinator. Each of these business models creates biases in the information that gets promoted on the respective platforms. This is why I like to know the origin story and the business models behind the publications that I read.

Continue reading…

Protocol Buffers with Kenton Varda

http://traffic.libsyn.com/sedaily/ProtocolBuffers.mp3Podcast: Play in new window | Download When engineers are writing code, they are manipulating objects. You might have a user object represented on your computer, and that user object has several different fields—a name, a gender, and an age. When you want to send that object across the network to a different computer, the object needs to be turned into a sequence of 1s and 0s that will travel

Continue reading…

High Volume Logging with Steve Newman

http://traffic.libsyn.com/sedaily/Scalyr.mp3Podcast: Play in new window | Download Google Docs is used by millions of people to collaborate on documents together. With today’s technology, you could spend a weekend coding and build a basic version of a collaborative text editor. But in 2004 it was not so easy. In 2004 Steve Newman built a product called Writely, which allowed users to collaborate on documents together. Initially, Writely was hosted on a

Continue reading…

Scala at Duolingo with Andre Kenji Horie

http://traffic.libsyn.com/sedaily/ScalaatDuolingo.mp3Podcast: Play in new window | Download Duolingo is a language learning platform with over 200 million users. On a daily basis millions of users receive customized language lessons targeted specifically to them. These lessons are generated by a system called the session generator.   Andre Kenji Horie is senior engineer at Duolingo. He wrote about the process of rewriting the session generator, moving from Python to Scala and changing

Continue reading…

Engineering Values with Lynne Tye

http://traffic.libsyn.com/sedaily/KeyValues.mp3Podcast: Play in new window | Download The values system of a company guides the actions of the engineers who work at that company. Some companies value open communication and a flat organization where anybody can talk to anyone else. Other companies encourage hierarchy and secrecy, so that employees are focused on their specific section of the company. Some companies take themselves seriously, and have a work environment that is

Continue reading…

Cloud Marketplace with Zack Bloom

http://traffic.libsyn.com/sedaily/CloudflareApps.mp3Podcast: Play in new window | Download Ten years ago, if you wanted to build software, you probably needed to know how to write code. Today, the line between “technical” and “non-technical” people is blurring. Website designers can make a living building sites for people on WordPress or Squarespace–without knowing how to write code. Salesforce integration experts can help a sales team set up complicated software–without knowing how to write

Continue reading…

Scalable Multiplayer Games with Yan Cui

http://traffic.libsyn.com/sedaily/ScalableMultiplayerGames.mp3Podcast: Play in new window | DownloadRemember when the best game you could play on your phone was Snake? In 1998, Snake was preloaded on Nokia phones, and it was massively popular. That same year Half-Life won game of the year on PC. Metal Gear Solid came out for Playstation. The first version of Starcraft also came out in 1998. In 1998, few people would have anticipated that games with

Continue reading…

Decentralized Objects with Martin Kleppman

http://traffic.libsyn.com/sedaily/CRDTs_Decentralized_Files.mp3Podcast: Play in new window | DownloadThe Internet was designed as a decentralized system. Theoretically, if Alice wants to send an email to Bob, she can set up an email client on her computer and send that email to Bob’s email server on his computer. In reality, very few people run their own email servers. We all send our emails to centralized services like Gmail, and connect to those centralized

Continue reading…

Serverless Applications with Randall Hunt

http://traffic.libsyn.com/sedaily/AWSLambda.mp3Podcast: Play in new window | Download Developers can build networked applications today without having to deploy their code to a server. These “serverless” applications are constructed from managed services and functions-as-a-service. Managed services are cloud offerings like database-as-a-service, queueing-as-a-service, or search-as-a-service. These managed services are easy to use. They take care of operational burdens like scalability and outages. But managed services typically solve a narrow use case. You can’t

Continue reading…

Data Science Mindset with Zacharias Voulgaris

http://traffic.libsyn.com/sedaily/DataScienceMindset.mp3Podcast: Play in new window | Download A company’s approach to data can make or break the business. In the past, data was static. There was not much data, it sat in Excel, and it was interacted with on a nightly or monthly basis. Now, data is dynamic, real time and huge. To tap into available data, many industries have oriented themselves to becoming data intensive. With many new industry

Continue reading…

Secure Authentication with Praneet Sharma

http://traffic.libsyn.com/sedaily/Keyless.mp3Podcast: Play in new window | Download When I log into my bank account from my laptop, I first enter my banking password. Then the bank sends a text message to my phone with a unique code, and I enter that code into my computer to finish the login. This login process is two-factor authentication. I am proving my identity by entering my banking password (the first factor) and validating

Continue reading…

Serverless Scheduling with Rodric Rabbah

http://traffic.libsyn.com/sedaily/ServerlessSchedulingIBM.mp3Podcast: Play in new window | Download Functions as a service are deployable functions that run without an addressable server. Functions as a service scale without any work by the developer. When you deploy a function as a service to a cloud provider, the cloud provider will take care of running that function whenever it is called. You don’t have to worry about spinning up a new machine and monitoring

Continue reading…

Animating VueJS with Sarah Drasner

http://traffic.libsyn.com/sedaily/AnimatingVueJS.mp3Podcast: Play in new window | Download Most user interfaces that we interact with are not animated. We click on a button, and a form blinks into view. We click a link and the page abruptly changes. On the other hand, when we interact with an application that has animations, we can feel the difference. The animations are often subtle. If you aren’t sure what I’m talking about, pay attention

Continue reading…

React and GraphQL at New York Times

http://traffic.libsyn.com/sedaily/NYTGraphql.mp3Podcast: Play in new window | Download Are we a media company or a technology company? Facebook and the New York Times are both asking themselves this question. Facebook originally intended to focus only on building technology–to be a neutral arbiter of information. This has turned out to be impossible. The Facebook newsfeed is defined by algorithms that are only as neutral as the input data. Even if we could

Continue reading…

How IBM Runs Its Cloud with Jason McGee

http://traffic.libsyn.com/sedaily/BuildingaCloudIBM.mp3Podcast: Play in new window | Download Cloud computing changed the economics of running a software company. A cloud is a network of data centers that offers compute resources to developers. In the 1990s, software companies purchased servers–an upfront capital expense that required tens of thousands of dollars. In the early 2000s, cloud computing started, and turned that capital expense into an operational expense. Instead of a huge bulk purchase

Continue reading…

Thumbtack Infrastructure with Nate Kupp

http://traffic.libsyn.com/sedaily/ThumbtackInfrastructure.mp3Podcast: Play in new window | Download Thumbtack is a marketplace for real-world services. On Thumbtack, people get their house painted, their dog walked, and their furniture assembled. With 40,000 daily marketplace transactions, the company handles significant traffic. On yesterday’s episode, we explored how one aspect of Thumbtack’s marketplace recently changed, going from asynchronous matching to synchronous “instant” matching. In this episode, we zoom out to the larger architecture of

Continue reading…

Marketplace Matching with Xing Chen

http://traffic.libsyn.com/sedaily/ThumbtackMarketplaceEvolution.mp3Podcast: Play in new window | Download The labor market is moving online. Taxi drivers are joining Uber and Lyft. Digital freelancers are selling their services through Fiverr. Experienced software contractors are leaving contract agencies to join Gigster. Online labor marketplaces create market efficiency by improving the communications between buyers and sellers. Workers make their own hours, and their performance is judged by customers and algorithms, rather than the skewed

Continue reading…

Load Balancing at Scale with Vivek Panyam

http://traffic.libsyn.com/sedaily/LoadBalancingatScale.mp3Podcast: Play in new window | Download Facebook serves interactive content to billions of users. Google serves query requests on the world’s biggest search engine. Uber handles a significant percentage of the transportation within the United States. These services are handling radically different types of traffic, but many of the techniques they use to balance loads are similar. Vivek Panyam is an engineer with Uber, and he previously interned at

Continue reading…

Incident Response with Emil Stolarsky

http://traffic.libsyn.com/sedaily/IncidentResponse.mp3Podcast: Play in new window | Download As a system becomes more complex, the chance of failure increases. At a large enough scale, failures are inevitable. Incident response is the practice of preparing for and effectively recovering from these failures. An engineering team can use checklists and runbooks to minimize failures. They can put a plan in place for responding to failures. And they can use the process of post

Continue reading…

Run Less Software with Rich Archbold

http://traffic.libsyn.com/sedaily/IntercomEngineering.mp3Podcast: Play in new window | Download There is a quote from Jeff Bezos: “70% of the work of building a business today is undifferentiated heavy lifting. Only 30% is creative work. Things will be more exciting when those numbers are inverted.” That quote is from 2006, before Amazon Web Services had built most of their managed services. In 2006, you had no choice but to manage your own database,

Continue reading…

Training the Machines with Russell Smith

http://traffic.libsyn.com/sedaily/RainforestQA.mp3Podcast: Play in new window | Download Automation is changing the labor market. To automate a task, someone needs to put in the work to describe the task correctly to a computer. For some tasks, the reward for automating a task is tremendous–for example, putting together mobile phones. In China, companies like FOXCONN are investing time and money into programming the instructions for how to assemble your phone. Robots execute

Continue reading…

High Volume Event Processing with John-Daniel Trask

http://traffic.libsyn.com/sedaily/HighVolumeEventProcessing.mp3Podcast: Play in new window | Download A popular software application serves billions of user requests. These requests could be for many different things. These requests need to be routed to the correct destination, load balanced across different instances of a service, and queued for processing. Processing a request might require generating a detailed response to the user, or making a write to a database, or the creation of a

Continue reading…

Fiverr Engineering with Gil Sheinfeld

http://traffic.libsyn.com/sedaily/FiverrEngineering.mp3Podcast: Play in new window | Download As the gig economy grows, that growth necessitates innovations in the online infrastructure powering these new labor markets. In our previous episodes about Uber, we explored the systems that balance server load and gather geospacial data. In our coverage of Lyft, we studied Envoy, the service proxy that standardizes communications and load balancing among services. In shows about Airbnb, we talked about the

Continue reading…

Serverless Event-Driven Architecture with Danilo Poccia

http://traffic.libsyn.com/sedaily/ServerlessEvents.mp3Podcast: Play in new window | Download In an event driven application, each component of application logic emits events, which other parts of the application respond to. We have examined this pattern in previous shows that focus on pub/sub messaging, event sourcing, and CQRS. In today’s show, we examine the intersection of event driven architecture and serverless architecture. Serverless applications can be built by combining functions-as-a-service (like AWS Lambda) together

Continue reading…

BigQuery with Jordan Tigani

http://traffic.libsyn.com/sedaily/BigQuery.mp3Podcast: Play in new window | Download Large-scale data analysis was pioneered by Google, with the MapReduce paper. Since then, Google’s approach to analytics has evolved rapidly, marked by papers such as Dataflow and Dremel. Dremel combined a column-oriented, distributed file system with a novel way of processing queries. A single Dremel query is distributed into a tree of servers, starting with the root server, splitting into the intermediate servers,

Continue reading…

Legal Technology with Justin Kan

http://traffic.libsyn.com/sedaily/LegalTechnology.mp3Podcast: Play in new window | Download Imagine that you are a lawyer. Your work involves managing files with dense, technical text. Your co-workers collaborate with you to accomplish a complex goal that can be broken down into smaller pieces. Your work has formal specifications, but there are degrees of freedom in how you express an idea. In all of these ways, the job of a lawyer is similar to

Continue reading…

Early Investments with Semil Shah

http://traffic.libsyn.com/sedaily/SemilShah.mp3Podcast: Play in new window | Download An engineer who wants to start a business using investment capital needs to understand the expectations of investors. The market for the business needs to be huge. The team needs to have a differentiated understanding of the market, or a differentiated product. The CEO needs to have the determination to continue operating the company even when it gets very difficult. And the price

Continue reading…

OpenBazaar with Brian Hoffman

http://traffic.libsyn.com/sedaily/OpenBazaar.mp3Podcast: Play in new window | Download Cryptocurrencies give us a decentralized financial system. OpenBazaar is a decentralized commerce system. A merchant can log onto OpenBazaar and post a listing for an item–for example, a t-shirt that I want to sell for $15. My item listing will spread throughout the OpenBazaar P2P network. A shopper can download the OpenBazaar desktop application and see my listing for a t-shirt. The shopper

Continue reading…

Netflix Serverless-like Platform with Vasanth Asokan

http://traffic.libsyn.com/sedaily/NetflixServerless.mp3Podcast: Play in new window | Download The Netflix API is accessed by developers who build for over 1000 device types: TVs, smartphontes, VR headsets, laptops. If it has a screen, it can probably run Netflix. On each of these different devices, the Netflix experience is different. Different screen sizes mean there is variable space to display the content. When you open up Netflix, you want to efficiently browse through

Continue reading…

Serverless Authentication with Bobby Johnson

http://media.blubrry.com/audio_reviews/p/traffic.libsyn.com/sedaily/Webtask.mp3Podcast: Play in new window | Download Serverless architecture is software that runs without an addressable server. Serverless is made possible by two types of technology: platform as a service providers like Auth0, and functions as a service like AWS Lambda. With both of these technologies, we can program logic that runs without being deployed to a server. Functions as a service are cheap and scalable. Write your code for

Continue reading…

Parlaying Failure to Fortune with Paul Martino

http://traffic.libsyn.com/sedaily/PaulMartino.mp3Podcast: Play in new window | Download In 2003, Paul Martino co-founded Tribe.net, one of the earliest social networking sites.  Tribe had significant traction, with hundreds of thousands of users. In the early 2000s, hundreds of thousands of users was enough traffic to pose a company with engineering challenges. Paul had studied computer science, and was able to use his knowledge of high-performance computing to write an efficient graph database,

Continue reading…

Bad Men with Bob Hoffman

http://traffic.libsyn.com/sedaily/BadMen.mp3Podcast: Play in new window | Download In the 1960s, advertising agencies were high-dollar creative producers. A client would come to an ad agency and pay millions of dollars for artistic messaging that would convince a consumer to buy a product. How could you measure the success of these advertising campaigns? Maybe you could see success in the sales data. Maybe people were starting to talk about the product. Ultimately,

Continue reading…

Augmented Reality with Scott Montgomerie

http://traffic.libsyn.com/sedaily/ScopeAR.mp3Podcast: Play in new window | Download Augmented reality applications are slowly making their way into the world of the consumer. Pokemon Go created the magical experience of seeing Pokemon superimposed upon the real world. IKEA’s mobile app lets you see how a couch would fit into your living room, which has a significant improvement on the furniture buying process. Augmented reality applications can have even more dramatic impact on

Continue reading…

Elastic Load Balancing with Ranga Rajagopalan

http://traffic.libsyn.com/sedaily/Avi_Networks_complete_with_preamble.mp3Podcast: Play in new window | Download Computational load is the amount of demand that is being placed on a computer system. “Load” can take the form of memory, CPU, network bandwidth, disk space, and other finite resources. When we design systems, we need to prepare for high-load events. On a social network, people are much more active in the mornings. On an e-commerce site, Black Friday causes many more

Continue reading…

Kafka at NY Times with Boerge Svingen

http://traffic.libsyn.com/sedaily/KafkaatNYT.mp3Podcast: Play in new window | Download The New York Times is a newspaper that evolved into a digital publication. Across its 166 year history, The Times has been known for longform journalistic quality, in addition to its ability to quickly churn out news stories. Some content on the New York Times is old but timeless “evergreen” content. Readers of the New York Times website are not only looking for the

Continue reading…

Cryptoeconomics with Vlad Zamfir

http://traffic.libsyn.com/sedaily/VladZamfir.mp3Podcast: Play in new window | Download A cryptocurrency has a distributed ledger called a blockchain. The blockchain keeps track of every transaction that occurs across the cryptocurrency. This blockchain must stay up-to-date and verified–which requires someone in the network to do that validation. Bitcoin and Ethereum use the proof-of-work algorithm. Miners do computational work to validate the legitimacy of transactions across the network, and in return they are given

Continue reading…

Analyse Asia with Bernard Leong

http://traffic.libsyn.com/sedaily/AnalyseAsia.mp3Podcast: Play in new window | Download In America, the tech companies we focus on are commonly known as FAANG: Facebook, Amazon, Apple, Netflix, Google. We all know what these companies do because they impact our daily lives. In Asia, there are three giant tech companies that have similar scale: Baidu, Alibaba, and Tencent, otherwise known as BAT. Technology within a location is shaped by the pressures of that location.

Continue reading…

IFTTT Architecture with Nicky Leach

http://traffic.libsyn.com/sedaily/IFTTT.mp3Podcast: Play in new window | Download It’s 9pm at night, and you are hungry. You order a pizza from Domino’s. You live on a street that’s dark, and so you have installed a smart lightbulb in front of your mailbox that lights up the address. When the pizza at Domino’s is ready, you want the lightbulb on your mailbox to light up so that the delivery person can read

Continue reading…

Dremio with Tomer Shiran

http://traffic.libsyn.com/sedaily/Dremio.mp3Podcast: Play in new window | Download The MapReduce paper was published by Google in 2004. MapReduce is an algorithm that describes how to do large-scale data processing on large clusters of commodity hardware. The MapReduce paper marked the beginning of the “big data” movement. The Hadoop project is an open source implementation of the MapReduce paper. Doug Cutting and Mike Cafarella wrote software that allowed anybody to use MapReduce,

Continue reading…

Keybase with Max Krohn

http://traffic.libsyn.com/sedaily/Keybase.mp3Podcast: Play in new window | Download Public key encryption allows for encrypted, private messages. A message sent from Bob to Alice gets encrypted using Alice’s public key. Public key encryption also allows for signed messages–so that when Alice signs a message, Alice uses her private key and Bob can verify it if Bob has her public key. In both cases, Bob needs Alice’s public key! If Bob gets that

Continue reading…

Quantum Computing Introduction with Zlatko Minev

http://traffic.libsyn.com/sedaily/QuantumComputing.mp3Podcast: Play in new window | Download Computer chips have physical limitations. When transistors get too small, electrons start to behave in ways that make the hardware modules less reliable. Our reliable technological progress has been enabled by Moore’s Law: the idea that the number of components we can fit on a chip doubles roughly every 12-18 months. We can’t keep shrinking the size of these components, because physics is

Continue reading…

Smart Contract Security with Emin Gün Sirer

http://traffic.libsyn.com/sedaily/SmartContractSecurity.mp3Podcast: Play in new window | Download A smart contract is a program that allows for financial transactions. Smart contracts are usually associated with the Ethereum platform, which has a language called Solidity that makes it easy to program smart contracts. Someday, we will have smart contracts issuing insurance, processing legal claims, and executing accounting transactions. Smart contracts involve money, and they are likely to transact with cryptocurrencies. That makes

Continue reading…

Interviewing.io with Aline Lerner

http://traffic.libsyn.com/sedaily/Interviewing-io.mp3Podcast: Play in new window | Download Interviewing engineers is not a solved problem. Quite the opposite–everyone in the software industry will tell you their own personal issues with the hiring process. One reason that technical interviews have not evolved significantly is the lack of standardized tooling. Some companies give you one phone screen, some give you two. Some companies have you solve brain teasers (“how many golf balls fit

Continue reading…

Model Training with Yufeng Guo

http://traffic.libsyn.com/sedaily/ModelTraining.mp3Podcast: Play in new window | Download Machine learning models can be built by plotting points in space and optimizing a function based off of those points. For example, I can plot every person in the United States in a 3 dimensional space: age, geographic location, and yearly salary. Then I can draw a function that minimizes the distance between my function and each of those data points. Once I

Continue reading…

Internet Monitoring with Matt Kraning

http://traffic.libsyn.com/sedaily/InternetMonitoring.mp3Podcast: Play in new window | Download How would you build a system for indexing and monitoring the entire Internet? Start by breaking the Internet up into IP address ranges. Give each of those address ranges to servers distributed around the world. On each of those servers, iterate through your list of IP addresses, sending packets to them. Depending on what sorts of packets those IP addresses respond to, and

Continue reading…

Scala Native with Denys Shabalin

http://traffic.libsyn.com/sedaily/ScalaNative.mp3Podcast: Play in new window | Download Scala is a functional and object oriented programming language built on the JVM. Scala Native takes this language, loved by many, and brings it to bare metal. Scala Native is an optimizing ahead-of-time compiler and lightweight managed runtime designed specifically for Scala. Denys Shabalin is a Research Assistant at the EPFL and the primary creator of Scala Native. In this episode, Adam Bell

Continue reading…

Gigster with Roger Dickey

http://traffic.libsyn.com/sedaily/Gigster.mp3Podcast: Play in new window | Download You have heard the phrase: every company is becoming a software company. An insurance company is now supposed to turn into a software company that sells insurance. A clothing retailer needs to reinvent itself to be able to build software to manage the production and distribution of its clothing. Software applications provide so much leverage to an organization, it seems smart to develop

Continue reading…

Blockchain Building with Daniel van Flymen

http://traffic.libsyn.com/sedaily/BuildaBlockchain.mp3Podcast: Play in new window | Download A blockchain is a data structure that provides decentralized, peer-to-peer data distribution. Bitcoin is the most well-known blockchain, but in the next decade we will see many more blockchains. Most listeners probably know that you could just fork the code of Bitcoin to start your own blockchain–but wouldn’t it be nice to know how to build a blockchain from scratch? Daniel van Flymen

Continue reading…

Ethereum Platform with Preethi Kasireddy

http://traffic.libsyn.com/sedaily/EthereumBasics.mp3Podcast: Play in new window | Download Ethereum is a decentralized transaction-based state machine. Ethereum was designed to make smart contracts more usable for developers. Smart contracts are decentralized programs that usually allow for some a transaction between the owner of the contract and anyone who would want to purchase something from the contract owner. For example, I could set up a smart contract where a listener sends my smart

Continue reading…

Bitcoin Segwit with Jordan Clifford

http://traffic.libsyn.com/sedaily/BlocksizeDebate.mp3Podcast: Play in new window | Download Visa processes 1,600 transactions per second. PayPal processes 193 transactions per second. Bitcoin processes only 3-4 transactions per second. In order to fulfill the dreams of financial programming–in order to get decentralized, peer-to-peer micropayments–Bitcoin needs a much higher transaction throughput. Bitcoin’s scalability issues have led to debates within the community and changes in the software. In this episode, Jordan Clifford gives an overview

Continue reading…

Tinder Engineering Management with Bryan Li

http://traffic.libsyn.com/sedaily/TinderManagement.mp3Podcast: Play in new window | Download Tinder is a rapidly growing social network for meeting people and dating. In the past few years, Tinder’s userbase has grown rapidly, and the engineering team has scaled to meet the demands of increased popularity. On Tinder, you are presented with a queue of suggested people that you might match with, and you swipe left or right to indicate that you like or

Continue reading…

Advertiser Trust with Marc Goldberg

http://traffic.libsyn.com/sedaily/TrustMetrics.mp3Podcast: Play in new window | Download Despite all the problems with online advertising, ads are not going away. Advertising is fundamental to the modern Internet economy. In previous episodes of Software Engineering Daily, we have mostly dissected the problems of adtech–bots, tracking, fraud, brand safety. We have talked about some solutions–for example, JavaScript tags that you can put on a page to identify a bot before you serve it

Continue reading…

Ad Fraud Science with Augustine Fou

http://traffic.libsyn.com/sedaily/AugustineFou.mp3Podcast: Play in new window | Download Advertising fraud continues to plague the Internet. We do not know the scope and scale of that fraud. How many ads on the Internet are viewed by bots? Estimations range from 2% to 99%. Advertisers are slowly becoming more educated about fraud, thanks in part to Dr. Augustine Fou. Dr. Fou is a full-time advertising fraud researcher. He looks at data sets of

Continue reading…

User Management with Michel Feaster

http://traffic.libsyn.com/sedaily/Usermind.mp3Podcast: Play in new window | Download A customer engages with a company across a variety of channels–email, Zendesk, Salesforce, online advertising. Unifying those data sources and getting a dashboard into the entire customer experience is the goal of Usermind, a customer engagement hub. If you can get all of that data unified in one place, it creates a tool that salespeople, customer service, and marketing can all look at

Continue reading…

42 Coding School with Brittany Bir

http://traffic.libsyn.com/sedaily/42CodingSchool.mp3Podcast: Play in new window | Download 42 is tuition-free developer school for students from 18-30. It was started by Xavier Niel, a French billionaire who wanted to encourage a new model of software education. 42 has campuses in France and Silicon Valley. 42 has very high standards for the students it admits, because the students that get in are not paying tuition, but they have 24/7 access to high

Continue reading…

ReactVR with Andrew Imm

http://traffic.libsyn.com/sedaily/ReactVR.mp3Podcast: Play in new window | Download React is a programming model for user interfaces. ReactJS is for building user interfaces for web applications. React Native is for building UI on Android or iOS. ReactVR is for building user interfaces in virtual reality. React Native was originally developed to make it easier to maintain parity between the web, iOS, and Android teams at Facebook. If I build an application for

Continue reading…

Sports Deep Learning with Yu-Han Chang and Jeff Su

http://traffic.libsyn.com/sedaily/SportsAnalytics.mp3Podcast: Play in new window | Download A basketball game gives off endless amounts of data. Cameras from all angles capture the players making their way around the court, dribbling, passing, and shooting. With computer vision, a computer can build a well-defined understanding for what a sport looks like. With other machine learning techniques, the computer can make predictions by combining historical data with a game that is going on

Continue reading…

Alerting and Metrics with Clement Pang

http://traffic.libsyn.com/sedaily/ClementPang.mp3Podcast: Play in new window | Download An alert is a signal of problematic application behavior. When something unusual happens to your application, an alert can bring that anomaly to your attention. In order to detect unusual events, you need to define the norm. In order to define both normal and problematic behavior, you need metrics. Metrics are measurements of the behavior in your application. Metrics get created from logs

Continue reading…

Video Infrastructure with Matt McClure and Jon Dahl

http://traffic.libsyn.com/sedaily/VideoInfrastructure.mp3Podcast: Play in new window | Download Playing a video on the Internet seems simple. You press play, the video gets delivered, and boom–you are watching Game of Thrones, right? It’s a bit more complicated. Unless you have built an application that involves video, you probably have not dealt with the world of codecs, bitrates, and streaming. Depending on the bandwidth between the user and the server, you might want

Continue reading…

Dashboarding and Query Latency with Tom O’Neill

http://traffic.libsyn.com/sedaily/PeriscopeData.mp3Podcast: Play in new window | Download A dashboard is a data visualization that aggregates metrics in a way that we can quickly understand. In a modern software company, everyone uses dashboards–from salespeople to DevOps to HR. Each dashboard represents a query that must be updated frequently, so that anyone looking at it is getting up-to-date information. The data set being queried might be getting updated quickly in the case

Continue reading…

Static Analysis with Paul Anderson

http://traffic.libsyn.com/sedaily/StaticAnalysis.mp3Podcast: Play in new window | Download Static analysis is the process of evaluating code for errors, memory leaks, and security vulnerabilities. The “static” part refers to the fact that the code is not running. This differentiates it from unit tests and integration tests, which evaluate the runtime characteristics of code. If you use an IDE or a linter, you are using a basic form of static analysis all the

Continue reading…

The Coding VC with Leo Polovets

http://traffic.libsyn.com/sedaily/CodingVC.mp3Podcast: Play in new window | Download The underlying cause of failure for many startups is that the founders are afraid of discomfort. An environment where everyone is comfortable is unlikely to be an environment where personal growth and value creation is occurring. When you are in a startup, calibrating the right amount of discomfort is often about calibrating risk. What are your risks? Can you quantify them? Can you

Continue reading…

Tinder Growth Engineering with Alex Ross

http://traffic.libsyn.com/sedaily/TinderGrowthEngineering.mp3Podcast: Play in new window | Download Tinder is a popular dating app where each user swipes through a sequence of other users in order to find a match. Swiping left means you are not interested. Swiping right means you would like to connect with the person. The simple premise of Tinder has led to massive growth, and the app is now also used to discover new friends and create

Continue reading…

Brave Browser with Jonathan Sampson

http://traffic.libsyn.com/sedaily/Brave.mp3Podcast: Play in new window | Download Online advertising enables free content and services of the Internet. One of the free services that is powered by advertising is the browser. 60% of web browsing is done through Chrome, which is owned by Google, which is powered by advertising. The application that most of us use to explore the web is made by a company that relies on ads, so it

Continue reading…

Deep Learning Systems with Milena Marinova

http://traffic.libsyn.com/sedaily/DeepLearningSystems.mp3Podcast: Play in new window | Download The applications that demand deep learning range from self-driving cars to healthcare, but the way that models are developed and trained is similar. A model is trained in the cloud and deployed to a device. The device engages with the real world, gathering more data. That data is sent back to the cloud, where it can improve the model. From the processor level

Continue reading…

Spotify Event Delivery with Igor Maravic

http://traffic.libsyn.com/sedaily/SpotifyEventDelivery.mp3Podcast: Play in new window | Download Spotify is a streaming music company with more than 50 million users. Whenever a user listens to a song, Spotify records that event and uses it as input to learn more about the user’s preferences. Listening to a song is one type of event–there are hundreds of others. Opening the Spotify app, skipping a song, sharing a playlist with a friend–all of these

Continue reading…

Advertising Analytics with Jonah Goodhart

http://traffic.libsyn.com/sedaily/MoatAnalytics.mp3Podcast: Play in new window | Download Moat is one of the most successful advertising technology companies in history. After building a business from measurement of ad impressions, Moat was sold to Oracle for $850 million. Advertising powers the free content on the Internet. Measurement makes it easier for publishers to monetize their content. At Software Engineering Daily, we know this from firsthand experience. The podcast ecosystem has barely any

Continue reading…

Visual Search with Neel Vadoothker

http://traffic.libsyn.com/sedaily/Visual_Search.mp3Podcast: Play in new window | Download If I have a picture of a dog, and I want to search the Internet for pictures that look like that dog, how can I do that? I need to make an algorithm to build an index of all the pictures on the Internet. That index can define the different features of my images. I can find mathematical features in each image that

Continue reading…

Doing Anything with George Anders

http://traffic.libsyn.com/sedaily/GeorgeAnders.mp3Podcast: Play in new window | Download Software gives us new ways of communicating with each other. Engineers build scalable systems for e-commerce, helpdesk, and video sharing–and these systems do scale, to millions of people. But software alone cannot serve all of the demands of all the users and customers on these platforms. We need customer service representatives to address unexpected demands. We need design specialists to evaluate the interface

Continue reading…

Word2Vec with Adrian Colyer

http://traffic.libsyn.com/sedaily/Word2vecAdrianColyer.mp3Podcast: Play in new window | Download Machines understand the world through mathematical representations. In order to train a machine learning model, we need to describe everything in terms of numbers.  Images, words, and sounds are too abstract for a computer. But a series of numbers is a representation that we can all agree on, whether we are a computer or a human. In recent shows, we have explored how

Continue reading…

DAO Hack with Matt Leising

http://traffic.libsyn.com/sedaily/DAOHack.mp3Podcast: Play in new window | Download The Decentralized Autonomous Organization (DAO) was a digital form of venture capital. It was an ambitious idea–to provide a new decentralized business model for organizing corporations on top of the Ethereum blockchain. Few people in the crypto community were opposed to this premise–but the timeline was short, the code requirements were tremendous, and in retrospect, a vulnerability was inevitable. The DAO launched in

Continue reading…

Software Engineering Daily App with Keith and Craig Holliday

http://traffic.libsyn.com/sedaily/SEDApp.mp3Podcast: Play in new window | Download You have probably missed some of the best episodes of Software Engineering Daily. If you listen to just a few episodes a week, it can be difficult to identify the high quality shows. And if you are new to the podcast, you have no idea how to find episodes that might appeal to you. Software Engineering Daily has a discovery problem. We have

Continue reading…

Attack Attribution with John Davis

http://traffic.libsyn.com/sedaily/AttackAttribution.mp3Podcast: Play in new window | Download When a cyber attack occurs, how do we identify who committed it? There is no straightforward answer to that question. Even if we know Chinese hackers have infiltrated our power grid with logic bombs, we might not be able to say with certainty whether those hackers were state actors or rogue Chinese hackers looking for an offensive asset to sell to their government.

Continue reading…

Car and IoT Security with Chris Craig

http://traffic.libsyn.com/sedaily/SecurityChrisCraig.mp3Podcast: Play in new window | Download Ransomware and DDoS attacks happen all the time. Sometimes they affect large swaths of users. WannaCry ransomware froze the computer systems in hospitals. Mirai botnet DDoS attacks took down a DNS provider, making Netflix and Twitter inaccessible for a short period of time. These are innocent attacks compared to what we could face from a world where cars, heart rate monitors, and other

Continue reading…

Artificial Intelligence APIs with Simon Chan

http://traffic.libsyn.com/sedaily/SalesforceEinstein.mp3Podcast: Play in new window | Download Software companies that have been around for a decade have a ton of data. Modern machine learning techniques are able to turn that data into extremely useful models. Salesforce users have been entering petabytes of data into the company’s CRM tool since 1999. With its Einstein suite of products, Salesforce is using that data to build new product features and APIs. Simon Chan

Continue reading…

Information Theory with Jimmy Soni and Rob Goodman

http://traffic.libsyn.com/sedaily/ClaudeShannon.mp3Podcast: Play in new window | Download We write code in a language that looks like English. Whether it is JavaScript, Fortran, or assembly language, that code is an abstraction on top of layers of intermediate languages, binary, transistors, and physics. 100 years ago, this would have seemed like magic. Most of us know about Alan Turing, who described the vision of a multipurpose computer with the concept of the

Continue reading…

Healthcare AI with Cosima Gretton

http://traffic.libsyn.com/sedaily/HealthwithCosima.mp3Podcast: Play in new window | Download Automation will make healthcare more efficient and less prone to error. Today, machine learning is already being used to diagnose diabetic retinopathy and improve radiology accuracy. Someday, an AI assistant will assist a doctor in working through a complicated differential diagnosis. Our hospitals look roughly the same today as they did ten years ago, because getting new technology into the hands of doctors

Continue reading…

Industrial IoT with Jayson Delancey

http://traffic.libsyn.com/sedaily/IndustrialIoT.mp3Podcast: Play in new window | Download Sensors are being attached to trains, lightposts, and all kinds of factory equipment. Industrial machinery gives off high volumes of data that can be captured, stored, and processed with machine learning in order to improve workflows and ensure safety. Jayson Delancey works at GE, which is building tools and systems to manage large IoT deployments. The full stack for enterprise IoT involves tools

Continue reading…