Machine Learning with Data Skeptic and Second Spectrum at Telesign

http://traffic.libsyn.com/sedaily/2018_05_19_LAMeetup.mp3Podcast: Play in new window | DownloadData Skeptic is a podcast about machine learning, data science, and how software affects our lives. The first guest on today’s episode is Kyle Polich, the host of Data Skeptic. Kyle is one of the best explainers of machine learning concepts I have met, and for this episode, he presented some material that is perfect for this audience: machine learning for software engineers. Second

Continue reading…

Alexa Voice Design with Paul Cutsinger

http://traffic.libsyn.com/sedaily/2018_05_18_VoiceDesign.mp3Podcast: Play in new window | Download Voice interfaces are a newer form of communicating with computers. Alexa is a voice interface platform from Amazon. Alexa powers the Amazon Echo, as well as Alexa-enabled cars, refrigerators, and dishwashers. Any developer can build a device with a voice interface using a Raspberry Pi. Paul Cutsinger works on Echo and Alexa at Amazon. He’s focused on growing the market of developers who

Continue reading…

Pulsar Messaging with Lewis Kaneshiro

http://traffic.libsyn.com/sedaily/2018_05_17_Pulsar.mp3Podcast: Play in new window | Download Message broker systems decouple the consumers and producers of a message channel. In previous shows, we have explored ZeroMQ, PubNub, Apache Kafka, and NATS. In this episode, we talk about another message broker: Apache Pulsar. Pulsar is an open source distributed pub-sub message system originally created at Yahoo. It was used to scale products with high volumes of users–such as Yahoo Mail. There

Continue reading…

Gloo: Function Gateway with Idit Levine

http://traffic.libsyn.com/sedaily/2018_05_16_Gloo.mp3Podcast: Play in new window | Download Gloo is a function gateway built on top of the popular open source project Envoy. The goal of Gloo is to decouple client-facing APIs from upstream APIs. Gloo is similar to an API gateway, which is a tool that software companies can use to collect all their APIs and one place and impose security, monitoring, and other standards around those APIs. The goal

Continue reading…

Cloud Native Computing Foundation with Chris Aniszczyk and Dan Kohn

http://traffic.libsyn.com/sedaily/2018_05_14_CloudNativeComputingFoundation.mp3Podcast: Play in new window | Download The Kubernetes ecosystem consists of enterprises, vendors, open source projects, and individual engineers. The Cloud Native Computing Foundation was created to balance the interests of all the different groups within the cloud native community. CNCF has similarities to the Linux Foundation and the Apache Foundation. CNCF helps to guide open source projects in the Kubernetes ecosystem–including Prometheus, Fluentd, and Envoy. With the help

Continue reading…

Cluster Schedulers with Ben Hindman

http://traffic.libsyn.com/sedaily/2018_05_11_Mesosphere.mp3Podcast: Play in new window | Download Mesos is a system for managing distributed systems. The goal of Mesos is to help engineers orchestrate resources among multi-node applications like Spark. Mesos can also manage lower level schedulers like Kubernetes. A common misconception is that Mesos aims to solve the same problem as Kubernetes, but Mesos is a higher level abstraction. Ben Hindman co-founded Mesosphere to bring the Mesos project to

Continue reading…

Deep Learning Topologies with Yinyin Liu

http://traffic.libsyn.com/sedaily/2018_05_10_DeepLearningTopologies.mp3Podcast: Play in new window | Download Algorithms for building neural networks have existed for decades. For a long time, neural networks were not widely used. Recent changes to the cost of compute and the size of our data have made neural networks extremely useful. Our smart phones generate terabytes of useful data. Lower storage costs make it economical to keep that data. Cloud computing democratized the ability to do

Continue reading…

Data Engineering Podcast with Tobias Macey

http://traffic.libsyn.com/sedaily/2018_05_09_DataEngineeringwithTobiasMacey.mp3Podcast: Play in new window | DownloadCloud computing lowered the cost and improved accessibility to tools for storing large volumes of data. In the early 2000s, Hadoop caused a revolution in large scale batch processing. Since then, companies have been building ways to store and access their data faster and more efficiently. At the same time, the sheer volume of data has increased and machine learning has given rise to

Continue reading…

Stripe Atlas with Patrick McKenzie

http://traffic.libsyn.com/sedaily/2018_05_08_StripeAtlas.mp3Podcast: Play in new window | DownloadStarting an Internet business is harder than it should be. You need to incorporate, create an operating agreement, set up a system to accept payments, and many other straightforward tasks. In the 1990s, this was how it felt to set up anything on the Internet. You always had to stand up a web server on your own infrastructure, before you could get to the

Continue reading…

Affirm Engineering with Libor Michalek

http://traffic.libsyn.com/sedaily/2018_05_07_AffirmEngineering.mp3Podcast: Play in new window | DownloadWhen I buy a mattress online, I pay for it with my credit card. Behind the scenes, a complex series of transactions occur between a payment gateway, the credit card company, and a few banks. There are problems with this process–it is slow, complex, and involves the synchronization of several different parties. Some consumers will not want to purchase the mattress because they do

Continue reading…

Superpedestrian Robotic Wheel / Infrastructure at HubSpot Meetup Talks

http://traffic.libsyn.com/sedaily/2018_05_05_RoboticWheel_InfrastructureatHubspotMeetupTalks.mp3Podcast: Play in new window | DownloadSuperpedestrian is a robotic bicycle wheel that learns how you pedal and personalizes your bicycle ride. The engineering challenges of Superpedestrian are at the intersection of robotics, software, and real-time analytics. The first half of today’s show is about Superpedestrian. Goss Nuzzo Jones and Matt Cole are engineers at Superpedestrian. The slides for their presentation are also in the show notes. The second half

Continue reading…

Spark Geospatial Analytics with Ram Sriharsha

http://traffic.libsyn.com/sedaily/2018_05_04_GeospatialAnalytics.mp3Podcast: Play in new window | Download Phones are constantly tracking the location of a user in space. Devices like cars, smart watches, and drones are also picking up high volumes of location data. This location data is also called “geospatial data.” The amount of geospatial data is rapidly increasing, and there is a growing demand for software to perform operations over that data. Geospatial data sets are often massive–so

Continue reading…

WannaCry’s Gray Hat with Reeves Wiedeman

http://traffic.libsyn.com/sedaily/2018_05_03_WannaCryGrayHat.mp3Podcast: Play in new window | Download Last year, the WannaCry ransomware attack shut down hospitals, public transportation systems, and governments, demanding payment to unlock key computer systems. A programmer named Marcus Hutchins was able to stop WannaCry by registering a DNS entry buried in the WannaCry code. Not long after he stopped the WannaCry attack, Marcus Hutchins was arrested at a security conference in Las Vegas. Marcus’s arrest was

Continue reading…

Building Datadog with Alexis Le-Quoc

http://traffic.libsyn.com/sedaily/2018_05_02_BuildingDatadog.mp3Podcast: Play in new window | Download Alexis Le-Quoc started Datadog in 2010, after living through the Internet boom and bust cycle of the late 90s and early 2000s. In 2010, cloud was just starting to become popular. There was a gap in the market for infrastructure monitoring tools, which Alexis helped fill with the first version of Datadog. Since 2010, the number of different cloud infrastructure products has proliferated.

Continue reading…

Technology Utopia with Michael Solana

http://traffic.libsyn.com/sedaily/2018_05_01_AnatomyofNext.mp3Podcast: Play in new window | DownloadTechnology is pushing us rapidly toward a future that is impossible to forecast. We try to imagine what that future might look like, and we can’t help having our predictions shaped by the media we have consumed. 1984, Terminator, Gattaca, Ex Machina, Black Mirror–all of these stories present a dystopian future. But if you look around the world, the most successful technologists are mostly

Continue reading…

Epicenter Cryptocurrencies with Brian Fabian Crain

http://traffic.libsyn.com/sedaily/2018_04_30_EpicenterBitcoin.mp3Podcast: Play in new window | Download Podcasting about cryptocurrencies is a strange occupation. You get emails all the time from companies doing a token sale that you would never want to be affiliated with. You get angry tweets from anonymous Twitter accounts that are on one side of the Bitcoin scaling debate. You get to interview extreme personalities, and the technical discussions can be highly educational. Brian Fabian Crain

Continue reading…

Keybase Architecture / Clarifai Infrastructure Meetup Talks

http://traffic.libsyn.com/sedaily/2018_04_28_KeybaseArchitectureClarifaiInfrastructure.mp3Podcast: Play in new window | Download Keybase is a platform for managing public key infrastructure. Keybase’s products simplify the complicated process of associating your identity with a public key. Keybase is the subject of the first half of today’s show. Michael Maxim, an engineer from Keybase gives an overview for how the technology works and what kinds of applications Keybase unlocks. The second half of today’s show is about

Continue reading…

Google Cluster Evolution with Brian Grant

http://traffic.libsyn.com/sedaily/2018_04_27_KubernetesClusterManagement.mp3Podcast: Play in new window | Download Google’s central system for managing compute resources is called Borg. On Borg, millions of Linux containers process a wide variety of workloads. When a new application is spun up, Borg provides that application with the resources it needs. Workloads at Google usually fall into one of two distinct categories: long-running application workloads (such as Gmail) and batch workloads (such as a MapReduce job).

Continue reading…

TensorFlow Applications with Rajat Monga

http://traffic.libsyn.com/sedaily/2018_04_26_TensorFlowUpdates.mp3Podcast: Play in new window | Download Rajat Monga is a director of engineering at Google where he works on TensorFlow. TensorFlow is a framework for numerical computation developed at Google. The majority of TensorFlow users are building machine learning applications such as image recognition, recommendation systems, and natural language processing–but TensorFlow is actually applicable to a broader range of scientific computation than just machine learning. TensorFlow has APIs for

Continue reading…

Siftery Engineering with Ayan Barua

http://traffic.libsyn.com/sedaily/2018_04_25_SifteryEngineering.mp3Podcast: Play in new window | Download There are hundreds of different databases. There are tens of continuous delivery products. There is an ocean of cloud providers and CRM systems and monitoring platforms and sales prospecting tools. The range of available software products is so diverse that it can be overwhelming to figure out which products to buy. Siftery is a company that was started to index software products and

Continue reading…

NATS Messaging with Derek Collison

http://traffic.libsyn.com/sedaily/2018_04_24_NATSMessageBroker.mp3Podcast: Play in new window | Download A message broker is an architectural component that sends messages between different nodes in a distributed system. Message brokers are useful because the sender of a message does not always know who might want to receive that message. Message brokers can be used to implement the “publish/subscribe” pattern, and by centralizing the message workloads within the pub/sub system, it lets system operators scale

Continue reading…

Stripe Observability Pipeline with Cory Watson

http://traffic.libsyn.com/sedaily/2018_04_23_StripeObservability.mp3Podcast: Play in new window | DownloadStripe processes payments for thousands of businesses. A single payment could involve 10 different networked services. If a payment fails, engineers need to be able to diagnose what happened. The root cause could lie in any of those services. Distributed tracing is used to find the causes of failures and latency within networked services. In a distributed trace, each period of time associated with

Continue reading…

Bitcoin Debates with Roger Ver

http://traffic.libsyn.com/sedaily/2018_04_20_BitcoinwithRogerVer.mp3Podcast: Play in new window | Download Bitcoin and Bitcoin Cash are two cryptocurrencies with similar properties. But the supporters of each of these Bitcoin versions have strongly divergent opinions on the direction of the Bitcoin project. At the center of this debate is the subject of block size. Bitcoin’s block size determines how many transactions fit into each block that is mined. A larger block size leads to faster

Continue reading…

React Stack with G2i Team

http://traffic.libsyn.com/sedaily/2018_04_19_ReactandGraphQL.mp3Podcast: Play in new window | Download Most new frontend webapps today use ReactJS. An increasing number of mobile apps are created using the cross-platform components of React Native. GraphQL, Facebook’s open source data-fetching middleware tool is being used by more and more companies, who are finding that it simplifies their development. Facebook’s open source suite of technologies created a new developer ecosystem. There is an increased demand for engineers

Continue reading…

SafeGraph with Auren Hoffman

http://traffic.libsyn.com/sedaily/2018_04_17_MLDatawithAurenHoffman.mp3Podcast: Play in new window | Download Machine learning tools are rapidly maturing. TensorFlow gave developers an open source version of Google’s internal machine learning framework. Cloud computing provides a cost effective, accessible way of training models. Edge computing allows for low latency deployments of models. But even if you are a kid with a laptop who has learned all the machine learning algorithms, read all of the deep learning

Continue reading…

Talking Bitcoin with Adam B. Levine

http://traffic.libsyn.com/sedaily/2018_04_17_TalkingBitcoin.mp3Podcast: Play in new window | Download Let’s Talk Bitcoin is one of the most popular podcasts about cryptocurrencies. Adam B. Levine started it after three other podcasts he started did not get the traction he had hoped for. Adam parlayed the success of Let’s Talk Bitcoin into a network of podcasts–the Let’s Talk Bitcoin Network–which also includes one of my favorite shows, Epicenter. Adam joins me on today’s episode

Continue reading…

Monitoring Kubernetes with Ilan Rabinovitch

http://traffic.libsyn.com/sedaily/2018_04_16_MonitoringKuberneteswithDatadog.mp3Podcast: Play in new window | Download Monitoring a Kubernetes cluster allows operators to track the resource utilization of the containers within that cluster. In today’s episode, Ilan Rabinovitch joins the show to explore the different options for setting up monitoring, and some common design patterns around Kubernetes logging and metrics gathering. Ilan is the VP of product and community at Datadog. Earlier in his career, Ilan spent much of

Continue reading…

Unchained with Laura Shin

http://traffic.libsyn.com/sedaily/2018_04_13_Unchained.mp3Podcast: Play in new window | Download Laura Shin is the host of Unchained, a podcast about cryptocurrencies and decentralized technology. For every episode, Laura does significant research and preparation, so the content turns out polished and high quality. Her enthusiasm for the subject of cryptocurrencies comes through in her reporting. Podcasting about cryptocurrencies requires walking a fine line. Cryptocurrencies have a mixture of drama and exciting technology–which are both

Continue reading…

Mastodon: Federated Social Network with Eugen Rochko

http://traffic.libsyn.com/sedaily/2018_04_12_Mastodon.mp3Podcast: Play in new window | Download Social networks can make you feel connected to a global society. But those social networks are controlled by a corporate entity. The profit motivations of the corporation are not directly aligned with the experience of the users. Mastodon is an open source, decentralized social network. Eugen Rochko started building Mastodon in response to his dissatisfaction with centralized social networks like Facebook and Twitter.

Continue reading…

Go Systems with Erik St. Martin

http://traffic.libsyn.com/sedaily/2018_04_11_GowithErikStMartin.mp3Podcast: Play in new window | Download Go is a language designed to improve systems programming. Go includes abstractions that simplify aspects of low level engineering that are historically difficult—concurrency, resource allocation, and dependency management. In that light, it makes sense that the Kubernetes container orchestration system was written in Go. Erik St. Martin is a cloud developer advocate at Microsoft, where he focuses on Go and Kubernetes. He also

Continue reading…

Site Reliability Management with Mike Hiraga

http://traffic.libsyn.com/sedaily/2018_04_09_SREMikeHiraga.mp3Podcast: Play in new window | Download Software engineers have interacted with operations teams since software was being written. In the 1990s, most operations teams worked with physical infrastructure. They made sure that servers were provisioned correctly and installed with the proper software. When software engineers shipped bad code that took down a software company, the operations teams had to help recover the system—which often meant dealing with the physical

Continue reading…

IPFS Design with David Dias

http://traffic.libsyn.com/sedaily/2018_04_06_IPFSDavidDias.mp3Podcast: Play in new window | DownloadThe Interplanetary File System (IPFS) is a decentralized global, peer-to-peer file system. IPFS combines ideas from BitTorrent, Git, and Bitcoin, creating a new way to store and access objects across the Internet. When you access an object on almost any website, you are accessing the object via a location address—a URL. The URL tells you where to find the object. If the object is

Continue reading…

Ethereum Governance with Hudson Jameson

http://traffic.libsyn.com/sedaily/2018_04_05_EthereumGovernance.mp3Podcast: Play in new window | DownloadThe Ethereum community started as a small group of dedicated engineers. It has ballooned to thousands of engineers, entrepreneurs and investors, all of whom have a stake in the direction of Ethereum. Ethereum is an open source project, and the direction of a popular open source project can get complex. Ethereum is figuring out how to govern itself. It’s not clear what the perfect

Continue reading…

PubSub Infrastructure with Stephen Blum

http://traffic.libsyn.com/sedaily/2018_04_04_PubsubInfrastructure.mp3Podcast: Play in new window | Download The pubsub pattern allows a developer to create channels, which messages can be written to and read from. Pubsub messaging is useful for multicast messaging–when you want to publish messages from a producer, and have multiple consumers who are subscribed to the publisher receive those messages. Almost any application that reaches a high level of complexity will need a pubsub system of some

Continue reading…

Gitcoin: Open Source Bounties with Kevin Owocki

http://traffic.libsyn.com/sedaily/2018_04_03_Gitcoin.mp3Podcast: Play in new window | Download Most technology companies rely on open source software projects. But open source software projects are often maintained by a group of people that is not affiliated with any particular company. When an open source project develops too much technical debt, it can become a tragedy of the commons. Who is responsible for maintaining these open source projects? This is the motivation for open

Continue reading…

Zcash Design with Sean Bowe

http://traffic.libsyn.com/sedaily/2018_04_02_ZcashSeanBowe.mp3Podcast: Play in new window | Download Zcash is a payment and consensus system that allows users to transfer money to each other with strong guarantees of privacy. Zcash implements the same core features of Bitcoin, with the added functionality of shielded payments. Shielded payments are private, and they are enabled by a novel cryptographic technique called zk-SNARKS: zero knowledge succinct non-interactive argument of knowledge. A zk-SNARK allows for the

Continue reading…

ShapeShift with Erik Voorhees

http://traffic.libsyn.com/sedaily/2018_03_30_ShapeshiftErikVoorhees.mp3Podcast: Play in new window | Download “The Federal Reserve System is fraudulent. Whatever its stated purpose, its effective purpose is to create a mechanism of deficit spending by politicians, through the insidious invisible taxation of monetary debasement (aka inflation).” These are the words of Erik Voorhees, the CEO of crypto financial exchange ShapeShift. Long before he started ShapeShift, Erik was opposed to some of the core principles of the

Continue reading…

Enterprise Smart Contracts with Marley Gray

http://traffic.libsyn.com/sedaily/2018_03_29_EnterpriseBlockchains.mp3Podcast: Play in new window | Download We sign many different types of contracts throughout our lives. We sign a mortgage to get a loan for a house. When we go to the hospital, we sign a piece of paper that defines how our medical data can be shared between organizations. These pieces of paper represent our opting into an agreement that will be mediated and enforced by computer interactions.

Continue reading…

Plasma: Smart Contract Scalability with Christian Reitwiessner

http://traffic.libsyn.com/sedaily/2018_03_28_Plasma.mp3Podcast: Play in new window | Download Ethereum is a system for running decentralized smart contracts. In the current implementation of Ethereum, every smart contract gets deployed to every full node. Whenever a user wants to call a smart contract, that smart contract gets executed on each full node–across the entire network. The current model for smart contract execution needs to be made more scalable. In today’s episode, Christian Reitwiessner

Continue reading…

Cryptocurrency Networking with Soumya Basu

http://traffic.libsyn.com/sedaily/2018_03_27_Falcon.mp3Podcast: Play in new window | Download Soumya Basu is a PhD student at Cornell, where he studies distributed systems problems associated with cryptocurrencies. Soumya is advised by Emin Gun Sirer, a Cornell professor who previously appeared on the show to discuss smart contract security. Soumya joins the show today to talk about a variety of issues in the cryptocurrency space. We first explored the degree to which Bitcoin and

Continue reading…

Consensus Systems with Ethan Buchman

http://traffic.libsyn.com/sedaily/2018_03_26_Tendermint.mp3Podcast: Play in new window | Download Consensus protocols are used to allow computers to work together. A consensus protocol lets different servers agree on the state of a system. For decades, these protocols have been used to establish consensus among database nodes, application servers, and other infrastructure that runs within an enterprise. More recently, new consensus protocols have been invented to allow cryptoeconomic systems to agree on the state

Continue reading…

DAO Reflections and Slock.it with Christoph Jentzsch

http://traffic.libsyn.com/sedaily/2018_03_23_SlockitwithChristophJentzsh.mp3Podcast: Play in new window | Download The DAO was a system of smart contracts on the Ethereum blockchain that investors put millions of dollars into. Back in May 2016, it was the largest crowdfunding event in history, and we discussed it in detail in a previous episode with Matt Leising. The DAO was hacked due to a security vulnerability, and this event led to a hard fork of Ethereum.

Continue reading…

Streamr: Data Streaming Marketplace with Henri Pihkala

http://traffic.libsyn.com/sedaily/2018_03_22_Streamr.mp3Podcast: Play in new window | Download Data streams about the weather can be used to predict how soybean futures are going to change in price. Satellite data streams can take pictures of the number of cars on the road, and judge how traffic patterns are changing. Search engines can aggregate data from different queries and determine what people are most interested in. Data streams define how the world is

Continue reading…

Status.im: Ethereum Mobile Browser with Jarrad Hope and Oskar Thoren

http://traffic.libsyn.com/sedaily/2018_03_21_Statusim.mp3Podcast: Play in new window | Download To use a web application, you probably open a web browser or a mobile app. To access an Ethereum application, many people use an Ethereum browser. In previous episodes, we explored Metamask and Mist, which are Ethereum browsers for the desktop. In today’s episode, we explore Status, a mobile Ethereum browser. Status founders Jarrad Hope and Oskar Thoren join the show to talk

Continue reading…

The Business of Decentralization with Anthony Diiorio

http://traffic.libsyn.com/sedaily/2018_03_20_AnthonyJaxx.mp3Podcast: Play in new window | Download Anthony Diiorio was involved with Ethereum since the earliest days. He was one of the first people to see the Ethereum ideas presented by Vitalik Buterin, and he invested deeply in Ethereum–both financially and by helping to establish the early Ethereum community. Anthony started Decentral in 2014, which is a hub for his projects in the cryptocurrency space, the most impactful project being

Continue reading…

ShapeShift Operations with Jon ShapeShift

http://traffic.libsyn.com/sedaily/2018_03_19_ShapeshiftOperations.mp3Podcast: Play in new window | Download A financial exchange is an operationally intensive business. You have customers making a high volume of transactions, your service has to be low latency and highly available, and you are dealing with a lot of money. A cryptocurrency exchange has all of the complexity of a typical financial exchange–and then some additional complexity. ShapeShift is a cryptocurrency exchange that allows users to buy

Continue reading…

Crypto Pump and Dumps with Bruno Skvorc

http://traffic.libsyn.com/sedaily/2018_03_16_PumpandDumpswithBruno.mp3Podcast: Play in new window | Download Cryptocurrency speculation has pulled in a large population of people who do not know what they are investing in. If you hear about an investment of $1000 turning into $1M, it’s tempting to get sucked in yourself. For most of these everyday people, the game is completely rigged. A large percentage of market activity is driven by “pump and dumps.” A pump and

Continue reading…

Crypto Bloomberg with Valentin Mihov

http://traffic.libsyn.com/sedaily/2018_03_15_Santiment.mp3Podcast: Play in new window | Download In the finance industry, many people have a computer on their desk called a Bloomberg terminal. A Bloomberg terminal contains news, stock prices, communication tools, and other features that make it worth a high subscription price. And people in finance can afford to pay that high subscription because their decisions can cause a gain or loss of thousands of dollars. Cryptocurrency investors have

Continue reading…

Web3 with Fabian Vogelsteller

http://traffic.libsyn.com/sedaily/2018_03_14_Web3.mp3Podcast: Play in new window | Download Most applications today run on a cloud provider like AWS. They are built with a framework like Ruby on Rails. They use a set of APIs like Stripe and Twilio for middleware services. This is the era of “web 2.0.” With decentralized systems, we are starting to get a feel for what “web 3.0” might feel like. The futuristic idea of “web 3.0”

Continue reading…

Metamask with Dan Finlay

http://traffic.libsyn.com/sedaily/2018_03_13_Metamask.mp3Podcast: Play in new window | Download Decentralized applications can be built on the Ethereum blockchain. Just as the Bitcoin blockchain is a distributed, append-only ledger of financial transaction history, Ethereum is a distributed, append-only ledger of computational transaction history. New kinds of applications can be built on the Ethereum blockchain—and just like every new technology, we need an interface to bridge that new technology and our existing technology.  We

Continue reading…

Monopolies and Proof of Stake with Karl Floersh

http://traffic.libsyn.com/sedaily/2018_03_12_MonopoliesandProofofStake.mp3Podcast: Play in new window | Download Decentralized applications might someday offer alternatives to modern monopolies. Uber, Airbnb, Facebook, Amazon—all of these services could be recreated on a decentralized stack of technologies like Ethereum, IPFS, and Golem. Fully decentralized services could be more transparent, cheaper, and more efficient. But let’s be realistic. Today, even the simplest applications of fully decentralized blockchains don’t work as well as we need them to.

Continue reading…

Proof of Stake with Subhan Nadeem

http://traffic.libsyn.com/sedaily/2018_03_09_ProofofStake.mp3Podcast: Play in new window | Download For a decade, Bitcoin’s proof-of-work system has run without disruption. In a proof-of-work scheme, Bitcoin miners compete to solve a cryptographic puzzle associated with a block of transactions. Every ten minutes, all the Bitcoin miner nodes race to be the first to solve a block of transactions. Only one miner wins each block, meaning the other nodes’ time was ultimately wasted. There is

Continue reading…

How Aragon Manages DAOs with Luis Cuende

http://traffic.libsyn.com/sedaily/2018_03_08_Aragon.mp3Podcast: Play in new window | Download Humans organize into groups. There are lots of group types: religions, corporations, national governments, state governments, citizenries, clubs, musical bands. Every group has governance. Governance defines the rules, and the ways that rules change. The United States requires citizens to pay taxes. A corporation requires you to show up to work, but they have to pay you a salary. Most groups today are

Continue reading…

Smart Contracts with Raine Revere

http://traffic.libsyn.com/sedaily/2018_03_07_SmartContracts.mp3Podcast: Play in new window | Download Smart contracts are programs that run on the Ethereum blockchain. A smart contract developer pays Ether to deploy the contract. When a contract is deployed, every full node on the Ethereum blockchain has a copy of the contract code in that node’s address space. Every full node needs to hold a copy of every smart contract. This allows every full node to process

Continue reading…

Bitcoin’s Future with Joseph Bonneau

http://traffic.libsyn.com/sedaily/2018_03_06_BitcoinsFuture.mp3Podcast: Play in new window | Download Joseph Bonneau is co-author of Bitcoin and Cryptocurrency Technologies, a popular textbook. At NYU, he works as an assistant professor exploring cryptography and security. His YouTube lessons teaching Bitcoin have hundreds of thousands of views. His material offers clear explanations of how Bitcoin works. Since Joseph has a clear understanding of the objective facts around Bitcoin, he is the perfect person to ask

Continue reading…

Smart Agriculture with Mike Prorock

http://traffic.libsyn.com/sedaily/2018_03_05_SmartAgriculture.mp3Podcast: Play in new window | Download Farms have lots of data. A corn farmer needs to monitor the chemical composition of soil. A soybean farmer needs to track crop yield. A chicken farmer needs to count the number of eggs produced. If this data is captured, it can be acted upon—for example, a dry farm can automatically turn up its irrigation system. Or the data can simply be studied.

Continue reading…

Dogecoin with Jackson Palmer

http://traffic.libsyn.com/sedaily/2018_03_02_DogecoinJacksonPalmer.mp3Podcast: Play in new window | Download Dogecoin was started in 2013 as a joke. Jackson Palmer forked Bitcoin and created his cryptocurrency as a play off the “doge” meme. The currency became popular as a means of reddit users “tipping” each other. If I made a comment on reddit that you liked, you might send me some Dogecoin. This use case allowed people to share the idea of Dogecoin

Continue reading…

Blockchain Scalability with Peter Ullrich

http://traffic.libsyn.com/sedaily/2018_03_01_ScalingBlockchains.mp3Podcast: Play in new window | Download There are two factors that limit the rate at which transactions are accepted into the Bitcoin blockchain: block time and block size. Block time defines how often a new block is appended onto the blockchain. Block size defines how many transactions fit into a new block. As of March 2018, the current block time and block size allow for about 7 transactions per

Continue reading…

Bitcoin Transactions with Daniel Van Flymen

http://traffic.libsyn.com/sedaily/2018_02_26_BitcoinTransactions.mp3Podcast: Play in new window | Download Bitcoin is an immutable, append-only blockchain ledger that reaches consensus through proof-of-work. The contents of the ledger are financial transactions–people sending and receiving Bitcoin currency to each other. Since Bitcoin, there have been other cryptocurrencies that have similar properties–like Ethereum and the IPFS/Filecoin system. Similar to Bitcoin, they use a decentralized, proof of work based system with a currency reward system–but the ledger

Continue reading…

Scale Self-Driving with Alexandr Wang

http://traffic.libsyn.com/sedaily/2018_02_27_ScaleSelfDriving.mp3Podcast: Play in new window | Download The easiest way to train a computer to recognize a picture of cat is to show the computer a million labeled images of cats. The easiest way to train a computer to recognize a stop sign is to show the computer a million labeled stop signs. Supervised machine learning systems require labeled data. Today, most of that labeling needs to be done by

Continue reading…

Spark and Streaming with Matei Zaharia

http://traffic.libsyn.com/sedaily/2018_02_26_SparkDelta.mp3Podcast: Play in new window | Download Apache Spark is a system for processing large data sets in parallel. The core abstraction of Spark is the resilient distributed dataset (RDD), a working set of data that sits in memory for fast, iterative processing. Matei Zaharia created Spark with two goals: to provide a composable, high-level set of APIs for performing distributed processing; and to provide a unified engine for running

Continue reading…

Cloud and Edge with Steve Herrod

http://traffic.libsyn.com/sedaily/2018_02_23_VMWareCTO.mp3Podcast: Play in new window | Download Steve Herrod led engineering at VMWare as the company scaled from 30 engineers to 3,000 engineers. After 11 years, he left to become a managing director for General Catalyst, a venture capital firm. Since he has both operating experience and a wide view of the technology landscape as an investor, he is well-equipped to discuss a topic that we have been covering on

Continue reading…

Serverless Systems with Eduardo Laureano

http://traffic.libsyn.com/sedaily/2018_02_22_MicrosoftServerless.mp3Podcast: Play in new window | Download On Software Engineering Daily, we have been covering the “serverless” movement in detail. For people who don’t use serverless functions, it seems like a niche. Serverless functions are stateless, auto-scaling, event driven blobs of code. You might say “serverless sounds kind of cool, but why don’t I just use a server? It’s a paradigm I’m used to.” Serverless is exciting not because of

Continue reading…

Cloud Foundry Overview with Mike Dalessio

http://traffic.libsyn.com/sedaily/2018_02_21_MikeDaLessio.mp3Podcast: Play in new window | Download Earlier this year we did several shows about Cloud Foundry, followed by several shows about Kubernetes. Both of these projects allow you to build scalable, multi-node applications–but they serve different types of users. Cloud Foundry encompasses a larger scope of the application experience than Kubernetes. Kubernetes is lower level, and is actually being used within newer versions of Cloud Foundry to give Cloud

Continue reading…

Kafka Design Patterns with Gwen Shapira

http://traffic.libsyn.com/sedaily/2018_02_20_GwenShapiro.mp3Podcast: Play in new window | Download Kafka is at the center of modern streaming systems. Kafka serves as a database, a pubsub system, a buffer, and a data recovery tool. It’s an extremely flexible tool, and that flexibility has led to its use as a platform for a wide variety of data intensive applications. Today’s guest is Gwen Shapira, a product manager at Confluent. Confluent is a company that

Continue reading…

Streaming Architecture with Ted Dunning

http://traffic.libsyn.com/sedaily/2018_02_19_TedDunning.mp3Podcast: Play in new window | Download Streaming architecture defines how large volumes of data make their way through an organization. Data is created at a user’s smartphone, or on a sensor inside of a conveyor belt at a factory. That data is sent to a set of backend services that aggregate the data, organizing it and making it available to business analysts, application developers, and machine learning algorithms. The

Continue reading…

Streaming Analytics with Scott Kidder

http://traffic.libsyn.com/sedaily/2018_02_16_FlinkandVideo.mp3Podcast: Play in new window | Download When you go to a website where a video is playing, and your video lags, how does the website know that you are having a bad experience? Problems with video are often not complete failures–maybe part of the video loads, and plays just fine, and then the rest of the video is buffering. You have probably experienced sitting in front of a video,

Continue reading…

Streaming Architecture with Tugdual Grall

http://traffic.libsyn.com/sedaily/2018_02_15_TugdualGraal.mp3Podcast: Play in new window | Download At a big enough scale, every software product produces lots of data. Whether you are building an advertising technology company, a social network, or a system for IoT devices, you have thousands of events coming in at a fast pace that you want to aggregate, study and act upon. For the last decade, engineers have been learning to store and process these vast

Continue reading…

Machine Learning Deployments with Kinnary Jangla

http://traffic.libsyn.com/sedaily/2018_02_14_ProductionMLSystems.mp3Podcast: Play in new window | Download Pinterest is a visual feed of ideas, products, clothing, and recipes. Millions of users browse Pinterest to find images and text that are tailored to their interests. Like most companies, Pinterest started with a large monolithic application that served all requests. As Pinterest’s engineering resources expanded, some of the architecture was broken up into microservices and Dockerized, which make the system easier to

Continue reading…

Box Kubernetes Migration with Sam Ghods

http://traffic.libsyn.com/sedaily/2018_02_13_BoxKubernetes.mp3Podcast: Play in new window | Download Over 12 years of engineering, Box has developed a complex architecture of services. Whenever a user uploads a file to Box, that upload might cause 5 or 6 different services to react to the event. Each of these services is managed by a set of servers, and managing all of these different servers is a challenge. Sam Ghods is the cofounder and services

Continue reading…

Scaling Box with Jeff Quiesser

http://traffic.libsyn.com/sedaily/2018_02_12_BoxEngineering.mp3Podcast: Play in new window | Download When Box started in 2006, the small engineering team had a lot to learn. Box was one of the earliest cloud storage companies, with a product that allowed companies to securely upload files to remote storage. This was two years before Amazon Web Services introduced on-demand infrastructure, so the Box team managed their own servers, which they learned how to do as they

Continue reading…

Google BeyondCorp with Max Saltonstall

http://traffic.libsyn.com/sedaily/2018_02_09_GoogleBeyondCorp.mp3Podcast: Play in new window | Download Employees often find themselves needing to do work outside of the office. Depending on the sensitivity of your task, accessing internal systems from a remote location may or may not be OK. If you are using a corporate application that shows the menu of your company’s cafe on your smartphone, your workload is less sensitive. If you are accessing the proprietary codebase of

Continue reading…

Load Testing Mobile Applications with Paulo Costa and Rodrigo Coutinho

http://traffic.libsyn.com/sedaily/2018_02_08_OutSystems.mp3Podcast: Play in new window | Download Applications need to be ready to scale in response to high-load events. With mobile applications, this can be even more important. People rely on mobile applications such as banking, ride sharing, and GPS. During Black Friday, a popular ecommerce application could be bombarded by user requests–you might not be able to complete a request to buy an item at the Black Friday discount.

Continue reading…

Tether, Ripple, and Blockchain Reporting with Matt Leising

http://traffic.libsyn.com/sedaily/2018_02_07_MattLeising.mp3Podcast: Play in new window | Download Your friends from college are asking you how to buy Bitcoin. Your mom is emailing you articles about the benefits of decentralized peer-to-peer networks. Your shoe shiner is telling you to buy XRP. It is 2018, and cryptocurrencies have become a daily part of news headlines. The general public may not understand how this technology works, but everyone knows that changes are on

Continue reading…

Serverless at the Edge with Kenton Varda

http://traffic.libsyn.com/sedaily/2018_02_06_CloudFlareWorkers.mp3Podcast: Play in new window | Download Over the last decade, computation and storage has moved from on-premise hardware into the cloud data center. Instead of having large servers “on premise,” companies started to outsource their server workloads to cloud service providers. At the same time, there has been a proliferation of devices at the “edge.” The most common edge device is your smartphone, but there are many other smart

Continue reading…

Linkedin Resilience with Bhaskaran Devaraj and Xiao Li

http://traffic.libsyn.com/sedaily/2018_02_05_LinkedinResilience.mp3Podcast: Play in new window | Download How do you build resilient, failure tested systems? Redundancy, backups, and testing are all important. But there is also an increasing trend towards chaos engineering–the technique of inducing controlled failures in order to prove that a system is fault tolerant in the way that you expect. In last week’s episode with Kolton Andrus, we discussed one way to build chaos engineering as a

Continue reading…

Chaos Engineering with Kolton Andrus

http://traffic.libsyn.com/sedaily/2018_02_02_Gremlin.mp3Podcast: Play in new window | Download The number of ways that applications can fail are numerous. Disks fail all the time. Servers overheat. Network connections get flaky. You assume that you are prepared for such a scenario, because you have replicated your servers. You have the database backed up. Your core application is spread across multiple availability zones. But are you really sure that your system is resilient? The

Continue reading…

How to Change an Enterprise’s Software and Culture with Zhamak Dehghani

http://traffic.libsyn.com/sedaily/2018_02_01_MicroservicesZhamakDehgani.mp3Podcast: Play in new window | Download On this show, we spend a lot of time talking about CI/CD, data engineering, and microservices. These technologies have only been widely talked about for the last 5-10 years. That means that they are easy to adopt for startups that get founded in the last 5-10 years, but not necessarily for older enterprises. Within a large enterprise, it can be challenging to make

Continue reading…

Developer Stereotypes with Sue Loh

http://traffic.libsyn.com/sedaily/2018_01_31_SueLoh.mp3Podcast: Play in new window | Download Sue Loh is a software engineer and author of a book with the goal of breaking developer stereotypes. Stereotyping among developers leads to bad outcomes. When incorrect assumptions are made about certain populations, those populations feel marginalized and engineering resources get misallocated. From the perspective of Sue, the main problem is about how children are socialized. Young girls in particular are discouraged from

Continue reading…

Design Principles From Functional Programming with Runar Bjarnason

http://traffic.libsyn.com/sedaily/2018_01_30_DesignPrinciplesforFunctional.mp3Podcast: Play in new window | Download Functional programming can improve the overall design of an application architecture. Runar Bjarnason has been exploring how writing in a functional style increases modularity and compositionality of software for many years. He is co-author of Functional Programming in Scala, a book that explores the relationship between functional programming and software design. In this interview with guest host Adam Bell, Runar explains how writing

Continue reading…

Deep Learning Hardware with Xin Wang

http://traffic.libsyn.com/sedaily/2018_01_29_DeepLearningHardware.mp3Podcast: Play in new window | Download Training a deep learning model involves operations over tensors. A tensor is a multi-dimensional array of numbers. For several years, GPUs were used for these linear algebra calculations. That’s because graphics chips are built to efficiently process matrix operations. Tensor processing consists of linear algebra operations that are similar in some ways to graphics processing–but not identical. Deep learning workloads do not run

Continue reading…

Changelog Podcasting at KubeCon with Adam Stacoviak

http://traffic.libsyn.com/sedaily/2018_01_27_Changelog.mp3Podcast: Play in new window | Download At KubeCon, I had the chance to catch up with Adam Stacoviak of the Changelog, a podcast that was an inspiration for starting Software Engineering Daily. Changelog has long been one of my favorite podcasts about engineering, thanks in part to Adam’s personality. This was a spontaneous conversation, but it was a good one. Transcript Transcript provided by We Edit Podcasts. Software Engineering

Continue reading…

Edge Deep Learning with Aran Khanna

http://traffic.libsyn.com/sedaily/2018_01_26_EdgeDeepLearning.mp3Podcast: Play in new window | Download A modern farm has hundreds of sensors to monitor the soil health, and robotic machinery to reap the vegetables. A modern shipping yard has hundreds of computers working together to orchestrate and analyze the freight that is coming in from overseas. A modern factory has temperature gauges and smart security cameras to ensure workplace safety. All of these devices could be considered “edge”

Continue reading…

Serverless Containers with Sean McKenna

http://traffic.libsyn.com/sedaily/2018_01_25_SeanMcKenna.mp3Podcast: Play in new window | Download After two weeks of episodes about Kubernetes, our in-depth coverage of container orchestration is drawing to a close. We have a few more shows on the topic before we move on to covering other aspects of software. If you have feedback on this thematic format (whether you like it or not), send me an email: jeff@softwareengineeringdaily.com Today’s episode fits nicely into some of

Continue reading…

Web Security at Cloudflare, Pinterest, and Segment

http://traffic.libsyn.com/sedaily/2018_01_24_SEDWebSecurityMeetup.mp3Podcast: Play in new window | Download Last month, Software Engineering Daily had our 4th Meetup at Cloudflare in San Francisco. For this Meetup, the format was short interviews with security specialists from Pinterest, Cloudflare, and Segment. Each of these companies has unique security challenges, but they also have overlap in their security strategies. Nick Sullivan, Amine Kamel, and Evan Johnson are all seasoned engineers, and it was a privilege

Continue reading…

SpeechBoard with Craig Cannon and Ramon Recuero Moreno

http://traffic.libsyn.com/sedaily/2018_01_23_Speechboard.mp3Podcast: Play in new window | Download Creating a podcast is still too difficult. One of the main barriers to entry is the editing process. After recording a podcast, the podcast producer needs to line up soundwaves in a digital audio workstation and clip the raw audio files to remove sections that need to be removed. As someone who has edited a lot of podcasts, I know that this is

Continue reading…

Container Instances with Gabe Monroy

http://traffic.libsyn.com/sedaily/2018_01_22_ContainerInstances.mp3Podcast: Play in new window | Download In 2011, platform-as-a-service was in its early days. It was around that time that Gabe Monroy started a container platform called Deis, with the goal of making an open source platform-as-a-service that anyone could deploy to whatever infrastructure they wanted. Over the last six years, Gabe had a front row seat to the rise of containers, the variety of container orchestration systems, and

Continue reading…

Service Mesh Design with Oliver Gould

http://traffic.libsyn.com/sedaily/2018_01_19_ConduitProxy.mp3Podcast: Play in new window | Download Oliver Gould worked at Twitter from 2010 to 2014. Twitter’s popularity was taking off, and the engineering team was learning how to scale the product. During that time, Twitter adopted Apache Mesos, and began breaking up its monolithic architecture into different services. As more and more services were deployed, engineers at Twitter decided to standardize communications between those services with a tool called

Continue reading…

Kubernetes Storage with Bassam Tabbara

http://traffic.libsyn.com/sedaily/2018_01_18_RookKubernetesStorage.mp3Podcast: Play in new window | Download Modern applications store most of their data on hosted storage solutions. We use hosted block storage to back databases, hosted object storage for objects such as videos, and hosted file storage for file systems. Using a cloud provider for these storage systems can simplify scalability, durability, and availability–it can be less painful than taking care of storage yourself. One downside: the storage systems

Continue reading…

Kubernetes State Management with Niraj Tolia

http://traffic.libsyn.com/sedaily/2018_01_17_KubernetesDataNiraj.mp3Podcast: Play in new window | Download A common problem in a distributed system: how do you take a snapshot of the global state of that system? Snapshot is difficult because you need to tell every node in the system to simultaneously record its state. There are several reasons to take a snapshot. You might want to take a picture of the global state for the purposes of debugging. Or

Continue reading…

Kubernetes Operations with Brian Redbeard

http://traffic.libsyn.com/sedaily/2018_01_16_MulticloudKubernetes.mp3Podcast: Play in new window | DownloadIn the last four years, CoreOS has been at the center of enterprise adoption of containers. During that time, Brian Harrington (or “Redbeard”) has seen a lot of deployments. In this episode, Brian discusses the patterns he has seen among successful Kubernetes deployments–and the pitfalls of the less successful. How should you manage configuration? How can you avoid IP address overlap between containers? How

Continue reading…

FluentD with Eduardo Silva

http://traffic.libsyn.com/sedaily/2018_01_15_FluentD.mp3Podcast: Play in new window | Download A backend application can have hundreds of services written in different programming frameworks and languages. Across these different languages, log messages are produced in different formats. Some logging is produced in XML, some is produced in JSON, some is in other formats. These logs need to be unified into a common format, and centralized for any developer who wants to debug. The popularity

Continue reading…

The Gravity of Kubernetes

http://traffic.libsyn.com/sedaily/2018_01_13_GravityOfKubernetes.mp3Podcast: Play in new window | Download Kubernetes has become the standard way of deploying new distributed applications. Most new internet businesses started in the foreseeable future will leverage Kubernetes (whether they realize it or not). Many old applications are migrating to Kubernetes too. Before Kubernetes, there was no standardization around a specific distributed systems platform. Just like Linux became the standard server-side operating system for a single node, Kubernetes

Continue reading…

Kubernetes Vision with Brendan Burns

http://traffic.libsyn.com/sedaily/BrendanBurns.mp3Podcast: Play in new window | Download Kubernetes has become the standard system for deploying and managing clusters of containers. But the vision of the project goes beyond managing containers. The long-term goal is to democratize the ability to build distributed systems. Brendan Burns is a co-founder of the Kubernetes project. He recently announced an open source project called Metaparticle, a standard library for cloud-native development: Metaparticle builds on top

Continue reading…

High Volume Distributed Tracing with Ben Sigelman

http://traffic.libsyn.com/sedaily/DistributedTracing.mp3Podcast: Play in new window | Download You are requesting a car from a ridesharing service such as Lyft. Your request hits the Lyft servers and begins trying to get you a car. It takes your geolocation, and passes the geolocation to a service that finds cars that are nearby, and puts all those cars into a list. The list of nearby cars is sent to another service, which sorts

Continue reading…

Kubernetes on AWS with Arun Gupta

http://traffic.libsyn.com/sedaily/KubernetesonAWS.mp3Podcast: Play in new window | Download Since Kubernetes came out, engineers have been deploying clusters to Amazon. In the early years of Kubernetes, deploying to AWS meant that you had to manage the availability of the cluster yourself. You needed to configure etcd and your master nodes in a way that avoided having a single point of failure. Deploying Kubernetes on AWS became simpler with an open-source tool called

Continue reading…

Istio Motivations with Louis Ryan

http://traffic.libsyn.com/sedaily/IstioMotivations.mp3Podcast: Play in new window | Download A single user request hits Google’s servers. A user is looking for search results. In order to deliver those search results, that request will have to hit several different internal services on the way to getting a response. These different services work together to satisfy the user request. All of these services need to communicate efficiently, they need to scale, and they need

Continue reading…

Kubernetes Usability with Joe Beda

http://traffic.libsyn.com/sedaily/KubernetesUsability.mp3Podcast: Play in new window | Download Docker was released in 2013, and popularized the use of containers. A container is an abstraction for isolating a well-defined portion of an operating system. Developers quickly latched onto containers as a way to cut down on the cost of virtual machines–as well as isolate code and simplify deployments. Developers began deploying so many containers that they needed a centralized way to manage

Continue reading…