High Volume Logging with Steve Newman

http://traffic.libsyn.com/sedaily/Scalyr.mp3Podcast: Play in new window | Download Google Docs is used by millions of people to collaborate on documents together. With today’s technology, you could spend a weekend coding and build a basic version of a collaborative text editor. But in 2004 it was not so easy. In 2004 Steve Newman built a product called Writely, which allowed users to collaborate on documents together. Initially, Writely was hosted on a

Continue reading…

Scala at Duolingo with Andre Kenji Horie

http://traffic.libsyn.com/sedaily/ScalaatDuolingo.mp3Podcast: Play in new window | Download Duolingo is a language learning platform with over 200 million users. On a daily basis millions of users receive customized language lessons targeted specifically to them. These lessons are generated by a system called the session generator.   Andre Kenji Horie is senior engineer at Duolingo. He wrote about the process of rewriting the session generator, moving from Python to Scala and changing

Continue reading…

Engineering Values with Lynne Tye

http://traffic.libsyn.com/sedaily/KeyValues.mp3Podcast: Play in new window | Download The values system of a company guides the actions of the engineers who work at that company. Some companies value open communication and a flat organization where anybody can talk to anyone else. Other companies encourage hierarchy and secrecy, so that employees are focused on their specific section of the company. Some companies take themselves seriously, and have a work environment that is

Continue reading…

Cloud Marketplace with Zack Bloom

http://traffic.libsyn.com/sedaily/CloudflareApps.mp3Podcast: Play in new window | Download Ten years ago, if you wanted to build software, you probably needed to know how to write code. Today, the line between “technical” and “non-technical” people is blurring. Website designers can make a living building sites for people on WordPress or Squarespace–without knowing how to write code. Salesforce integration experts can help a sales team set up complicated software–without knowing how to write

Continue reading…

Scalable Multiplayer Games with Yan Cui

http://traffic.libsyn.com/sedaily/ScalableMultiplayerGames.mp3Podcast: Play in new window | DownloadRemember when the best game you could play on your phone was Snake? In 1998, Snake was preloaded on Nokia phones, and it was massively popular. That same year Half-Life won game of the year on PC. Metal Gear Solid came out for Playstation. The first version of Starcraft also came out in 1998. In 1998, few people would have anticipated that games with

Continue reading…

Decentralized Objects with Martin Kleppman

http://traffic.libsyn.com/sedaily/CRDTs_Decentralized_Files.mp3Podcast: Play in new window | DownloadThe Internet was designed as a decentralized system. Theoretically, if Alice wants to send an email to Bob, she can set up an email client on her computer and send that email to Bob’s email server on his computer. In reality, very few people run their own email servers. We all send our emails to centralized services like Gmail, and connect to those centralized

Continue reading…

Serverless Applications with Randall Hunt

http://traffic.libsyn.com/sedaily/AWSLambda.mp3Podcast: Play in new window | Download Developers can build networked applications today without having to deploy their code to a server. These “serverless” applications are constructed from managed services and functions-as-a-service. Managed services are cloud offerings like database-as-a-service, queueing-as-a-service, or search-as-a-service. These managed services are easy to use. They take care of operational burdens like scalability and outages. But managed services typically solve a narrow use case. You can’t

Continue reading…

Data Science Mindset with Zacharias Voulgaris

http://traffic.libsyn.com/sedaily/DataScienceMindset.mp3Podcast: Play in new window | Download A company’s approach to data can make or break the business. In the past, data was static. There was not much data, it sat in Excel, and it was interacted with on a nightly or monthly basis. Now, data is dynamic, real time and huge. To tap into available data, many industries have oriented themselves to becoming data intensive. With many new industry

Continue reading…

Secure Authentication with Praneet Sharma

http://traffic.libsyn.com/sedaily/Keyless.mp3Podcast: Play in new window | Download When I log into my bank account from my laptop, I first enter my banking password. Then the bank sends a text message to my phone with a unique code, and I enter that code into my computer to finish the login. This login process is two-factor authentication. I am proving my identity by entering my banking password (the first factor) and validating

Continue reading…

Serverless Scheduling with Rodric Rabbah

http://traffic.libsyn.com/sedaily/ServerlessSchedulingIBM.mp3Podcast: Play in new window | Download Functions as a service are deployable functions that run without an addressable server. Functions as a service scale without any work by the developer. When you deploy a function as a service to a cloud provider, the cloud provider will take care of running that function whenever it is called. You don’t have to worry about spinning up a new machine and monitoring

Continue reading…

Animating VueJS with Sarah Drasner

http://traffic.libsyn.com/sedaily/AnimatingVueJS.mp3Podcast: Play in new window | Download Most user interfaces that we interact with are not animated. We click on a button, and a form blinks into view. We click a link and the page abruptly changes. On the other hand, when we interact with an application that has animations, we can feel the difference. The animations are often subtle. If you aren’t sure what I’m talking about, pay attention

Continue reading…

React and GraphQL at New York Times

http://traffic.libsyn.com/sedaily/NYTGraphql.mp3Podcast: Play in new window | Download Are we a media company or a technology company? Facebook and the New York Times are both asking themselves this question. Facebook originally intended to focus only on building technology–to be a neutral arbiter of information. This has turned out to be impossible. The Facebook newsfeed is defined by algorithms that are only as neutral as the input data. Even if we could

Continue reading…

How IBM Runs Its Cloud with Jason McGee

http://traffic.libsyn.com/sedaily/BuildingaCloudIBM.mp3Podcast: Play in new window | Download Cloud computing changed the economics of running a software company. A cloud is a network of data centers that offers compute resources to developers. In the 1990s, software companies purchased servers–an upfront capital expense that required tens of thousands of dollars. In the early 2000s, cloud computing started, and turned that capital expense into an operational expense. Instead of a huge bulk purchase

Continue reading…

Thumbtack Infrastructure with Nate Kupp

http://traffic.libsyn.com/sedaily/ThumbtackInfrastructure.mp3Podcast: Play in new window | Download Thumbtack is a marketplace for real-world services. On Thumbtack, people get their house painted, their dog walked, and their furniture assembled. With 40,000 daily marketplace transactions, the company handles significant traffic. On yesterday’s episode, we explored how one aspect of Thumbtack’s marketplace recently changed, going from asynchronous matching to synchronous “instant” matching. In this episode, we zoom out to the larger architecture of

Continue reading…

Marketplace Matching with Xing Chen

http://traffic.libsyn.com/sedaily/ThumbtackMarketplaceEvolution.mp3Podcast: Play in new window | Download The labor market is moving online. Taxi drivers are joining Uber and Lyft. Digital freelancers are selling their services through Fiverr. Experienced software contractors are leaving contract agencies to join Gigster. Online labor marketplaces create market efficiency by improving the communications between buyers and sellers. Workers make their own hours, and their performance is judged by customers and algorithms, rather than the skewed

Continue reading…

Load Balancing at Scale with Vivek Panyam

http://traffic.libsyn.com/sedaily/LoadBalancingatScale.mp3Podcast: Play in new window | Download Facebook serves interactive content to billions of users. Google serves query requests on the world’s biggest search engine. Uber handles a significant percentage of the transportation within the United States. These services are handling radically different types of traffic, but many of the techniques they use to balance loads are similar. Vivek Panyam is an engineer with Uber, and he previously interned at

Continue reading…

Incident Response with Emil Stolarsky

http://traffic.libsyn.com/sedaily/IncidentResponse.mp3Podcast: Play in new window | Download As a system becomes more complex, the chance of failure increases. At a large enough scale, failures are inevitable. Incident response is the practice of preparing for and effectively recovering from these failures. An engineering team can use checklists and runbooks to minimize failures. They can put a plan in place for responding to failures. And they can use the process of post

Continue reading…

Run Less Software with Rich Archbold

http://traffic.libsyn.com/sedaily/IntercomEngineering.mp3Podcast: Play in new window | Download There is a quote from Jeff Bezos: “70% of the work of building a business today is undifferentiated heavy lifting. Only 30% is creative work. Things will be more exciting when those numbers are inverted.” That quote is from 2006, before Amazon Web Services had built most of their managed services. In 2006, you had no choice but to manage your own database,

Continue reading…

Training the Machines with Russell Smith

http://traffic.libsyn.com/sedaily/RainforestQA.mp3Podcast: Play in new window | Download Automation is changing the labor market. To automate a task, someone needs to put in the work to describe the task correctly to a computer. For some tasks, the reward for automating a task is tremendous–for example, putting together mobile phones. In China, companies like FOXCONN are investing time and money into programming the instructions for how to assemble your phone. Robots execute

Continue reading…

High Volume Event Processing with John-Daniel Trask

http://traffic.libsyn.com/sedaily/HighVolumeEventProcessing.mp3Podcast: Play in new window | Download A popular software application serves billions of user requests. These requests could be for many different things. These requests need to be routed to the correct destination, load balanced across different instances of a service, and queued for processing. Processing a request might require generating a detailed response to the user, or making a write to a database, or the creation of a

Continue reading…