Category Cloud Engineering

Cloud Marketplace with Zack Bloom

http://traffic.libsyn.com/sedaily/CloudflareApps.mp3Podcast: Play in new window | Download Ten years ago, if you wanted to build software, you probably needed to know how to write code. Today, the line between “technical” and “non-technical” people is blurring. Website designers can make a living building sites for people on WordPress or Squarespace–without knowing how to write code. Salesforce integration experts can help a sales team set up complicated software–without knowing how to write

Continue reading…

Scalable Multiplayer Games with Yan Cui

http://traffic.libsyn.com/sedaily/ScalableMultiplayerGames.mp3Podcast: Play in new window | DownloadRemember when the best game you could play on your phone was Snake? In 1998, Snake was preloaded on Nokia phones, and it was massively popular. That same year Half-Life won game of the year on PC. Metal Gear Solid came out for Playstation. The first version of Starcraft also came out in 1998. In 1998, few people would have anticipated that games with

Continue reading…

Decentralized Objects with Martin Kleppman

http://traffic.libsyn.com/sedaily/CRDTs_Decentralized_Files.mp3Podcast: Play in new window | DownloadThe Internet was designed as a decentralized system. Theoretically, if Alice wants to send an email to Bob, she can set up an email client on her computer and send that email to Bob’s email server on his computer. In reality, very few people run their own email servers. We all send our emails to centralized services like Gmail, and connect to those centralized

Continue reading…

Serverless Applications with Randall Hunt

http://traffic.libsyn.com/sedaily/AWSLambda.mp3Podcast: Play in new window | Download Developers can build networked applications today without having to deploy their code to a server. These “serverless” applications are constructed from managed services and functions-as-a-service. Managed services are cloud offerings like database-as-a-service, queueing-as-a-service, or search-as-a-service. These managed services are easy to use. They take care of operational burdens like scalability and outages. But managed services typically solve a narrow use case. You can’t

Continue reading…

Serverless Scheduling with Rodric Rabbah

http://traffic.libsyn.com/sedaily/ServerlessSchedulingIBM.mp3Podcast: Play in new window | Download Functions as a service are deployable functions that run without an addressable server. Functions as a service scale without any work by the developer. When you deploy a function as a service to a cloud provider, the cloud provider will take care of running that function whenever it is called. You don’t have to worry about spinning up a new machine and monitoring

Continue reading…

React and GraphQL at New York Times

http://traffic.libsyn.com/sedaily/NYTGraphql.mp3Podcast: Play in new window | Download Are we a media company or a technology company? Facebook and the New York Times are both asking themselves this question. Facebook originally intended to focus only on building technology–to be a neutral arbiter of information. This has turned out to be impossible. The Facebook newsfeed is defined by algorithms that are only as neutral as the input data. Even if we could

Continue reading…

How IBM Runs Its Cloud with Jason McGee

http://traffic.libsyn.com/sedaily/BuildingaCloudIBM.mp3Podcast: Play in new window | Download Cloud computing changed the economics of running a software company. A cloud is a network of data centers that offers compute resources to developers. In the 1990s, software companies purchased servers–an upfront capital expense that required tens of thousands of dollars. In the early 2000s, cloud computing started, and turned that capital expense into an operational expense. Instead of a huge bulk purchase

Continue reading…

Thumbtack Infrastructure with Nate Kupp

http://traffic.libsyn.com/sedaily/ThumbtackInfrastructure.mp3Podcast: Play in new window | Download Thumbtack is a marketplace for real-world services. On Thumbtack, people get their house painted, their dog walked, and their furniture assembled. With 40,000 daily marketplace transactions, the company handles significant traffic. On yesterday’s episode, we explored how one aspect of Thumbtack’s marketplace recently changed, going from asynchronous matching to synchronous “instant” matching. In this episode, we zoom out to the larger architecture of

Continue reading…

Marketplace Matching with Xing Chen

http://traffic.libsyn.com/sedaily/ThumbtackMarketplaceEvolution.mp3Podcast: Play in new window | Download The labor market is moving online. Taxi drivers are joining Uber and Lyft. Digital freelancers are selling their services through Fiverr. Experienced software contractors are leaving contract agencies to join Gigster. Online labor marketplaces create market efficiency by improving the communications between buyers and sellers. Workers make their own hours, and their performance is judged by customers and algorithms, rather than the skewed

Continue reading…

Load Balancing at Scale with Vivek Panyam

http://traffic.libsyn.com/sedaily/LoadBalancingatScale.mp3Podcast: Play in new window | Download Facebook serves interactive content to billions of users. Google serves query requests on the world’s biggest search engine. Uber handles a significant percentage of the transportation within the United States. These services are handling radically different types of traffic, but many of the techniques they use to balance loads are similar. Vivek Panyam is an engineer with Uber, and he previously interned at

Continue reading…

Incident Response with Emil Stolarsky

http://traffic.libsyn.com/sedaily/IncidentResponse.mp3Podcast: Play in new window | Download As a system becomes more complex, the chance of failure increases. At a large enough scale, failures are inevitable. Incident response is the practice of preparing for and effectively recovering from these failures. An engineering team can use checklists and runbooks to minimize failures. They can put a plan in place for responding to failures. And they can use the process of post

Continue reading…

Run Less Software with Rich Archbold

http://traffic.libsyn.com/sedaily/IntercomEngineering.mp3Podcast: Play in new window | Download There is a quote from Jeff Bezos: “70% of the work of building a business today is undifferentiated heavy lifting. Only 30% is creative work. Things will be more exciting when those numbers are inverted.” That quote is from 2006, before Amazon Web Services had built most of their managed services. In 2006, you had no choice but to manage your own database,

Continue reading…

High Volume Event Processing with John-Daniel Trask

http://traffic.libsyn.com/sedaily/HighVolumeEventProcessing.mp3Podcast: Play in new window | Download A popular software application serves billions of user requests. These requests could be for many different things. These requests need to be routed to the correct destination, load balanced across different instances of a service, and queued for processing. Processing a request might require generating a detailed response to the user, or making a write to a database, or the creation of a

Continue reading…

Fiverr Engineering with Gil Sheinfeld

http://traffic.libsyn.com/sedaily/FiverrEngineering.mp3Podcast: Play in new window | Download As the gig economy grows, that growth necessitates innovations in the online infrastructure powering these new labor markets. In our previous episodes about Uber, we explored the systems that balance server load and gather geospacial data. In our coverage of Lyft, we studied Envoy, the service proxy that standardizes communications and load balancing among services. In shows about Airbnb, we talked about the

Continue reading…

Serverless Event-Driven Architecture with Danilo Poccia

http://traffic.libsyn.com/sedaily/ServerlessEvents.mp3Podcast: Play in new window | Download In an event driven application, each component of application logic emits events, which other parts of the application respond to. We have examined this pattern in previous shows that focus on pub/sub messaging, event sourcing, and CQRS. In today’s show, we examine the intersection of event driven architecture and serverless architecture. Serverless applications can be built by combining functions-as-a-service (like AWS Lambda) together

Continue reading…

Netflix Serverless-like Platform with Vasanth Asokan

http://traffic.libsyn.com/sedaily/NetflixServerless.mp3Podcast: Play in new window | Download The Netflix API is accessed by developers who build for over 1000 device types: TVs, smartphontes, VR headsets, laptops. If it has a screen, it can probably run Netflix. On each of these different devices, the Netflix experience is different. Different screen sizes mean there is variable space to display the content. When you open up Netflix, you want to efficiently browse through

Continue reading…

Serverless Authentication with Bobby Johnson

http://media.blubrry.com/audio_reviews/p/traffic.libsyn.com/sedaily/Webtask.mp3Podcast: Play in new window | Download Serverless architecture is software that runs without an addressable server. Serverless is made possible by two types of technology: platform as a service providers like Auth0, and functions as a service like AWS Lambda. With both of these technologies, we can program logic that runs without being deployed to a server. Functions as a service are cheap and scalable. Write your code for

Continue reading…

Augmented Reality with Scott Montgomerie

http://traffic.libsyn.com/sedaily/ScopeAR.mp3Podcast: Play in new window | Download Augmented reality applications are slowly making their way into the world of the consumer. Pokemon Go created the magical experience of seeing Pokemon superimposed upon the real world. IKEA’s mobile app lets you see how a couch would fit into your living room, which has a significant improvement on the furniture buying process. Augmented reality applications can have even more dramatic impact on

Continue reading…

Elastic Load Balancing with Ranga Rajagopalan

http://traffic.libsyn.com/sedaily/Avi_Networks_complete_with_preamble.mp3Podcast: Play in new window | Download Computational load is the amount of demand that is being placed on a computer system. “Load” can take the form of memory, CPU, network bandwidth, disk space, and other finite resources. When we design systems, we need to prepare for high-load events. On a social network, people are much more active in the mornings. On an e-commerce site, Black Friday causes many more

Continue reading…

IFTTT Architecture with Nicky Leach

http://traffic.libsyn.com/sedaily/IFTTT.mp3Podcast: Play in new window | Download It’s 9pm at night, and you are hungry. You order a pizza from Domino’s. You live on a street that’s dark, and so you have installed a smart lightbulb in front of your mailbox that lights up the address. When the pizza at Domino’s is ready, you want the lightbulb on your mailbox to light up so that the delivery person can read

Continue reading…