Podcast: Play in new window | Download
http://traffic.libsyn.com/sedaily/NetflixServerless.mp3Podcast: Play in new window | Download The Netflix API is accessed by developers who build for over 1000 device types: TVs, smartphontes, VR headsets, laptops. If it has a screen, it can probably run Netflix. On each of these different devices, the Netflix experience is different. Different screen sizes mean there is variable space to display the content. When you open up Netflix, you want to efficiently browse through
http://traffic.libsyn.com/sedaily/netflixcaching_edited.mp3Podcast: Play in new window | Download Caching is a fundamental concept of computer science. When data is accessed frequently, we put that data in a place where it can be accessed more quickly–we put the data in a cache. When data is accessed less often, we leave it in a place where the access time is slow or expensive. Netflix has a huge variety of data, and a huge
http://traffic.libsyn.com/sedaily/scheduling_at_netflix_edited.mp3Podcast: Play in new window | Download At Netflix, developers write applications with a variety of requirements–from simple requests for a list of movies to more resource-intensive requests like a complex machine learning workflow. Netflix wants developers to be able to request the resources they need from a compute cluster and receive those resources on-demand, without thinking too much about the state of that pool of resources they are drawing
http://traffic.libsyn.com/sedaily/Schedulers_Edited.mp3Podcast: Play in new window | Download Scheduling is the method by which work is assigned to resources to complete that work. At the operating system level, this can mean scheduling of threads and processes. At the data center level, this can mean scheduling Hadoop jobs or other workflows that require the orchestration of a network of computers. Adrian Cockcroft worked on scheduling at Sun Microsystems, eBay, and Netflix. In
“If you can make a system that can survive this random failure testing, then you will more or likely survive whatever other chaotic conditions exist.”
“We are at this moment where states and corporations are trying to restrict so much of what we can do on the internet because we have centralized the internet.”
Popcorn Time was a free, open-source application that allowed for streaming of movie and television show torrents.
“Sometimes there’s a misconception that Genie is a job scheduling platform… Genie really represents our extraction layer, from what our computational resources are, to our end user jobs.”
Genie is an open-source tool that provides job and resource management for the Hadoop ecosystem in the cloud.
http://traffic.libsyn.com/sedaily/devopscafe.mp3Podcast: Play in new window | Download “DevOps is not a thing. It is a set of problem statements and solution possibilities that are always growing.” The hosts of DevOps Cafe joined Software Engineering Daily for a conversation about DevOps culture and misconceptions. Questions What do software engineers need to know about DevOps? What are the biggest misconceptions around DevOps? Is DevOps ultimately about continuous integration, or containers, or any
http://traffic.libsyn.com/sedaily/presto_chris.mp3Podcast: Play in new window | DownloadPresto is a low latency SQL language built for interactive analysis. Christopher Berner works on Presto at Facebook. Questions: Is Presto for data scientists, developers, or everyone? What are the problems with Hive? How does Hive break a query into mapreduces? How do the clients, coordinators, and workers interact? Is Presto both fast and cheap? How does Presto tune Java to get speed
http://traffic.libsyn.com/sedaily/restify_yunong_2.mp3Podcast: Play in new window | Downloadrestify is a node.js module built to enable correct REST web services. Netflix uses restify to gain performance and visibility. Yunong Xiao, senior engineer at Netflix, talks about the incident which incited Netflix’s service migration to restify. The discussion starts with an explanation of flame graphs and evolves into a conversation about restify, and the importance of choosing the correct RESTful API. Links: Node.js In Flames Observable Node.js Applications (tech talk)