Podcast: Play in new window | Download
http://traffic.libsyn.com/sedaily/BigQuery.mp3Podcast: Play in new window | Download Large-scale data analysis was pioneered by Google, with the MapReduce paper. Since then, Google’s approach to analytics has evolved rapidly, marked by papers such as Dataflow and Dremel. Dremel combined a column-oriented, distributed file system with a novel way of processing queries. A single Dremel query is distributed into a tree of servers, starting with the root server, splitting into the intermediate servers,
http://traffic.libsyn.com/sedaily/Dremio.mp3Podcast: Play in new window | Download The MapReduce paper was published by Google in 2004. MapReduce is an algorithm that describes how to do large-scale data processing on large clusters of commodity hardware. The MapReduce paper marked the beginning of the “big data” movement. The Hadoop project is an open source implementation of the MapReduce paper. Doug Cutting and Mike Cafarella wrote software that allowed anybody to use MapReduce,
http://traffic.libsyn.com/sedaily/IstioServiceMesh.mp3Podcast: Play in new window | Download Modern software applications are often built out of loosely coupled microservices. These services can be written in different languages, by different people, but communication between services needs to be standardized. For this reason, a service proxy is useful. A service proxy is a sidecar container that sits next to a service and facilitates communications with other services. Once every service has a sidecar
http://traffic.libsyn.com/sedaily/SearchEngineLand.mp3Podcast: Play in new window | Download Search engines run our lives. The path we take to information is dictated by Google, Facebook, Amazon, and other forms of search. Search engines feel objective and truthful, but are built through ongoing experimentation and subjective decision making. That’s what has kept Danny Sullivan writing about search engines for twenty years. The content Google prioritizes, the ads that we see, the way that
http://traffic.libsyn.com/sedaily/googleearlydays_edited.mp3Podcast: Play in new window | Download John Looney spent more than 10 years at Google. He started with infrastructure, and was part of the team that migrated Google File System to Colossus, the successor to GFS. Imagine migrating every piece of data on Google from one distributed file system to another. In this episode, John sheds light on the engineering culture that has made Google so successful. He has
http://traffic.libsyn.com/sedaily/Fission.mp3Podcast: Play in new window | Download Kubernetes is an orchestration system for managing containers. Since it was open sourced by Google, Kubernetes has created a wave of innovation in the infrastructure technology space. Another recent innovation has been the “serverless” execution tools–such as AWS Lambda and Google Cloud Functions. Serverless execution, otherwise known as functions-as-a-service, allows a developer to execute code against cloud servers without specifying which cloud servers
http://traffic.libsyn.com/sedaily/Firebase.mp3Podcast: Play in new window | Download Firebase is a backend-as-a-service. The key efficiency of a backend-as-a-service is that it enables developers to go from having a 3-tier architecture (client, server, database) to a 2-tier architecture (client, backend-as-a-service). The team who started Firebase built it as a pivot. They had started a social network, and then they realized there wasn’t a good backend for chat tools. And so they started
http://traffic.libsyn.com/sedaily/CloudClients_edited.mp3Podcast: Play in new window | Download Google builds cloud services for developers, such as PubSub, Cloud Storage, BigQuery, and Cloud DataStore. On Software Engineering Daily, we’ve done lots of shows about how these types of services are built. In this episode, we are zooming in on the interaction between the developer using a cloud service and the design and engineering of the client APIs. To build a useful cloud
http://traffic.libsyn.com/sedaily/Apache_Beam__Edited.mp3Podcast: Play in new window | Download Unbounded data streams create difficult challenges for our application architectures. The data never stops coming, and we are forced to assume that we will never know if or when we have seen all of our data. Some streaming systems give us the tools to deal partially with unbounded data streams, but we have to complement those streaming systems with batch processing, in a
http://traffic.libsyn.com/sedaily/TensorFlow_with_Rajat__Edited.mp3Podcast: Play in new window | Download TensorFlow is Google’s open source machine learning library. Rajat Monga is the engineering director for TensorFlow. In this episode, we cover how to use TensorFlow, including an example of how to build a machine learning model to identify whether a picture contains a cat or not. TensorFlow was built with the mission of simplifying the process of deploying a machine learning model from
http://traffic.libsyn.com/sedaily/android_on_iphone_fixed.mp3Podcast: Play in new window | Download Finally–the Android operating system has been put on an iPhone, and today’s guest is Nick Lee, who accomplished that feat. Nick works at Tendigi, a design and engineering firm. In the past, Nick has put Windows 95 on an Apple Watch. Why would you do something like this? In today’s interview with Nick, we talk about the technical challenges of bringing Nick’s
http://traffic.libsyn.com/sedaily/Kubernetes_Origins_Edited.mp3Podcast: Play in new window | Download The container management system Kubernetes was open sourced by Google with the intention of creating a cloud service based on the project. Today, the Kubernetes ecosystem is looking similar to the Android ecosystem, with different vendors providing different ways to use Kubernetes, from RedHat’s OpenShift to Google Container Engine. Craig Mcluckie was a member of the team who originally devised Kubernetes, and
http://traffic.libsyn.com/sedaily/Management.mp3Podcast: Play in new window | Download Engineering managers start out as engineers. Eventually, there is a fork in their career road where an engineer can choose to move up into management or continue on as an engineer in a more senior role. Changing to management involves an increase in responsibilities, a different set of goals to focus on. Jon Emerson was working at Google as an engineer when a
http://traffic.libsyn.com/sedaily/Polymer_Edited.mp3Podcast: Play in new window | Download Smart phone apps have better performance than web apps. When we have an application that we use on a regular basis, we download that application to a smart phone rather than using the browser based version on our mobile browser. Google’s Polymer Project wants to improve the gap between native app performance and mobile web app performance. The key problem with mobile web
“I definitely think we can try to abstract away the first principles of intelligence and then try to go from these principles to an intelligent machine that might look nothing like the brain.”
http://traffic.libsyn.com/sedaily/vint_edited.m4aPodcast: Play in new window | DownloadVint Cerf is Chief Internet Evangelist at Google. He contributes to global policy development and continued spread of the Internet. This episode is republished from The Quoracast. Questions: What will the world look like in 5 years? What are the biggest problems associated with rapid spread and development of the Internet? Does blockchain technology present any solutions to these problems Why are cats so
“You don’t mind if failures slow things down, but its very important that failures do not stop forward progress.”
“Changing anything changes everything.”
Technical debt, referring to the compounding cost of changes to software architecture, can be especially challenging in machine learning systems.
“A lot of data science teams – if you ask them what their ten most important questions are… a lot of people can’t even come up with those.”
Many companies find themselves drowning in data. The quantity of data matters far less than the right questions in the pursuit of actionable insights.
Modern automated attacks using widespread botnets have evolved in sophistication, making cybercrime an increasingly relevant threat in today’s internet. Security researchers and organizations have to stay vigilant in this cat-and-mouse game.
Shuman Ghosemajumder is the VP of Product at Shape Security, which defends applications from malware and bots. He is the former click fraud czar at Google, and he will be speaking at QCon San Francisco.