Python Data Visualization with Jake VanderPlas

http://traffic.libsyn.com/sedaily/python_dataviz_edited_fixed.mp3Podcast: Play in new window | Download Data visualization tools are required to translate the findings of data scientists into charts, graphs, and pictures. Understanding how to utilize these tools and display data is necessary for a data scientist to communicate with people in other domains. In this episode, Srini Kadamati hosts a discussion with Jake VanderPlas about the Python ecosystem for data science and the different attempts at creating

Continue reading…

Columnar Data: Apache Arrow and Parquet with Julien Le Dem and Jacques Nadeau

http://traffic.libsyn.com/sedaily/columnardata_edited_fixed.mp3Podcast: Play in new window | Download Column-oriented data storage allows us to access all of the entries in a database column quickly and efficiently. Columnar storage formats are mostly relevant today for performing large analytics jobs. For example, if you are a bank, and you want to get the sum of all of the financial transactions that took place on your system in the last week, you don’t want

Continue reading…

Architecture of Free Code Camp with Berkeley Martinez

http://traffic.libsyn.com/sedaily/freecodecamp_arch_fixed.mp3Podcast: Play in new window | Download Free Code Camp is an online learning platform that takes people from knowing nothing about code to having enough knowledge to build software for a living. We have already done a show with Quincy Larson, the founder of Free Code Camp, in which we discussed his motivation for starting the organization. The economics of running a free interactive platform with thousands of users

Continue reading…

Ethics of Software with Bill Sourour

http://traffic.libsyn.com/sedaily/ethicsofsoftware_edited.mp3Podcast: Play in new window | Download Software engineers are often one of the last lines of defense against potentially dangerous and unethical practices. Every software company encounters situations where the line between right and wrong is not clearly drawn. Back in the year 2000 Bill Sourour was asked to code a project to help market a pharmaceutical product in a misleading way. Reflecting on this experience, Bill recently wrote

Continue reading…

Email Infrastructure with Chris McFadden

http://traffic.libsyn.com/sedaily/email_infrastructure_edited.mp3Podcast: Play in new window | Download A company like Pinterest has millions of transactional emails to send to people. The scalability challenges of sending high volumes of email mean that it makes more sense for most companies to use an email as a service product rather than building their own. Chris McFadden is the VP of engineering and cloud operations at SparkPost and he joins the show to explain the

Continue reading…

Cyber Warfare with Jared Smith

http://traffic.libsyn.com/sedaily/websecurity_edited.mp3Podcast: Play in new window | Download Vulnerabilities exist in every computer system. As a system gets bigger, the number of vulnerabilities magnifies. The web is the biggest, most complex computer system we have–but fortunately, the steps we can take to secure our web applications are often quite simple. Jared Smith is a cyber security research scientist with Oak Ridge National Laboratory. He joined me on the show to discuss

Continue reading…

Meetup Architecture with Yvette Pasqua

http://traffic.libsyn.com/sedaily/meetup_architecture_edited.mp3Podcast: Play in new window | Download Meetup is an online service that allows people to gather into groups and meet in person. Since 2002, the company has been growing and its technology stack has been changing. Today, they are in the process of migrating to the cloud, using both Amazon Web Services and Google Compute Platform. Yvette Pasqua is the CTO of Meetup and she joins the show to

Continue reading…

Evolutionary Architecture with Neal Ford

http://traffic.libsyn.com/sedaily/architecture_edited.mp3Podcast: Play in new window | Download When a useful new technology comes out, companies that are in a position to adopt that new technology can gain an edge over competitors. As our industry grows and moves faster, these kinds of changes are coming faster–some recent examples are Docker, ReactJS, and Kubernetes. Evolutionary architecture supports incremental, guided change as a first principle along multiple dimensions. A company with an evolutionary

Continue reading…

Security Research with Samy Kamkar

http://traffic.libsyn.com/sedaily/security_edited.mp3Podcast: Play in new window | Download Every digital system has vulnerabilities. Cars can be hacked, locked computers can be exploited, and credit cards can be spoofed. Security researchers make a career out of finding these types of vulnerabilities. Samy Kamkar’s approach to security research is not just about dissection–it’s also about creativity. For many of the technologies he hacks on, Samy open-sources code that summarily describes the vulnerability he

Continue reading…

Self-Contained Systems with Eberhard Wolff

http://traffic.libsyn.com/sedaily/selfcontained_edited.mp3Podcast: Play in new window | Download Self-contained systems is an architectural approach that separates the functionality of a system into many independent systems. Each self-contained system is an autonomous web application, and is owned by one team. Communication with other self-contained systems or 3rd party systems is asynchronous where possible. As Eberhard Wolff explains in this episode, self-contained systems is not the same thing as microservices, but they are

Continue reading…

Breaking Into Startups

http://traffic.libsyn.com/sedaily/breakingintostartups_edited.mp3Podcast: Play in new window | Download Many people find themselves going down a career path that does not bring them satisfaction. A lawyer finds himself constantly working cases he doesn’t care about. A student in medical school gets completely burned out from hospital bureaucracy. An investment banker no longer finds joy in the accounting statements that she used to enthusiastically study. Startups offer a different career path. Within a

Continue reading…

Startup Engineering with Mike Wolfe

http://traffic.libsyn.com/sedaily/mikewolfe_edited.mp3Podcast: Play in new window | Download In the 1990s, the barriers to starting a company were significant. Not only did you need an idea, you needed $200,000 for servers and Oracle licenses. With cloud computing, the up-front financial costs of getting a company off the ground have been mostly eliminated–but the idea of starting a company is still perceived as risky. The process of building software has changed dramatically

Continue reading…

Robot Cloud Lab with Max Hodak

http://traffic.libsyn.com/sedaily/transcriptic_edited.mp3Podcast: Play in new window | Download A biologist wants to study the genetic makeup of an organism. A pharmaceutical researcher wants to test the effects of an experimental drug. These types of experiments require a deep knowledge of the scientific domain as well as the lab techniques to produce the data that will eventually yield a result. Transcriptic is a robotic biology laboratory that allows you to make requests

Continue reading…

Performance Monitoring with Andi Grabner

http://traffic.libsyn.com/sedaily/monitoring_edited.mp3Podcast: Play in new window | Download Application performance monitoring helps an engineer understand what is going on with an application. An application on a single machine is often monitored by inserting bytecode instructions into the application after it has been interpreted. Distributed cloud applications with functionality broken up across multiple servers often use distributed tracing. Andi Grabner from Dynatrace joins today’s show to explain how monitoring software is built,

Continue reading…

Antifraud Architecture with Josh Yudaken

http://traffic.libsyn.com/sedaily/antifraud_architecture_edited.mp3Podcast: Play in new window | Download Online marketplaces and social networks often have a trust and safety team. The trust and safety team helps protect the platform from scams, fraud, and malicious actors. To detect these bad actors at scale requires building a system that classifies every transaction on the platform as safe or potentially malicious. Since every social platform has to build something like this, Smyte decided to

Continue reading…

Sampling with Daniel Trostli

http://traffic.libsyn.com/sedaily/sampling_edited.mp3Podcast: Play in new window | Download Every song you hear on the radio is written with a computer. Computer musicians mostly use synthesizers and samples to compose these songs. A sample is a snippet of recorded sound, sometimes taken from a songs, a movie, or another source. The more samples a musician has access to the better. SampleFocus is a platform where musicians upload and download samples to build

Continue reading…

Data Engineering with Pete Soderling

http://traffic.libsyn.com/sedaily/hakkalabs_edited.mp3Podcast: Play in new window | Download In the last five years, companies started hiring data engineers. A data engineer creates the systems that manage and access the huge volumes of data that are accumulating on cheap cloud servers. As the saying goes, “it’s more expensive to throw out the data than to store it.” Pete Soderling joins the show to discuss the rise of the data engineer, and how

Continue reading…

Ad Fraud Research with Augustine Fou

http://traffic.libsyn.com/sedaily/adfraudresearch_edited.mp3Podcast: Play in new window | Download A huge percentage of online advertisements are never seen by humans. They are viewed by bots–automated scripts that are opening web pages in a browser and pretending to be a human. Advertising scammers set up web pages, embed advertisements on those pages, and then pay for bot traffic to come and view those advertisements. This aspect of the internet is bizarre and alarming.

Continue reading…

Reactive Microservices with Jonas Boner

http://traffic.libsyn.com/sedaily/reactivemicroservices_edited.mp3Podcast: Play in new window | Download For many years, software companies have been breaking up their applications into individual services for the purpose of isolation and maintainability. In the early 2000s, we called this pattern “service-oriented architecture”. Today we call it “microservices”. Why did we change that terminology? Did the services get smaller? Not exactly. Jonas Boner suggests that the movement towards cloud and the increased prevalence of mobile

Continue reading…

Scale API with Lucy Guo and Alexandr Wang

http://traffic.libsyn.com/sedaily/scaleapi_edited1.mp3Podcast: Play in new window | Download Some tasks are simple, but cannot be performed by a computer. Audio transcription, image recognition, survey completion–these are simple procedures that almost any human could execute, but the machine learning models have not gotten consistent enough to do them accurately. Scale is an API for human labor, created by Lucy Guo and Alexandr Wang. Similar to Amazon Mechanical Turk, Scale sends small, simple

Continue reading…

Bots with Jon Bruner

http://traffic.libsyn.com/sedaily/botpodcast_edited.mp3Podcast: Play in new window | Download Over the next few years, bots will pervade our lives more and more. These smart, conversational text interfaces provide a new way of engaging with the computer systems that we have been mostly interacting with through web and mobile app interfaces for the last decade. Bots are a necessary complement to the voice interfaces of the future, because we don’t always want to

Continue reading…

Mesos, Kubernetes, and Infrastructure of the Future with Dharmesh Kakadia

http://traffic.libsyn.com/sedaily/mesos-and-kubernetes_edited_1.mp3Podcast: Play in new window | Download Mesos and Kubernetes are tools for distributed systems management. Kubernetes is built with an emphasis on running services, whereas Mesos is commonly used for a wider variety of workloads, including data infrastructure like Spark and Kafka. Mesos can also be used as a platform to provide resource management for Kubernetes. Dharmesh Kakadia is the author of Apache Mesos Essentials, and has spent time

Continue reading…

Ad Fraud Everywhere with Shailin Dhar

http://traffic.libsyn.com/sedaily/adfraudeverywhere_edited_2.mp3Podcast: Play in new window | Download Advertising fraud is easy, legal, and extremely profitable. A fraudster can set up a website, scrape content from the internet, and run programmatic advertisements against that website. The fraudster can then purchase bot traffic. Those bots will visit the page, consume advertisements, and return profit to the owner of the page. In a past life, Shailin Dhar worked for a company that set

Continue reading…

Cloud Foundry with Cornelia Davis

http://traffic.libsyn.com/sedaily/cloudfountry_edited.mp3Podcast: Play in new window | Download Cloud Foundry is an open-source platform as a service. Companies use Cloud Foundry as a control plane to deploy and manage applications. It provides abstractions for microservices and continuous integration. Cornelia Davis joins the show to discuss Cloud Foundry. I interviewed her at the DevOps Enterprise Summit, where enterprises share their stories of improving their culture and their technology stack. Cornelia explained how

Continue reading…

Netflix Caching with Scott Mansfield

http://traffic.libsyn.com/sedaily/netflixcaching_edited.mp3Podcast: Play in new window | Download Caching is a fundamental concept of computer science. When data is accessed frequently, we put that data in a place where it can be accessed more quickly–we put the data in a cache. When data is accessed less often, we leave it in a place where the access time is slow or expensive. Netflix has a huge variety of data, and a huge

Continue reading…

How Software Engineering Daily Works

http://traffic.libsyn.com/sedaily/how_sed_works_edited.mp3Podcast: Play in new window | Download Software Engineering Daily was started a year and a half ago, based on what I learned from my podcasting experience on Software Engineering Radio. Last week, I interviewed Robert Blumen, the editor of Software Engineering Radio, about how that podcast is produced. In today’s episode, Robert interviews me about this podcast. If you are thinking about starting a podcast about software engineering, this

Continue reading…

Developer Tools with Josh Varty

http://traffic.libsyn.com/sedaily/developertools_edited.mp3Podcast: Play in new window | Download When you are working on a program, a lot of things are going through your head. In some sense, you become part machine when you are programming. Learnable Programming is a concept that facilitates this, by showing developers what the computer is doing in real time, before compiling. In this episode, Josh Varty, co-founder of Code Connect Inc., talks to Edaena Salinas about

Continue reading…

Bot Memorial with Eugenia Kuyda

http://traffic.libsyn.com/sedaily/botmemorial_edited.mp3Podcast: Play in new window | Download When a human passes away, we create a tombstone as a memorial. Friends and family visit a grave to remember the times they had with that person while they were still alive. Memorial bots are another way to celebrate the life of someone who has passed away. A memorial bot is created by taking the messages sent by a deceased person and passing

Continue reading…

Algorithms to Live By with Brian Christian

http://traffic.libsyn.com/sedaily/algorithms_edited.mp3Podcast: Play in new window | Download When you are deciding who to marry, you are using an algorithm. The same is true when you are looking for a parking space, playing a game of poker, or deciding whether or not to organize your closet. Algorithms To Live By is a book about the computer science of human decisions. It offers strategies for how to think through everyday life like

Continue reading…

Adforprize

http://traffic.libsyn.com/sedaily/adforprize_edited_fixed.mp3Podcast: Play in new window | DownloadThere are multiple paths to constructing a piece of software from start to finish. An individual programmer can build an entire product from scratch in a couple days. A giant corporation can commission a project and delegate responsibilities to hundreds of people. An open source community can use the wisdom of the crowds to efficiently build an operating system. Today’s episode is about another

Continue reading…

Robot Lawyer with Joshua Browder

http://traffic.libsyn.com/sedaily/robotlawyer_edited_1.mp3Podcast: Play in new window | Download You have probably received a parking ticket that you felt was unfair,   but instead of fighting it, you paid the expensive price to get rid of it quickly. Fighting a parking ticket sounds like it would be so time consuming that it is a better decision to just pay for it. When Joshua Browder was faced with this situation, his response was different.

Continue reading…

Database as a Service with Eliot Horowitz

http://traffic.libsyn.com/sedaily/mongoservice_editedfixed1.mp3Podcast: Play in new window | Download Eight years ago, MongoDB was an internal project at 10gen, a company that was trying to build a platform-as-a-service out of open-source components. The team at 10gen realized that the platform-as-a-service play would be too complex, and difficult to build. Since MongoDB was the most valuable component of that project, they narrowed their focus to this new document-oriented database. In today’s episode, MongoDB

Continue reading…

Software Podcasting with Robert Blumen

http://traffic.libsyn.com/sedaily/swpodcasting_edited_fixed.mp3Podcast: Play in new window | Download Four years ago, I started volunteering for a popular podcast about software–Software Engineering Radio. For the next two years, I learned about the process of making a quality podcast about engineering. With its emphasis on preparation, timeless engineering principles, and attention to the listener, Software Engineering Radio continues to be one of the most popular shows about engineering. Software Engineering Daily is my

Continue reading…

DotNet Core with Lee Coward and Immo Landwerth

http://traffic.libsyn.com/sedaily/dotnetcore_edited.mp3Podcast: Play in new window | Download C# .NET is the framework that is most often used to write software for the Microsoft Windows operating system. For many years, the C# .NET framework was closed source, but Microsoft’s recent push towards open source has led to the creation of .NET Core, a fork of C# .NET composed of a small subset of features from the original C# .NET stack. This

Continue reading…

Biological Computation with Colin Gravill

http://traffic.libsyn.com/sedaily/biocomputation_edited.mp3Podcast: Play in new window | Download Biology research at Microsoft is focused on three main areas: molecular programming, synthetic biology, and stem cell biology. At the intersection of biology and computing there are implications for health, medicine, and efficient computing techniques. The field of Biological Computation is in its early days, and there is still lots of work to be done. Colin Gravill works in the computational science group

Continue reading…

Rust Concurrency with Alex Crichton

http://traffic.libsyn.com/sedaily/rust_edited_fixed.mp3Podcast: Play in new window | Download Rust is a systems level language that is built to prevent crashes and eliminate data races. A language like C++ gives you high speed and lots of control, but it is easy to have segfaults, data races, and other problems if you aren’t careful. On this spectrum of control versus safety, we can plot other languages like Java, Go, and Haskell–but none of

Continue reading…

Microservices with Rafi Schloming

http://traffic.libsyn.com/sedaily/microservices_tools_edited.mp3Podcast: Play in new window | Download Microservices are a widely adopted pattern for breaking an application up into pieces that can be well-understood by the individual teams within the company. Microservices also allow these individual pieces to be scaled independently and updated in isolation. Past Software Engineering Daily episodes have covered the microservice architectures of Twitter, Netflix, Google, Uber and other companies. In today’s episode, I sit down with

Continue reading…

Apache Geode with Swapnil Bawaskar

http://traffic.libsyn.com/sedaily/geode_edited.mp3Podcast: Play in new window | Download There is a hierarchy of ways to access and store data in a computer system. The cheapest, slowest way to store and retrieve data is disk. On the faster end, we have memory. As we architect systems with increasing complexity, we have additional considerations–network latency, transient compute nodes, and numerous caching layers. Apache Geode is a distributed, in-memory system for the JVM. It

Continue reading…

Debugging Stories with Haseeb Qureshi

http://traffic.libsyn.com/sedaily/debuggingstories_edited.mp3Podcast: Play in new window | Download Everyone has debugging stories. We have all had the experience of wrestling with a seemingly impossible bug for days until we finally come to a solution. In today’s episode, Haseeb Qureshi retells some of his favorite debugging stories: The case of the 500-mile email, Debugging Behind the Iron Curtain, and My Hardest Bug Ever.

Software Small Businesses with Patrick McKenzie

http://traffic.libsyn.com/sedaily/kalzumeus_edited.mp3Podcast: Play in new window | Download Many programmers listening to this podcast are working at a big company, and they would prefer to be running their own software business. Patrick McKenzie has been writing about this topic for several years on his blog Kalzumeus.com. Almost a decade ago, he was working as an enterprise developer at a large company in Japan. Over time, his side projects started making enough

Continue reading…

Botnet Facebook Likes with Derek Muller

http://traffic.libsyn.com/sedaily/likefraud_edited.mp3Podcast: Play in new window | Download Botnets have a massive influence on the Internet. As we have seen recently with the Mirai Botnet, IOT bots can take down companies as big as Netflix. In our recent episodes about advertising fraud, we’ve talked about how bots are being used to take billions of dollars of revenue from advertisers. Derek Muller is one of those advertisers who has spent money on

Continue reading…

Slack Bots with Amir Shevat

http://traffic.libsyn.com/sedaily/slackbots_edited.mp3Podcast: Play in new window | Download Slack is a chat client that has reached wide adoption. The rise of Slack has coincided with the rise of chatbots. A chatbot is a simple, conversational interface into a computer program that may have simple functionality, like telling you some simple statistics, or more complex functionality, like helping you manage your continuous integration pipeline. Bot design and engineering is a new field,

Continue reading…

Winning With Data with Tomasz Tunguz

http://traffic.libsyn.com/sedaily/winningwithdata_edited_2.mp3Podcast: Play in new window | Download Large technology companies have no shortage of data. But raw data itself does not provide a competitive advantage. Many companies are bottlenecked by a shortage of data scientists who can query that data effectively. This results in an organizational dysfunction where people lining up to ask questions of the data science team are unable to move as fast as they want to. Tomasz

Continue reading…

AWS Open Guide with Joshua Levy

http://traffic.libsyn.com/sedaily/awsguide_edited_2.mp3Podcast: Play in new window | Download Amazon Web Services changed the economics of building an internet application. Instead of having to invest tens of thousands of dollars up front for hardware, developers can pay for services over time as their application scales. As AWS has grown to be a gigantic platform, the documentation about how to use cloud infrastructure has become insufficient. As an answer to this, Joshua Levy

Continue reading…

Bot Day

http://traffic.libsyn.com/sedaily/botday_edited.mp3Podcast: Play in new window | DownloadBot Day was an O’Reilly conference featuring talks from some of the leading figures in the bot industry. Before I attended Bot Day, I knew there were lots of applications for chatbots, but I didn’t realize how good the tooling has gotten–it’s very easy to get started with chatbots today so if you are a developer and you have a basic idea, I suggest

Continue reading…

Infrastructure Mistakes with Avi Freedman

http://traffic.libsyn.com/sedaily/infrastructuremistakes_edited.mp3Podcast: Play in new window | Download The blueprint for a typical startup involves investing heavily in cloud services–either from Amazon, Google, or Microsoft. The high costs can quickly eat away at all of the money that startup has raised. In today’s episode, Avi Freedman outlines some of the infrastructure mistakes that can set back a company severely–cloud jail, hipster tools, and lack of monitorability. Avi is the CEO of

Continue reading…

Fraud Prevention with Pete Hunt

http://traffic.libsyn.com/sedaily/antifraud_edited.mp3Podcast: Play in new window | Download When Facebook acquired Instagram, one of the first systems Instagram plugged into was Facebook’s internal spam and fraud prevention system. Pete Hunt was the first Facebook engineer to join the Instagram team. When he joined, the big problems at Instagram were around fake accounts, harassment, and large volumes of spammy comments. After seeing the internal Facebook spam prevention tools clean up Instagram, Pete

Continue reading…

Reflections of an Old Programmer with Ben Northrop

http://traffic.libsyn.com/sedaily/oldprogrammerreflections_edited.mp3Podcast: Play in new window | Download Ben Northrop was sitting at a tech conference, listening to a presentation about a new piece of technology, when he was struck by the sense that history was repeating itself. For the twenty years that Ben has worked as a software engineer, he has been hearing about new technologies that claim they will be able to disrupt everything, and he has relentlessly been

Continue reading…

Julia Language with Jeff Bezanson

http://traffic.libsyn.com/sedaily/julia-language_edited.mp3Podcast: Play in new window | Download Jeff Bezanson’s university thesis described the motivation for a new programming language. He discussed the shortcomings of “array based programming environments” and his desire to create a more performant language with the best qualities of Lisp, Python, Ruby, Perl, Mathematica, R, and C. The Julia Language is a high performance language designed to suit technical users that crave the flexibility to pick their

Continue reading…

Legacy Code with Andrea Goulet

http://traffic.libsyn.com/sedaily/legacycode_edited.mp3Podcast: Play in new window | Download Legacy code is code without automated tests. Most companies have lots of legacy code, and most developers don’t like working on legacy code. Why is that? What is it that makes legacy code so difficult to work with? And why does a large amount of legacy code slow down an organization so severely? Andrea Goulet is the CEO of Corgibytes, a consultancy that

Continue reading…

Indie Hackers with Courtland Allen

http://traffic.libsyn.com/sedaily/indiehackers_edited.mp3Podcast: Play in new window | Download Indie Hackers is a website that profiles independent developers who have made profitable software projects, usually without raising any money. These projects make anywhere from a few hundred dollars a month to more than $100,000 as in the case with park.io, one of the services profiled by Indie Hackers. Courtland Allen is the creator, engineer, and interviewer behind Indie Hackers. For each business

Continue reading…

Ad Tracking with Larry Furr

http://traffic.libsyn.com/sedaily/ghostery_edited.mp3Podcast: Play in new window | Download When you visit a web page, that web page can write data to a file on your computer, known as a cookie. Scripts on that page can also read from your cookie file to understand where you have been in the past. All of this data about you is getting shared between advertising companies like Google, Facebook, and AppNexus. Ghostery is a browser

Continue reading…

ChatOps with Jason Hand

http://traffic.libsyn.com/sedaily/chatops_edited.mp3Podcast: Play in new window | Download Chat bots are your newest co-worker. Slack, HipChat, and other chat clients allow developers and other team members to communicate more dynamically than the limits of email. Companies have started to add bots to their chat rooms. These bots can give you technical information, restart a server, or notify you that a build has finished. Jason Hand is the author of ChatOps: Managing

Continue reading…

Ad Industry with Bob Hoffman

http://traffic.libsyn.com/sedaily/bobhofman_edited.mp3Podcast: Play in new window | Download Online advertising is heavily affected by a set of delusions and fraudulent practices that few people in the adtech industry have an interest in stopping. This is the curious, perverse nature of the world of online media. Some of the online advertising we see fulfills its job, when an ad successfully conveys a meaningful message from a marketer to a consumer. But there

Continue reading…

Musicians’ GitHub with Alan Grow

http://traffic.libsyn.com/sedaily/githubformusicians_edited.mp3Podcast: Play in new window | Download Music collaboration software that works over the Internet is a software challenge that has not been fully tackled. On today’s Internet, users collaborate intensively on programming projects, journalism, and other projects, but the tools for collaborating on music online have not yet become popular. Blend.io is a social music collaboration tool–a github for musicians. I have been using it myself and enjoying it

Continue reading…

Ad Fraud with Ben Trenda

http://traffic.libsyn.com/sedaily/adfraud_edited.mp3Podcast: Play in new window | Download Advertising fraud takes billions of dollars out of the economy every year. We don’t know exactly how much money is being lost, because we don’t know what percentage of Internet users are bots. Are You A Human is a company designed to solve that exact problem, and provide a service for verifying whether a user is real or automated. Ben Trenda is the

Continue reading…

Coin Center with Peter Van Valkenburgh

http://traffic.libsyn.com/sedaily/coincenter_edited.mp3Podcast: Play in new window | Download Blockchain technologies like Bitcoin and Ethereum have not impacted the lives of most consumers today. The theoretical breakthroughs that blockchain enables will eventually happen–I will be able to pay 1 cent to a knowledge worker in Africa without having to pay a 5 cent transaction fee. My servers will be able to pay other servers for small compute jobs. We will have decentralized

Continue reading…

Managed Kafka with Tom Crayford

http://traffic.libsyn.com/sedaily/heroku_kafka_edited.mp3Podcast: Play in new window | Download Kafka is a distributed log for producers and consumers to publish messages to each other. We’ve done many shows about Kafka as a key building block for distributed systems, but we often leave out the discussion of the complexities of setting up Kafka and monitoring it. Kafka deployments can be a complex piece of software to manage. Tom Crayford is an engineer at

Continue reading…

Reactive JavaScript with Ben Lesh

http://traffic.libsyn.com/sedaily/RxJSnetflix_edited.mp3Podcast: Play in new window | Download Netflix has a highly interactive user interface. As I move my mouse around the page, hovering over titles and inspecting movie descriptions, there is a lot going on under the hood. One component of this UI is RxJS, a library for building reactive JavaScript. Reactive programming uses the observer pattern to create objects that emit streams of events. We can compose these streams

Continue reading…

Database Choices and Uber with Markus Winand

http://traffic.libsyn.com/sedaily/uber_database_edited.mp3Podcast: Play in new window | Download When Uber’s engineering team published a blog post about moving to MySQL from Postgres, Markus Winand started receiving lots of email. Markus writes about databases on his blog “Use The Index, Luke,” a guide to database performance for developers. The people emailing Markus wanted to know–if Postgres doesn’t work well for Uber, is it safe to use for anyone? Markus wrote a detailed

Continue reading…

Topic Roundtable with Haseeb Qureshi and Practical Dev’s Ben Halpern

http://traffic.libsyn.com/sedaily/topicroundtable_edited.mp3Podcast: Play in new window | Download Bot fraud, the New York tech scene, RethinkDB and open source; these topics and more are discussed in today’s episode. Two of the most popular guests return to the show to explore a variety of topics. Ben Halpern is the creator of The Practical Dev, a massively popular Twitter account and blog that you may recognize from its parody O’Reilly book covers. Haseeb

Continue reading…

Google Cloudbuilding with Joe Beda

http://traffic.libsyn.com/sedaily/cloudbuilding_edited.mp3Podcast: Play in new window | Download Google Compute Engine is the public cloud built by Google. It provides infrastructure- and platform-as-a-service capabilities that rival Amazon Web Services. Today’s guest Joe Beda was there from the beginning of GCE, and he was also one of the early engineers on the Kubernetes project. Google’s internal systems have made it easy for employees to spin up compute resources, but it was not

Continue reading…

Docker Cloudcasting with Brian Gracely

http://traffic.libsyn.com/sedaily/cloudcasting_edited.mp3Podcast: Play in new window | Download Cloud computing was something much different in 2011, when Brian Gracely and Aaron Delp started The Cloudcast, a podcast I listen to on a regular basis. The Cloudcast features technical discussions about cloud infrastructure technology, and one of the most recent shows was a monologue by Brian Gracely where he explained his perspective on the industry rumblings about a Docker fork. The utility

Continue reading…

Simpsons Data Science with Todd Schneider

http://traffic.libsyn.com/sedaily/simpsons_data_science_edited.mp3Podcast: Play in new window | Download The Simpsons is a classic, beloved television show. The scripts of The Simpsons have been made publicly available, and include dialogue, location, and character information. Todd Schneider used these scripts and other information sources as a corpus to analyze The Simpsons and find interesting statistics–such as who the most important supporting characters were, and how the ratings of the show have trended over

Continue reading…

PANCAKE STACK Data Engineering with Chris Fregly

http://traffic.libsyn.com/sedaily/pancakestack_edited_fixed.mp3Podcast: Play in new window | Download Data engineering is the software engineering that enables data scientists to work effectively. In today’s episode, we explore the different sides of data engineering–the data science algorithms that need to be processed and the implementation of software architectures that enable those algorithms to run smoothly. The PANCAKE STACK is a 12-letter acronym that Chris Fregly gave to a collection of data engineering technologies

Continue reading…

Kafka Event Sourcing with Neha Narkhede

http://traffic.libsyn.com/sedaily/event_sourcing_edited.mp3Podcast: Play in new window | Download When a user of a social network updates her profile, that profile update needs to propagate to several databases that want to know about such an update–search indexes, user databases, caches, and other services. When Neha Narkhede was at LinkedIn, she helped develop Kafka, which was deployed at LinkedIn to help solve this very problem. Using Kafka as an event queue, LinkedIn adopted

Continue reading…

DevOps Handbook with Gene Kim

http://traffic.libsyn.com/sedaily/devops_handbook_edited.mp3Podcast: Play in new window | Download The intent of the DevOps movement is to get organizations moving faster and more effectively by breaking down siloes, and improving communication. Gene Kim’s book The Phoenix Project illustrated this by telling the fictional story of a company adopting a DevOps mentality. Although that book was fiction, Gene is an experienced engineer, having worked as founder and CTO of Tripwire, a software company

Continue reading…

Netflix Scheduling with Sharma Podila

http://traffic.libsyn.com/sedaily/scheduling_at_netflix_edited.mp3Podcast: Play in new window | Download At Netflix, developers write applications with a variety of requirements–from simple requests for a list of movies to more resource-intensive requests like a complex machine learning workflow. Netflix wants developers to be able to request the resources they need from a compute cluster and receive those resources on-demand, without thinking too much about the state of that pool of resources they are drawing

Continue reading…

Monitoring Architecture with Theo Schlossnagle

http://traffic.libsyn.com/sedaily/monitoring_theo_edited_fixed.mp3Podcast: Play in new window | Download Building a monitoring system is a complex distributed systems problem. Events are produced from different points in an application and must be aggregated in order to form metrics. These events are often ingested by a time series database, which forms the backbone of our monitoring system. Theo Schlossnagle is the CEO of Circonus, where he has been working on architecting the company’s monitoring

Continue reading…

Continuous Delivery with David Rice

http://traffic.libsyn.com/sedaily/continuousdelivery_edited.mp3Podcast: Play in new window | Download In order to move software updates from the development team to production, companies do a variety of things. Some teams might email files to each other or use FTP or even floppy disks. Most companies today at least use version control systems like Git together with separate servers for development and production. When code is ready to move to production, a build that

Continue reading…

Kafka Streams with Jay Kreps

http://traffic.libsyn.com/sedaily/kafka_streams_edited.mp3Podcast: Play in new window | Download Kafka Streams is a library for building streaming applications that transform input Kafka topics into output Kafka topics. In a time when there are numerous streaming frameworks already out there, why do we need yet another? To quote today’s guest Jay Kreps “the gap we see Kafka Streams filling is less the analytics-focused domain these frameworks focus on and more building core applications

Continue reading…

ScalaJS with Haoyi Li

http://traffic.libsyn.com/sedaily/scalajs_edited.mp3Podcast: Play in new window | Download Scala is a functional programming language built on the JVM. For more than a decade, this didn’t mean anything to front end web developers. More recently, ScalaJS has brought Scala to the front end. ScalaJS is a project that compiles any Scala program down to JavaScript–so that all of your Scala programs can run on the browser. Haoyi Li has worked on ScalaJS

Continue reading…

Developer Roles with Dave Curry and Fred George

http://traffic.libsyn.com/sedaily/developer_roles_edited.mp3Podcast: Play in new window | Download Software teams are traditionally composed of roles such as project manager, developer, QA, and manager. What happens if you throw out all of those titles, hire mostly engineers, and ask them to do whatever they think is best? That is the core idea behind Fred George’s idea of Developer Anarchy. In today’s episode, David Curry guest hosts an interview with Fred George. They

Continue reading…

Platform as a Service with Sinclair Schuller

http://traffic.libsyn.com/sedaily/PaaS_with_Sinclair_edited.mp3Podcast: Play in new window | Download Platform as a service can mean different things to different people. The most prominent feature of a PaaS is the ability to abstract away issues that every developer within an organization has to deal with. As an example, developers today don’t need to fear scalability and load balancing issues as much as engineers of the 90’s and early 2000s. We can develop our

Continue reading…

Docker Fork with Alex Williams and Joab Jackson

http://traffic.libsyn.com/sedaily/docker_fork_edited.mp3Podcast: Play in new window | Download Docker containers changed how engineers think about building software, and the company most responsible for the widespread adoption of containers is Docker itself. Since containerization has caught on in the mainstream, companies like RedHat, Google, Huawei, and many other big players have built platform products that utilize Docker containers. Docker containers are the unit that many engineers use to deploy their applications, but

Continue reading…

Andela with Brice Nkengsa

http://traffic.libsyn.com/sedaily/Andela_Edited_2.mp3Podcast: Play in new window | Download Africa has a huge reservoir of untapped technical talent. Tech companies have a huge amount of work they need skilled employees for. Andela recruits the most talented technologists across Africa, shapes them into world-class software developers, and places them with tech companies worldwide such as Google and Microsoft. Brice Nkengsa is the director of engineering at Andela, and he joins the show to

Continue reading…

Remote Work with Scott Berkun

http://traffic.libsyn.com/sedaily/Remote_Work_Edited.mp3Podcast: Play in new window | Download After nine years at Microsoft, Scott Berkun left to become an author. One of his books on project management was read by Matt Mullenweg, the creator of the WordPress blogging tool that runs a large percentage of the internet (including Software Engineering Daily). Scott became friends with the WordPress founder, who is also the CEO of Automattic, a company that sells WordPress hosting

Continue reading…

Zuckerberg Files with Michael Zimmer and Nick Proferes

http://traffic.libsyn.com/sedaily/ZuckerbergFiles_edited.mp3Podcast: Play in new window | Download Mark Zuckerberg may be the most powerful person in the world. At no other time in history has a single human had such fine-grained control over the most influential tool for media. Today’s guests are Michael Zimmer and Nick Proferes, the creators of The Zuckerberg Files, an index of every recorded word that Mark Zuckerberg has said in text, video, or audio. Why

Continue reading…

Scikit-learn with Andreas Mueller

http://traffic.libsyn.com/sedaily/scikit_learn-edited.mp3Podcast: Play in new window | Download Scikit-learn is a set of machine learning tools in Python that provides easy-to-use interfaces for building predictive models. In a previous episode with Per Harald Borgen about Machine Learning For Sales, he illustrated how easy it is to get up and running and productive with scikit-learn, even if you are not a machine learning expert. Srini Kadamati hosts today’s show and interviews Andreas

Continue reading…

Container Security with Phil Estes

http://traffic.libsyn.com/sedaily/Container_Edited.mp3Podcast: Play in new window | Download Containers have become the unit of infrastructure that many technology stacks deploy to. With the shift to containers, the attack surface of an application has changed, and we need to reconsider our security models; the resource allocation of our containers, the interactions between different containers on a single machine, and the big picture–how the external web may interact with our containers. Phil Estes

Continue reading…

Slack Security with Ryan Huber

http://traffic.libsyn.com/sedaily/Slack_Security_edited.mp3Podcast: Play in new window | Download Security for the popular chat application Slack is a major focus for the company. A corporate Slack account is as valuable to a hacker as a corporate email account. In today’s episode, Ryan Huber and I talk through Slack’s approach to security–from philosophical discussions of how to company approaches security to the technical practices of logging and monitoring, and why Slack has a

Continue reading…

Tech Leadership with Jeff Norris

http://traffic.libsyn.com/sedaily/Techleadership_Edited.mp3Podcast: Play in new window | Download The role of “tech lead” is a combination of a software engineer, a project manager, and an architect. A tech lead might spend 30% of her time coding and 70% managing a project, resolving conflicts, and planning.   In today’s episode, we discuss the structure of software teams, and when it might make sense to have a tech lead on your team, in

Continue reading…

Devoxx4Kids with Arun Gupta

http://traffic.libsyn.com/sedaily/Devoxx4Kids_edited.mp3Podcast: Play in new window | Download Devoxx4Kids is an organization that is inspiring children through robotics, programming, and engineering. Kids who attend a Devoxx4Kids workshop are exposed to entertaining and educational activities, such as writing a Minecraft mod or programming an Arduino.   Arun Gupta is a software engineer and the president of the board for Devoxx4Kids USA. In this episode we discuss coding education for kids, and what

Continue reading…

Cloud Clients with Jon Skeet

http://traffic.libsyn.com/sedaily/CloudClients_edited.mp3Podcast: Play in new window | Download Google builds cloud services for developers, such as PubSub, Cloud Storage, BigQuery, and Cloud DataStore. On Software Engineering Daily, we’ve done lots of shows about how these types of services are built. In this episode, we are zooming in on the interaction between the developer using a cloud service and the design and engineering of the client APIs.   To build a useful

Continue reading…

Electronic Frontier Foundation with Nate Cardozo

http://traffic.libsyn.com/sedaily/EFF_Nate_Edited.mp3Podcast: Play in new window | Download When the US government hacks its own citizens, The Electronic Frontier Foundation is often the best source of reporting to find out what laws the government has broken. When a change to the privacy policy of Google or Facebook is made, the Electronic Frontier Foundation is the best place to find out how that change in privacy exploits users. The Electronic Frontier Foundation

Continue reading…

Cloud Dataflow with Eric Anderson

http://traffic.libsyn.com/sedaily/Google_Cloud_Edited.mp3Podcast: Play in new window | Download Batch and stream processing systems have been evolving for the past decade. From MapReduce to Apache Storm to Dataflow, the best practices for large volume data processing have become more sophisticated as the industry and open source communities have iterated on them.   Dataflow and Apache Beam are projects that present a unified batch and stream processing system. A previous episode with Frances

Continue reading…

Commodity Discussion with Preethi Kasireddy

http://traffic.libsyn.com/sedaily/Commodity_Discussion_Edited.mp3Podcast: Play in new window | Download A previous episode of Software Engineering Daily called “You Are Not A Commodity” received a lot of feedback, both negative and positive. The episode was a monologue I wrote about why engineers should build products on their own as a default career path, rather than work at a large corporation as a default career path.   A reddit thread about the episode was

Continue reading…

Unikernels with Idit Levine

http://traffic.libsyn.com/sedaily/Unikernels_Edited.mp3Podcast: Play in new window | Download Unikernels allow us to specify the minimum features of an operating system we need to deploy our applications. We’ve had many shows about containers, which allow you to deploy your application on top of a segregated portion of an operating system. Unikernels are different because they can be deployed directly to bare metal or to a hypervisor.   Idit Levine works on Unikernels

Continue reading…

Microsoft Antitrust with Harry First

http://traffic.libsyn.com/sedaily/MSFT_Legal_edited.mp3Podcast: Play in new window | Download Microsoft was the dominant technology company in the 1990’s, until it came under fire for anticompetitive practices. Internet Explorer was tightly coupled to the Windows operating system, which prevented Netscape Navigator–a competing browser–from reaching users on the dominant platform.   This episode is about antitrust–what businesses can and cannot do in the name of competition, what the impact of Microsoft’s legal battles in

Continue reading…

Slack’s Architecture with Keith Adams

http://traffic.libsyn.com/sedaily/Slack_Architecture.mp3Podcast: Play in new window | Download Slack is a chat application that is rapidly growing in popularity. The focus of Slack is to create a polished, responsive tool for productivity that cuts down on the emailing, context switching, and useless meetings that take place at a typical enterprise.   Keith Adams, the chief architect at Slack, joins the show to explain how those high level principles translate into engineering

Continue reading…

Uber’s Postgres Problems with Evan Klitzke

http://traffic.libsyn.com/sedaily/Uber_DBs.mp3Podcast: Play in new window | Download When a company switches the relational database it uses, you wouldn’t expect the news of the switch to go viral. Most engineers are not interested in the subtle differences between MySQL and Postgres, right?   Uber recently switched from having Postgres as its main relational database to using MySQL. Evan Klitzke wrote a detailed blog post about the migration, and post got very

Continue reading…

Relational Databases with Craig Kerstiens

http://traffic.libsyn.com/sedaily/RelationalDBs.mp3Podcast: Play in new window | Download Relational databases are used by most applications. MySQL, Postgres, Microsoft SQL Server, and other products implement the core features of a relational database in different ways. A developer who has never studied this space in detail may not know the differences between these databases, and in this episode we describe some tradeoffs that relational databases can make. Craig Kerstiens is an engineer at

Continue reading…

The Recurse Center with Nick Bergson-Shilcock

http://traffic.libsyn.com/sedaily/Recurse_edited_fixed.mp3Podcast: Play in new window | Download Learning to program is about self-driven exploration. Universities help guide you, coding boot camps provide a rigorous environment to work in, and online coding courses provide content for you to study. But none of this will turn you into a great programmer unless you have the drive to improve and the curiosity to explore.   The Recurse Center is a place where people

Continue reading…

Facebook Relationship Algorithms with Jon Kleinberg

http://traffic.libsyn.com/sedaily/Facebook_Relationships_Fixed_Edited.mp3Podcast: Play in new window | Download Facebook users provide lots of information about the structure of their relationship graph. Facebook uses that information to provide content and services that are expected to be important to users. If Facebook knows who the most important people in my life are, Facebook can use that knowledge to serve me content that is more relevant to me.   Jon Kleinberg studied Facebook network

Continue reading…

Drones with Buddy Michini

http://traffic.libsyn.com/sedaily/Drones_with_Airware_Edited.mp3Podcast: Play in new window | Download Drones will become a central part of our lives. Drones are delivering packages, surveying cell phone towers, providing wi-fi, or fertilizing crops. Drones are assisting humans in dangerous work, and serving as an entirely new computing platform, providing services that were previously nonexistent.   Airware is a company that is building a full-stack drone platform. In this episode, Buddy Michini takes us through

Continue reading…

Music Deep Learning with Feynman Liang

http://traffic.libsyn.com/sedaily/Bachbot_Edited.mp3Podcast: Play in new window | Download Machine learning can be used to generate music. In the case of Feynman Liang’s research project BachBot, the machine learning model is seeded with the music of famous composer Bach. The music that BachBot creates sounds remarkably similar to Bach, although it has been generated by an algorithm, not by a human.   BachBot is a research project on computational creativity. Feynman Liang

Continue reading…

Automated Content with Robbie Allen

http://traffic.libsyn.com/sedaily/wordsmith_edited.mp3Podcast: Play in new window | Download You have probably read a news article that was written by a machine. When earnings reports come out, or a series of sports events like the Olympics occurs, there are so many small stories that need to be written that a news organization like the Associated Press would have to use all of its resources to write enough content to cover it all.

Continue reading…

Haskell in Production with Carl Baatz

http://traffic.libsyn.com/sedaily/Haskell_in_Production_Edited.mp3Podcast: Play in new window | Download The Haskell programming language is often thought of as an academic tool, useful for teaching students about monads and functors, but not much else. But there are advantages to using Haskell as a production backend language.   Better is a company built with Haskell on the backend, and Carl Baatz wrote a blog post detailing his experiences using Haskell. He joins the show

Continue reading…

CoreOS with Brandon Philips

http://traffic.libsyn.com/sedaily/CoreOS_Edited_2.mp3Podcast: Play in new window | Download Google’s infrastructure has been the source inspiration for research papers, software projects, and entire companies. Google pioneered the idea that we care less about the individual machines we are running our applications on, and more about the applications themselves.   Containers are the abstraction we use to separate the concerns of the application from those of the underlying hardware. CoreOS is an operating system

Continue reading…

Artificial Intelligence with Oren Etzioni

http://traffic.libsyn.com/sedaily/AI_Research_Edited_2.mp3Podcast: Play in new window | Download Research in artificial intelligence takes place mostly at universities and large corporations, but both of these types of institutions have constraints that cause the research to proceed a certain way. In a university, basic research might be hindered by lack of funding. At a big corporation, the researcher might be encouraged to study a domain that is not squarely in the interest of

Continue reading…