Data Engineering

Sort by:

Hadoop: Past, Present and Future with Mike Cafarella

“HDFS is going to be a cockroach – I don’t think its ever going away.” Hadoop was created in 2003. In the early years, Hadoop provided large scale data processing with MapReduce,
hadoop

Data Engineering at Airbnb with Maxime Beauchemin

“One big transformation we’re seeing right now is the slow agonizing death of MapReduce.” When a company gets big enough, there is so much data to be processed that an entire data

Benchmarking Stream Processing Frameworks with Bobby Evans

“Benchmarks are all crap, but there are some benchmarks that are better than others.” Continue reading…
stream processing frameworks

Deep Learning and Keras with François Chollet

“I definitely think we can try to abstract away the first principles of intelligence and then try to go from these principles to an intelligent machine that might look nothing like the
keras

Mesosphere and Tech Journalism with Derrick Harris

“The business of technology and the technology of technology are kind of converging if you ask me. And there is definitely a space for some publications that don’t have decades of
mesosphere