Hadoop

“HDFS is going to be a cockroach – I don’t think its ever going away.” Hadoop was created in 2003. In the early years, Hadoop provided large scale data processing with MapReduce,

“One big transformation we’re seeing right now is the slow agonizing death of MapReduce.” When a company gets big enough, there is so much data to be processed that an entire data

“I found Spark and I was really excited because I’m a functional programming nerd, and it was written in Scala.” Continue reading…

"It’s a great world to be a developer in. If you’re a developer today, you have so many tools and so many options." Continue reading…

“Systems are giving up correctness for latency, and I’m arguing that stream processing systems have to be designed to allow the user to pick the tradeoffs that the application