know the history of Hadoop

In this video blog we will be discussing about the era before Hadoop and the factors which led to the creation of Hadoop Framework.

Doug Cutting and Mike Cafarella, the founders of Hadoop, were inspired by Google’s GFS and MapReduce architecture.

Google introduced GFS (Google File System) system for storing huge size of data sets in a distributed manner in a cluster of commodity hardwares and MapReduce the technology for processing the data sets present in these distributed systems.

In 2004, Google published its GFS and MapReduce white papers. Doug Cutting and Mike Cafarella, who were then working in Nutch, got inspired by Google’s technology and started to build their own search engine called Nutch, on top of the Google’s file system and MapReduce technology.

Hadoop was originally developed to support distribution for the Nutch search engine project. And in 2006, Yahoo! hired Doug Cutting and introduced Hadoop framework to the world named the project after his son’s toy elephant. Cutting’s son was 2 years old at the time and just beginning to talk.

Now, with the help of Hadoop framework, many organizations have started analyzing huge data sets which remained unresolved for many decades. For more details on Big Data and Hadoop, please refer to the below post.

Understanding Big Data

Thus, we hope this blog has helped you understand on how Doug Cutting and Mike Cafarella inspired from Google’s GFS and MapReduce architecture and introduced Hadoop.

Keep visiting our website for more post on Big Data and other technologies.