Month: December 2015

In our previous blog Streaming Twitter Data Using Flume we knew about the basics for flume and how to use it for fetching data from twitter. Let’s look another way to use this flume for fetching data from local file system to HDFS. There are three sources for the above...

In this blog post, we have explained about the row-level transactions available in Hive. This post will provide you a good idea of how to implement the row-level transactions on the Hive table. Before beginning with the transactions in Hive, let’s look at the ACID properties, which are vital...

Apache Pig – Introduction Apache Pig is a high-level platform for creating MapReduce programs that will be used with Hadoop.It is a platform for analyzing large data sets, which consist of a high-level language for expressing data analysis programs.The beauty of Pig program’s structure is that they are open...

This blog focuses of the concepts involved in indexing in Hive. This post includes the following topics: When to use indexing. How indexing is helpful. How to create indexes for your tables. Perform some operations regarding the indexing in Hive. What is an Index? An Index acts as a...

This blog is about analyzing the data of youtube.This total analysis is performed   in Hadoop MapReduce. This youtube data is publicly available and the youtube data set is described below under the heading Data Set Description. Using that dataset we will perform some Analysis and will draw out some...

This post is about how HDFS handles data in batches and in real-time. This post will address all your queries on how HDFS stores data coming from different sources and in different forms, and also includes the basics of HDFS, starting from what Hadoop is, the different versions of...