Learn. Do. Earn.

Category: Big Data and Hadoop

Indexing in Hive

indexing_hive_cover_pic-1
This blog focuses of the concepts involved in indexing in Hive. This post includes the following topics: When to use indexing. How indexing is helpful. How to create indexes for your tables. Perform some operations regarding the indexing in Hive. What is an Index? An Index acts as a...
Read More
3 Comments

MapReduce Use Case-Youtube Data Analysis

Youtube
This blog is about analyzing the data of youtube.This total analysis is performed   in Hadoop MapReduce. This youtube data is publicly available and the youtube data set is described below under the heading Data Set Description. Using that dataset we will perform some Analysis and will draw out some...
Read More
10 Comments

Beginner’s Guide for Hdfs

hdfs beginenrs guide cover pic
This post is about how HDFS handles data in batches and in real-time. This post will address all your queries on how HDFS stores data coming from different sources and in different forms, and also includes the basics of HDFS, starting from what Hadoop is, the different versions of...
Read More
1 Comment

Streaming Twitter Data Using Flume

cover twitter flume
We all know that Hadoop is a framework which helps in parallel processing using huge datasets called Big Data. This is just a basic introduction/definition of Hadoop and you can find tons of stuff on Hadoop, over internet. So, instead of discussing more on Hadoop, we will focus on...
Read More
4 Comments

Hdfs Commands for Beginners

HDFS is a Java-based file system that provides scalable and reliable data storage in the Hadoop Ecosystem. So, you need to know basic HDFS commands to work in HDFS. Let’s first discuss why HDFS is used and the advantages of using it in Hadoop. HDFS – Features and Advantages...
Read More
Leave a Comment

Beginner’s Guide for Hbase

hnase
Before understanding what Hbase is, we need to understand why Hbase was introduced at first place. Prior to hbase we had Relation Database Management system (RDBMS) from late 1970’s , and it helped lot of companies to implement the solutions for their problems which are in use today. Even...
Read More
Leave a Comment

Beginner’s Guide for Pig

pig
Pig was initially developed by Yahoo! to allow individuals using Apache Hadoop to focus more on analyzing large datasets and spend less time in writing mapper and reducer programs.Pig enables users to write complex data analysis code without prior knowledge in Java. Pig’s simple SQL-like scripting language is called...
Read More
Leave a Comment

Beginner’s Guide for Hive

hive
Why was Hive introduced? Few years ago, Hadoop came into existence for solving queries on huge structured, Semi-structured, and unstructured datasets. Hadoop is considered to be the bestsolution to store and process those huge datasets, because of its advantages like scalability, less infrastructure costs(commodity hardware), data security(replication factor) and...
Read More
Leave a Comment

Data Serialization with Avro in Hive

avro+hive_feature_image
This blog focuses on providing in depth information of Avro in Hive. Here we have discussed about the importance and necessity of Avro and how to implement it in Hive. Through this blog you will get a clear idea about Avro and its implementation in your Hadoop projects. What...
Read More
2 Comments

Running Mapreduce in Local Mode

MR
In this blog we have explained in detail about how to run your mapreduce code locally in eclipse in any linux machine. After reading this blog you can easily run your mapreduce codes in eclipse without starting any of your hadoop daemons. Before getting started with the things let...
Read More
Leave a Comment
© Copyright 2016.  ACADGILD.