Learn. Do. Earn.

Month: June 2016

Implementing Custom Output Format in Hadoop

Custom-output-format-in-Hadoop
In this post, we will be discussing how to implement Custom output format in Hadoop. Here we will implement XML output format, which converts all the output keys and values into XML format. Let’s implement a word count program in MapReduce and write a custom output format which stores...
Read More
Leave a Comment

Kafka Producer and Consumer

Producer and Consumer in Kafka
In our previous post, Guide to Installing Kafka, we had discussed what Kafka is and how to install it. In this post, we will be taking an in-depth look at Kafka Producer and Consumer in Java. Before proceeding further, let’s make sure we understand some of the important terminologies...
Read More
Leave a Comment

Cassandra Installation on CentOS

Cassandra Installation
If you need scalability and high availability without compromising performance, then the Apache Cassandra Database is the right choice for you. Cassandra is a distributed database; initially developed by Facebook, it later on came under the Apache forum. In this post, we will be cover basic topics as an...
Read More
Leave a Comment

HTML5 SVG

Introduction to HTML5 SVG
What is SVG? SVG stands for Scalable Vector Graphics and is used for describing 2D-graphics and graphical applications in XML. XML is then rendered by an SVG viewer. SVG is mainly useful for vector type diagrams like Pie charts, Two-dimensional graphs in an X-Y coordinate system etc. Why use...
Read More
Leave a Comment

HTML5 Drag and Drop

HTML5 Drag & Drop
Drag and Drop is part of HTML5 standard. HTML Drag and Drop will enable applications to use drag and drop features in all kinds of browsers. In simple, Drag and Drop is a very common feature which enables you to grab an object and drag it to any location...
Read More
Leave a Comment

Spark Use Case – Social Media Analysis

Spark-Use-Case
In this post, we will work on a case study to calculate the average number of friends based on their age, on a social media website. Let’s begin by considering a sample of four records. Column 1: User ID Column 2: User Name Column 3: Age of the User...
Read More
Leave a Comment

Introduction to Apache Maven

Introduction to Maven
In this blog we will be discussing about maven, how it works and why it is famous for. Let’s come from the History of Maven. History of Maven The word maven means “accumulator of knowledge” in Yiddish. Maven began its life in the Jakarta Alexandria project.Though Maven started in...
Read More
Leave a Comment

Parquet File Format Hadoop

Parquet File format in Hive
In this blog we will discuss about most widely used file format in Hadoop ecosystem Parquet Parquet, an open source file format for Hadoop. Parquet stores nested data structures in a flat columnar format .Compared to a traditional approach where data is stored in row oriented approach, parquet is...
Read More
Leave a Comment

Implementing Custom Input Format in Spark

Custom input format in spark
In this post, we will be discussing how to implement custom input format in Spark. In Spark, we will implement the custom input format by using Hadoop custom input format. You can refer to our previous post to get an idea of how custom input format has been implemented...
Read More
Leave a Comment
© Copyright 2016.  ACADGILD.