Hadoop Administration – AcadGild https://acadgild.com/blog Learn. Do. Earn. Thu, 25 Aug 2016 12:01:42 +0000 en-US hourly 1 https://wordpress.org/?v=4.5.3 103159356 Ambari Installation Guide- Part II https://acadgild.com/blog/ambari-installation-guide-part-ii/ https://acadgild.com/blog/ambari-installation-guide-part-ii/#respond Thu, 04 Aug 2016 06:00:22 +0000 https://acadgild.com/blog/?p=12191 In this post, we will be discussing cluster setup in Ambari cluster using AWS EC2 instance. Before moving ahead in this post we recommend readers to go through our previous post on how Ambari works and steps to install it using a repository. Setting up Ambari Cluster and It’s Services: Before starting all the Ambari […]

The post Ambari Installation Guide- Part II appeared first on AcadGild.

]]> https://acadgild.com/blog/ambari-installation-guide-part-ii/feed/ 0 12191 Configuring Replication Factor and Block Size in HDFS https://acadgild.com/blog/configuring-replication-factor-block-size-hdfs/ https://acadgild.com/blog/configuring-replication-factor-block-size-hdfs/#respond Thu, 21 Jul 2016 11:43:27 +0000 https://acadgild.com/blog/?p=9676 In this post, we will be discussing how to configure replication factor, block size for the entire cluster, along with directory, and file in HDFS. Hadoop Distributed File System (HDFS) stores files such as blocks, and distributes them across the entire cluster. As HDFS was designed to be fault-tolerant and to run on commodity hardware, […]

The post Configuring Replication Factor and Block Size in HDFS appeared first on AcadGild.

]]> https://acadgild.com/blog/configuring-replication-factor-block-size-hdfs/feed/ 0 9676 Cassandra Installation on CentOS https://acadgild.com/blog/cassandra-installation-centos/ https://acadgild.com/blog/cassandra-installation-centos/#respond Sun, 26 Jun 2016 09:55:47 +0000 https://acadgild.com/blog/?p=8708 If you need scalability and high availability without compromising performance, then the Apache Cassandra Database is the right choice for you. Cassandra is a distributed database; initially developed by Facebook, it later on came under the Apache forum. In this post, we will be cover basic topics as an introduction of Cassandra and it’s Installation, […]

The post Cassandra Installation on CentOS appeared first on AcadGild.

]]> https://acadgild.com/blog/cassandra-installation-centos/feed/ 0 8708 Ambari Installation Guide – (part I) https://acadgild.com/blog/ambari-installation-guide-part/ https://acadgild.com/blog/ambari-installation-guide-part/#respond Thu, 16 Jun 2016 06:23:41 +0000 https://acadgild.com/blog/?p=6287 What is Ambari ? The Apache’s Ambari is a Hadoop management tool aimed at making Hadoop management simpler by developing software for provisioning, managing, and monitoring Apache Hadoop clusters. Ambari provides an intuitive, easy-to-use Hadoop management web UI backed by its restful APIs (Definition given by Apache Ambari) How it works? Ambari server will be […]

The post Ambari Installation Guide – (part I) appeared first on AcadGild.

]]> https://acadgild.com/blog/ambari-installation-guide-part/feed/ 0 6287 Fault Tolerance in Hadoop https://acadgild.com/blog/hadoop-fault-tolerant/ https://acadgild.com/blog/hadoop-fault-tolerant/#respond Sat, 04 Jun 2016 08:03:43 +0000 https://acadgild.com/blog/?p=5707 In our previous video blog we have learnt the difference between Vertical scaling and Horizontal scaling architecture and why Big data is suitable for storing and processing large datasets in horizontal scaling architecture. In this video blog we will be continuing discussing about the working of hadoop framework and how hadoop framework is fault tolerant. […]

The post Fault Tolerance in Hadoop appeared first on AcadGild.

]]> https://acadgild.com/blog/hadoop-fault-tolerant/feed/ 0 5707 Job Trends in Big Data https://acadgild.com/blog/job-trends-big-data/ https://acadgild.com/blog/job-trends-big-data/#respond Mon, 30 May 2016 13:24:53 +0000 https://acadgild.com/blog/?p=5687 Big Data has taken the IT world by storm. If you’re thinking about switching to Big Data domain or take the first step in your career with Big Data, then we believe that you have made the best decision in your career life. Here’s a guide to Big Data jobs, their prospects, salary compensations and […]

The post Job Trends in Big Data appeared first on AcadGild.

]]> https://acadgild.com/blog/job-trends-big-data/feed/ 0 5687 Customer Case Studies Where Hadoop Can Be Used As A Solution https://acadgild.com/blog/customer-case-studies-hadoop-can-used-sloution/ https://acadgild.com/blog/customer-case-studies-hadoop-can-used-sloution/#respond Mon, 30 May 2016 12:40:03 +0000 https://acadgild.com/blog/?p=5679 This video intends to be a part of a short discussion about the Few Customer case studies where hadoop can be used as a solution. We have the some case studies by which we can check the involvement of Hadoop in various sectors. Case Study 1: Children’s Hospital Los Angles Industry – Healthcare The hospital is completely […]

The post Customer Case Studies Where Hadoop Can Be Used As A Solution appeared first on AcadGild.

]]> https://acadgild.com/blog/customer-case-studies-hadoop-can-used-sloution/feed/ 0 5679 Challenges Faced with Hadoop https://acadgild.com/blog/challenges-faced-with-hadoop/ https://acadgild.com/blog/challenges-faced-with-hadoop/#respond Mon, 30 May 2016 12:20:12 +0000 https://acadgild.com/blog/?p=5668 This video intends to be a part of a short discussion about the problems faced with Big Data. There are some common challenges with Big Data like, Real-Time Analysis, Traditional Storage, Processing, Computation, etc. Hadoop is an open-source framework for processing Big Data. These days, there are many Hadoop distributions to choose from, and one of […]

The post Challenges Faced with Hadoop appeared first on AcadGild.

]]> https://acadgild.com/blog/challenges-faced-with-hadoop/feed/ 0 5668 Hadoop Admin Commands https://acadgild.com/blog/hadoop-admin-commands/ https://acadgild.com/blog/hadoop-admin-commands/#comments Mon, 30 May 2016 11:01:38 +0000 https://acadgild.com/blog/?p=5339 In this blog we will be discussing about some of the Administration commands and how they work? Hadoop fsck Commands 1. hadoop fsck / fsck command is used to check the HDFS file system. There are different arguments that can be passed with this command to emit different results. Please follow the below screenshot for […]

The post Hadoop Admin Commands appeared first on AcadGild.

]]> https://acadgild.com/blog/hadoop-admin-commands/feed/ 1 5339 Installing Cloudera (CDH 5 ) on Centos Linux. https://acadgild.com/blog/installing-cloudera-cdh-5-centos-linux/ https://acadgild.com/blog/installing-cloudera-cdh-5-centos-linux/#respond Mon, 30 May 2016 10:22:01 +0000 https://acadgild.com/blog/?p=5552 In this article we will be discussing about Installing Cloudera (CDH 5 ) in Centos Linux. Ways To Install CDH 5 :- We can install CDH 5 in following ways: Automated ways: Using Cloudera Manager, This is recommended method to install cloudera. Manual ways. Using Cloudera repository. Here we are going to install CDH 5 […]

The post Installing Cloudera (CDH 5 ) on Centos Linux. appeared first on AcadGild.

]]> https://acadgild.com/blog/installing-cloudera-cdh-5-centos-linux/feed/ 0 5552