Online Training, IT Technology Business Certification Courses - Busygamers.com/Academy

BECOME AN APACHE SPARK DEVELOPER IN
12 WEEKS

$11K
Survey by O’Reilly, revealed that people with Apache Spark skills added $11,000 extra to the median salary
Skill
Since Spark provides an enhancement to existing Big Data solution by improving efficiency, its definitely a great skill to possess.
Jobs
Companies like Intel, IBM, ZoomData, Cloudera, Altiscale and others are supporting & investing in Spark.

  10+  REVIEWS
1000+  LEARNERS
"Once a new technology rolls over you, if you`re not part of the steamroller, you`re part of the road."  - Stewart Brand
19,999

OUR MENTOR-DRIVEN PROGRAM
Learn the fundamentals
Learn intermediate concepts
Learn advanced concepts

Getting Started

  • Know history and mission of BGAcademy
  • Get a walkthrough on the Course plan.
  • Get introduced to Spark eco-system and get a walkthrough of Spark Architecture

Start with Basics

  • Install Spark and create your first Spark program
  • Get an overview of various Spark APIs (Scala, Java, Python)
COURSE SYLLABUS
Big Data and Hadoop overview

  • Overview of Big Data
  • Characteristics of Big Data
  • Types of data
  • Sources of Big Data
  • Big Data examples
  • Scaling
  • Hadoop batch processing o
  • Hadoop ecosystem
  • What is streaming data?
  • Batch vs streaming data processing
  • Real time analytics options

Introduction to Spark

  • Map reduce limitations and motivation towards Spark
  • What is Spark?
  • Features
  • Spark unified platform
  • Spark in Hadoop ecosystem
  • Why in-memory processing?
  • Terasort wining
  • Most active project in Apache
  • Spark survery
  • Industries using Spark
  • Popular use cases across the industry wide
  • Spark components - Driver
  • Executor
  • Worker
  • Spark master
  • Significance of Spark context
  • Spark APIs overview

Spark Core Part1

  • Resilient distributed datasets
  • Properties of RDD
  • Creating RDDs
  • Transformations in RDD
  • Actions in RDD
  • Saving data through RDD
  • Key-value pair RDD

Spark Shell

  • Installing Spark locally (Live)
  • Invoking Spark shell
  • Loading a file in shell
  • Hands-on word count program
  • Performing some basic operations on files in Spark shell

Spark core part2

  • Spark application overview
  • Job scheduling process
  • DAG scheduler
  • RDD graph and lineage
  • Narrow and wide dependencies
  • Life cycle of spark application

In-Memory Management

  • RDD lineage
  • Caching overview
  • Caching and persistence
  • Data locality
  • How to choose between the different persistence levels for caching RDDs
  • Spark memory allocation
  • Broadcast variables
  • Accumulators

Using Spark’s APIs in Scala, Java, Python

  • Word count example in explanation and development in 3 APIs
  • Code walk-through on translating spark transformations to equivalent Java transformation
  • Spark packages

Build and Deployment (Real-time environment setup)

  • IDE integration
  • Building project with SBT
  • Building project with maven
  • Running the application in cluster

Application development – Demo

  • Submit in cluster mode
  • Web UI - application monitoring
  • Log files
  • Important spark configuration properties

Cluster components

  • Spark application execution on a cluster
  • Scheduling process
  • How a Spark application breaks down into jobs -> stages -> tasks
  • Cluster managers: Local mode
  • Standalone scheduler
  • YARN
  • Mesos
  • Serialization in Spark

Application development – Advanced

  • How to implement custom input format
  • Partition transformations
  • Storing data in database

Project I

  • Mentee can select project from predefined set of BGAcademy projects or they can come up with their own ideas for their projects

Project I cont...

  • Mentee can select project from predefined set of BGAcademy projects or they can come up with their own ideas for their projects

Advanced topics

  • Best practices/ common mistakes
  • Optimization techniques
  • General troubleshooting
  • Memory (RAM) management

Spark Streaming

  • Spark streaming overview and architecture
  • Example: Streaming word count demo
  • DStreams
  • Breakdown of DStreams to RDD batches
  • Spark streaming example program demo and code walk through

Spark Streaming – advanced

  • Walkthrough of various Spark streaming sources
  • Custom receivers
  • Sliding window operations on DStreams
  • Streaming UI overview
  • Checkpointing
  • Multiple receivers and the Union transformation

Spark SQL

  • Spark SQL overview
  • Spark SQL demo
  • Comparison of Apache Hive vs Spark SQL
  • SchemaRDD and data frames
  • Integration with Spark streaming
  • Spark SQL example program demo and code walk through

Spark streaming and SQL

  • Demo on tools learnt in the session

MLlib

  • Overview of Spark MLlib basics
  • Walkthrough of various algorithms and examples

Graphx

  • Overview of Spark GraphX

Project II

  • Mentee can select project from predefined set of BGAcademy projects or they can come up with their own ideas for their projects

Project II cont...

  • Mentee can select project from predefined set of BGAcademy projects or they can come up with their own ideas for their projects

Project II cont...

  • Mentee can select project from predefined set of BGAcademy projects or they can come up with their own ideas for their projects

project II cont...

  • Mentee can select project from predefined set of BGAcademy projects or they can come up with their own ideas for their projects

INTERESTED IN CORPORATE TRAINING?
12
WEEKS
COURSE DURATION
2
SESSIONS
EVERY WEEK
1.5
HOURS
EACH SESSION
200
HOURS
PROJECTS & ASSIGNMENTS
GREAT
CAREER

COURSE EXTRACT

Level
Intermediate
Pre-Requisites
Should have knowledge on Scala/Python/Java
Technologies/Tools
RDD, Spark-Streaming, GraphX, MLib, Spark-SQL
Projects
2 (Fully Functional)
Batch Size
8 - 10 Students
Job Preparation
Yes
Certification
Yes
24*7 support
Yes
course extract

WE HELP YOU GET A GREAT JOB


ADDITIONAL BONUS WEEK


On course completion, you are ready to enter the exciting world of corporates . We show you how to make the right impression at job interviews.


INTENSIVE JOB INTERVIEW PRACTICE

Congratulations, you're now a programmer with awesome skills. In this bonus week, we'll help you prepare for your job interviews so that you can make a great first impression. This includes:

Job Preparation
2 in-depth mock technical interviews


Job Preparation
Guidance on how to answer real interview questions from top employers


Job Preparation
Assistance with creating a resume that stands out


BUILDING AN ONLINE REPUTATION

We can help you build that online presence on sites such as Git, StackOverflow, Quora, and LinkedIn.

Oracle
IBM
Microsoft
CISCO
CUSTOMER FEEDBACK


PRICING

19,999



Refund


MONEY BACK GUARANTEE

If you are unhappy with the course and opt out in the first week, you get a complete refund.



Scholarship


SCHOLARSHIPS

We subsidize our fees by 10% for military personnel, and college students with exceptional records. To apply for a scholarship, email enquiry@acadgild.com.



Discount


GROUP DISCOUNT

More than 3 people in a group or from the same Company can avail special discount. For more information contact us at enquiry@acadgild.com

FAQ'S

What is Spark Development Course?

This course will help you in gaining expertise in Big Data Ecosystem and Spark essential skills like RDD, Spark Streaming, Spark SQL, Machine Learning, GraphX. This course will help the learners to understand In-Memory Data Processing.

Who should do this course?

Any graduate aiming to successfully build their career around Big Data can do this course. This course will be beneficial for:

  • Software Developers and Architects
  • Professionals with analytics and data management profile
  • Business Intelligence Professionals
  • Project Managers
  • Data Scientists
  • Professionals with Business Intelligence, ETL and data warehousing background
  • Professionals from testing and mainframes background

How is this training going to help me get a job in this domain?

This course will equip the learners with skills that would help them in handling Big Data projects in various companies. We provide real time case studies, projects and assignments to equip our trainees with required skills to excel in projects related to Spark. Extra assistance like mock interviews sessions, resume building, career guidance related to openings in various companies would help you to land your dream Job in Big data and Spark Industry.

What is the per-requisite for this course?

The candidates should have knowledge on Scala/Python/Java.

Is Hadoop mandatory to learn Spark?

Hadoop is a combination of Filesystem and processing engine while Spark is an execution engine which works on different file systems, most preferably the one is HDFS (Hadoop File System). So learning Hadoop will be an additional advantage for Spark but is not mandatory.

Chat History
Copyright © Busy Gamers LLP 2016. All Rights Reserved

BGAcademy is an online training academy which teaches web development, mobile application development and big data courses. BGAcademy provides mentor driven online courses in frontend web development, Android app development, big data development, hadoop development, big data administration and robotics. With BGAcademy, you can learn how to build great responsive websites using latest technologies like Angular and Node. You can also learn to develop Android applications from the comfort of your home. Want to learn how to build fully functional and complex websites ? Or want to learn Android application development courses? Looking to create beautiful mobile applications? Looking for mentor driven web development Android programming course at affordable price? Trying to find best online classes for frontend development and Android development? Looking for summer programming camp for children at affordable price? Looking for Android programming for children? Looking for an expert to teach you big data development or big data administration? Want your child to become a robotics engineer? Look no further. Our expert mentors can teach to beginners as well as expert programmers. Our web development, Android app programming courses, big data courses and robotics course are tailored to your need. If you do not have any prior programming knowledge or skills, we will teach you from the basics of programming. With our comprehensive web development and Android app development courses, we are sure BGAcademy is the best online coding bootcamp for Android programming courses.