Hadoop Development - Comprehensive

( Duration: 5 Days )

Learn to create robust data processing applications using Apache Hadoop.

Participants will learn to build powerful data processing applications in this course. They will learn about MapReduce, the Hadoop Distributed Files System (HDFS), and how to write MapReduce code, and also learn best practices for Hadoop development, debugging, and implementation of workflows.

Hadoop Developer training course covers concepts addressed on the Cloudera Certified Developer for Apache Hadoop (CCDH) exam.

Throughout Hadoop Developer course, Participants will write Hadoop code and perform other hands-on exercises to solidify Participants understanding of the concepts.

By attending Hadoop Developer workshop, Participants will learn:

  • MapReduce and the HDFS
  • Write MapReduce code in Java or other programming languages
  • Issues to consider when developing MapReduce jobs
  • Implement common algorithms in Hadoop
  • Best practices for Hadoop development and debugging
  • Use other projects such as Apache Hive, Apache Pig, Sqoop, and Oozie
  • Advanced Hadoop API topics required for real-world data analysis

  • Some programming experience (preferably Java)
  • Knowledge of Hadoop is not required

Developers who need to write and maintain Apache Hadoop applications.



Hadoop Introduction

  • What is Big Data?
  • Source of Data
  • Characteristics of Big Data
  • Benefits of Big Data analysis
  • Challenges of Big Data processing
  • Why Hadoop for Big Data?
  • An introduction to Hadoop
  • What is Hadoop not good for?
  • Hadoop Ecosystem

Hadoop Installation

  • Pre-requisite
  • Hadoop Installation
  • Checking Installation

MapReduce Framework

  • What is MapReduce?
  • How does MapReduce work?
  • MapReduce Program
  • MapReduce program execution
  • MapReduce program Unit Testing
  • Deploying MapReduce on a cluster
  • Hadoop streaming
  • Combiner
  • Partitioner
  • Counters

HDFS - Hadoop Distributed File System

  • What is HDFS?
  • HDFS Architecture
  • Data Flow – anatomy of File Read and File Write
  • What is HDFS Block?
  • Types of Nodes in HDFS
  • What is HDFS Federation?
  • HDFS High Availability
  • HDFS Commands – also Parallel Copy
  • Hadoop Archives


  • What is Hive
  • Hive Architecture
  • Hive Language
  • What is Hive Metastore?
  • HiveQL
  • Hive Tables
  • How to Query Hive Tables?
  • User-Defined Functions


  • What is Pig
  • Pig Architecture
  • Execution Types
  • Pig Latin
  • User-Defined Functions
  • Data Processing Operators


  • HBase Introduction
  • HBase Architecture
  • HBase Data Model
  • HBase Schema Design
  • HBase and MapReduce
  • HBase Configuration
  • HBase Performance
  • HBase Troubleshooting & Debugging

Introduction to Sqoop

Encarta Labs Advantage

  • One Stop Corporate Training Solution Providers for over 3,500 Modules on a variety of subjects
  • All courses are delivered by Industry Veterans
  • Get jumpstarted from newbie to production ready in a matter of few days
  • Trained more than 20,000 corporate candidates across india and abroad
  • All our trainings are conducted in workshop mode with more focus on hands On

View our other course offerings by visiting www.encartalabs.com/course-catalogue

Contact us for delivering this course as a public/open-house workshop for a group of 10+ candidates at our venue