Call : (+91) 968636 4243
Mail : info@EncartaLabs.com
EncartaLabs

SAS and Hadoop

( Duration: 2 Days )

The SAS and Hadoop training course teaches delegates on how to use SAS programming methods to read, write, and manipulate Hadoop data. Base SAS methods that are covered include reading and writing raw data with the DATA step and managing the Hadoop file system and executing Map-Reduce and Pig code from SAS via the HADOOP procedure. In addition, the SAS/ACCESS Interface to Hadoop methods that allow LIBNAME access and SQL pass-through techniques to read and write Hadoop HIVE or Cloudera Impala tables structures is part of this course. Although not covered in any detail, a brief overview of additional SAS and Hadoop technologies, including DS2, high-performance analytics, SAS LASR Server, and in- memory Statistics, as well as the computing infrastructure and data access methods that support these, is also part of this course.

By attending SAS and Hadoop workshop, delegates will learn to:

  • Access Hadoop distributions using the LIBNAME statement and the SQL pass-through facility
  • Create and use SQL procedure pass-through queries
  • Use options and efficiency techniques for optimizing data access performance
  • Join data using the SQL procedure and the DATA step
  • Read and write Hadoop files with the FILENAME statement
  • Execute and use Hadoop commands with PROC HADOOP
  • Use Base SAS procedures with Hadoop
  • invoke execution of MapReduce programs and Pig programs in Hadoop within a SAS program
  • Write programs to create source data for SAS High Performance Analytics programs and execute SAS High Performance Analytics programs to analyze the data in parallel
  • Write SAS programs to start up a SAS LASR server grid, load data into memory in parallel and process that data in parallel with the IMSTAT procedure

Comfortable programming in SAS and Structured Query Language (SQL).

This SAS and Hadoop class is suitable for SAS programmers who need to access data in Hadoop from within SAS.

COURSE AGENDA

1

Introduction

  • What is Hadoop?
  • How SAS interfaces with Hadoop
2

Accessing HDFS and Invoking Hadoop Applications from SAS

  • Overview of methods available in Base SAS for interacting with Hadoop
  • Reading and writing Hadoop files using Base SAS
  • Methods
  • Executing MapReduce code
  • Executing Pig code using PROC HADOOP
3

Using the SQL Pass-Through Facility

  • Understand the SQL procedure pass-through facility
  • Connecting to a Hadoop Hive database
  • Learning methods to query Hive tables
  • Investigating Hadoop Hive metadata
  • Creating SQL procedure pass-through queries
  • Creating and loading Hive tables with SQL pass-through EXECUTE statements
  • Handling Hive STRING data types
4

Using the SAS/ACCESS LIBNAME Engine

  • Using the LIBNAME statement for Hadoop
  • Using data set options
  • Creating views
  • Combining tables
  • Benefits of the LIBNAME method
  • Using PROC HDMD to access delimited data, XML data, and other non-Hive formats
  • Performance considerations for the SAS/ACCESS LIBNAME statement
  • Copying data from a SAS library to a Hive library
5

Partitioning and Clustering Hive Tables

  • Identifying partitioning, clustering, and indexing methods in Hive
  • Understand how partitioning and clustering can increase query performance
  • Creating and loading partitioned and clustered Hive tables
6

Overview of SAS In-Memory Analytics and the Code Accelerator for Hadoop

  • Using high-performance procedures and the SASHDAT library engine
  • Creating a LASR Analytic server session
  • Using the SASIOLA engine
  • Executing DS2 threads in the Hadoop cluster to summarize data
  • Using PROC HDMD to access HDFS files

Encarta Labs Advantage

  • One Stop Corporate Training Solution Providers for over 6,000 various courses on a variety of subjects
  • All courses are delivered by Industry Veterans
  • Get jumpstarted from newbie to production ready in a matter of few days
  • Trained more than 50,000 Corporate executives across the Globe
  • All our trainings are conducted in workshop mode with more focus on hands-on sessions

View our other course offerings by visiting https://www.encartalabs.com/course-catalogue-all.php

Contact us for delivering this course as a public/open-house workshop/online training for a group of 10+ candidates.

Top
Notice
X