Call : (+91) 968636 4243
Mail : info@EncartaLabs.com
EncartaLabs

MS Azure Data Factory

( Duration: 5 Days )

Azure Data Factory (ADF) is a cloud-based service for data integration. ADF is used to integrate disparate data sources from across the organization including data in the cloud and data that is stored on-premises. It can process and transform the data by using compute services such as Azure HDInsight Hadoop, Spark, Azure Data Lake Analytics, and Azure Machine Learning.

In Azure Data Factory training course, you will learn to create data-driven pipelines to direct the movement of data.

  • Knowledge of Business Intelligence.
  • Sound knowledge of PowerShell and Microsoft Azure
  • Knowledge of Hive / Pig / JSON Scripting is desirable

COURSE AGENDA

1

Introduction to cloud computing and Azure Data Factory

  • Introduction to cloud computing
  • Why Cloud Computing?
  • Different Cloud Computing Models like SaaS, PaaS and Iaas
  • Understanding Hybrid Cloud
  • How is azure a leader in the cloud market?
  • Importance of of Data Warehouse, ETL and Analytics with cloud
  • What is Microsoft Azure Data Factory?
  • Overview of its workflow and different services in it
2

Implement non-relational data stores

  • Intro to non-relational data stores
  • Intro to Cosmos DB, Data Lake Storage and Blob Storage
  • Why Cosmos DB?
  • Working with Cosmos DB
  • Implement a solution that uses Cosmos DB
  • Why Data Lake?
  • Working with Data Lake
  • Implement a solution that uses Data Lake Storage Gen2
  • Why Blob Storage?
  • Working with Blob Storage
  • Implement a solution that uses Blob storage
  • Implement data distribution and partitions
  • Implement a consistency model in Cosmos DB
  • Provision a non-relational data store
  • Provide access to data to meet security requirements
  • Understanding High Availability, disaster recovery and global distribution
  • Implement for high availability, disaster recovery, and global distribution
3

Implement relational data stores

  • Intro to relational database and data stores
  • Understand elastic pools in a data store
  • Configuring elastic pools
  • Configuring geo-replication
  • Provide access to data for meeting the security requirements
  • Implement for high availability, disaster recovery, and global distribution in relational data stores
  • What is Azure Synapse Analytics and why is it important?
  • Implement data distribution and partitions for Azure Synapse Analytics
  • Understanding the relevance of PolyBase
  • Implement PolyBase
4

Manage data security

  • Understand the data masking
  • Implement data masking
  • Encrypt data at rest and in motion
5

Develop batch processing solutions

  • What is Azure Databricks?
  • What is Azure Data Factory?
  • Why Azure Databricks?
  • Why Azure Data Factory?
  • Develop batch processing solutions by using Data Factory and Azure Databricks
  • Understanding the concept behind data ingestion
  • What is PolyBase?
  • Understanding the workflow of PolyBase
  • Ingest data by using PolyBase
  • Implement the integration runtime for Data Factory
  • Implement Copy Activity within Azure Data Factory
  • Create linked services and datasets
  • Create pipelines and activities in Data Factory
  • Implement Mapping Data Flows in Azure Data Factory
  • Create and schedule triggers in Azure Data Factory
  • Implement Azure Databricks clusters, notebooks, jobs, and autoscaling
  • Ingest data into Azure Databricks
  • Creating the whole data lifecycle in Azure Data Factory
6

Develop streaming solutions

  • What is Azure Stream Analytics?
  • Why Azure Stream Analytics?
  • Configure input and output
  • Select the appropriate windowing functions
  • Implement event processing by using Stream Analytics
7

Monitor relational and non-relational data sources

  • Monitoring in Azure Data Factory
  • What is Azure Monitor?
  • Why use Azure Monitor?
  • Understanding Azure Log Analytics
  • Why Azure Log Analytics?
  • Implement monitoring in Blob Storage
  • Implement monitoring in Data Lake Storage
  • Implement monitoring in SQL Database
  • Implement monitoring in Azure Synapse Analytics
  • Implement monitoring in Cosmos DB
  • Configuring alerts in Azure Monitor
  • Implement auditing by using Azure Log Analytics
8

Monitor data processing

  • Monitoring Data Factory pipelines
  • Monitoring Azure Databricks
  • Monitoring Stream Analytics
  • Configuring alerts in Azure Monitor in the data processing
  • Implement auditing by using Azure Log Analytics in the data processing
9

Optimize Azure data solutions

  • Troubleshoot data partitioning bottlenecks
  • Optimize Data Lake Storage
  • Optimize Stream Analytics
  • Optimize Azure Synapse Analytics
  • Optimize SQL Database
  • Manage the data lifecycle

Encarta Labs Advantage

  • One Stop Corporate Training Solution Providers for over 6,000 various courses on a variety of subjects
  • All courses are delivered by Industry Veterans
  • Get jumpstarted from newbie to production ready in a matter of few days
  • Trained more than 50,000 Corporate executives across the Globe
  • All our trainings are conducted in workshop mode with more focus on hands-on sessions

View our other course offerings by visiting https://www.encartalabs.com/course-catalogue-all.php

Contact us for delivering this course as a public/open-house workshop/online training for a group of 10+ candidates.

Top
Notice
X