EncartaLabs

StreamSets Data Collector

( Duration: 2 Days )

This StreamSets Data Collector training course provides a comprehensive introduction to StreamSets Data Collector. You will learn how to create complex pipelines that ingest data from a variety of sources, manipulate that data, and then export it to destinations including Apache Kafka, relational database management systems, and Apache Hadoop.

  • General knowledge of operating systems, networking, programming concepts, and databases.

The StreamSets Data Collector workshop is ideal for:

  • Those who will be designing, building, and running data flow pipelines, including data engineers, data developers, data analysts, data scientists, ETL developers, and data architects.

COURSE AGENDA

1

Overview of the StreamSets

  • DataOps Platform
  • DataOps Platform Overview
  • StreamSets DataOps Architecture and Use Cases
  • Custom Examples
2

An Introduction to StreamSets Data Collector

  • Getting Started with Data Collector
  • SDC Overview
  • Building Pipelines
  • Previewing Data
  • Running the Pipeline
3

Pipeline Development

  • Connectors
  • Processors & Evaluators
  • Executors
  • Expression Language
4

Pipeline Events, Rules, and Alerts

  • Generating and Handling Events
  • Metric Rules
  • Data Rules
5

Reading, Writing and Transforming Data

  • Flat Files
  • Relational Databases: MySQL, Oracle, and Change Data Capture
  • Messaging Broker Systems: Kafka
  • Event Based: APIs
  • Distributed Storage: HDFS
  • Lookups: Relational Databases
6

Administration and Monitoring

  • Monitoring your SDC instances
7

Troubleshooting and Tuning

  • Troubleshooting errors and broken pipelines
  • Tuning configurations to speed up pipelines
8

Handling Data Drift

  • Data Drift Rules with MySQL

Encarta Labs Advantage

  • One Stop Corporate Training Solution Providers for over 4,000 Modules on a variety of subjects
  • All courses are delivered by Industry Veterans
  • Get jumpstarted from newbie to production ready in a matter of few days
  • Trained more than 50,000 Corporate executives across the Globe
  • All our trainings are conducted in workshop mode with more focus on hands-on sessions

View our other course offerings by visiting http://encartalabs.com/course-catalogue-all.php

Contact us for delivering this course as a public/open-house workshop/online training for a group of 10+ candidates.

Top