EncartaLabs

Apache Kafka

( Duration: 3 Days )

COURSE AGENDA

1

Big data landscape and architectures

  • Lambda Architecture
  • Kappa Architecture
  • Zeta Architecture
  • Seda Architecture
  • NoSQL Store and high throughput messaging system
2

Requirements of Kafka

  • Real time analytics
  • Data ingestion
  • Case studies
3

Kafka architecture

  • Core concepts
  • Kafka Design
  • Log Compaction
  • Message compaction
  • Replication
  • Message flow
  • High Availability and Consistency
  • Resource Management
  • Topics
  • Partitions
  • Replicas
  • Producers
  • Consumers
  • Brokers
  • Segment
  • Offset
  • Leader
  • Follower
4

Kafka Internals

  • Last Commit Offset
  • In-Sync Replicas
  • High Watermark
  • Log end offset
  • Single and Multiple Consumer with Multiple Consumer Group
5

Kafka Development

  • Architecture
  • Hardware specs
  • Deploying Deep Dive into Kafka Cluster
  • Understanding the components of Kafka cluster
  • Installation of Kafka Cluster
  • Configuring Kafka Cluster
  • Producer of Kafka
  • Consumer of Kafka
  • Producer and Consumer in Action
  • Hands on code with Java and Scala
  • Replication and Compression
6

Kafka Cluster

  • Install Kafka
  • Set up a Kafka
    • A single node- A single broker cluster
    • A single node - Multiple broker clusters
    • Multiple nodes - Multiple broker clusters
  • Kafka Operations and Performance Tuning
7

Kafka Streams

  • KStreams
  • KTable
  • All transformations with KStreams and KTable
    • map(),mapValues(),filter(),flatMap(),groupBy(),groupByKey(),foreach(),
    • peek(),writeAsText(),print()
  • Windowing
8

Kafka Connect

  • Data transfer through connect to HDFS and kafka topics
  • Working with Kafka Logs
  • Operationalizing Kafka Securing Kafka
  • Security Overview
  • Configuring Kafka Security
9

Encryption and Authentication using SSL

  • Authentication using SASL
  • Authorization and ACLs
  • Incorporating Security Features in a Running Cluster
  • ZooKeeper for HA Hands On
  • Using Kafka Connect to move data
  • Monitoring and Alerting using Kafka Tools
  • Set up authentication for Kafka
  • Authentication via SSL & Kerberos through SASL
  • Authorization, permissions and ACLs setup
  • Set up Encryption

Encarta Labs Advantage

  • One Stop Corporate Training Solution Providers for over 3,500 Modules on a variety of subjects
  • All courses are delivered by Industry Veterans
  • Get jumpstarted from newbie to production ready in a matter of few days
  • Trained more than 20,000 corporate candidates across india and abroad
  • All our trainings are conducted in workshop mode with more focus on hands On

View our other course offerings by visiting www.encartalabs.com/course-catalogue

Contact us for delivering this course as a public/open-house workshop for a group of 10+ candidates at our venue

Top