Get in Touch
 Duration 21 hours (3 days)

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Configuration

  • The role of Kafka in contemporary data pipelines
  • Key distinctions between Apache Kafka and Confluent Kafka
  • Essential components: producers, consumers, brokers, topics, and partitions
  • Deployment models and scaling strategies for Kafka clusters

Module 2: Configuring Zookeeper Quorums

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining Zookeeper Quorum size
  • Configuring Zookeeper
  • Setting up SSH on servers
  • Hands-on: Configuring Zookeeper (standalone and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Setting up Zookeeper Quorums
  • The Zookeeper internal file system
  • Performance considerations for Zookeeper
  • Demonstration of Zookeeper management tools and Zoonavigator

Module 3: Kafka Cluster Setup and Configuration

  • Foundational Kafka concepts
  • Core Kafka configurations
  • Hands-on: Configuring Kafka brokers
  • Hands-on: Running Kafka commands
  • Hands-on: Setting up a Kafka Multi-Broker Cluster
  • Hands-on: Testing the Kafka cluster
  • Verifying cluster connectivity
  • Advertised.listeners configuration: A critical setting
  • Managing topic configurations
  • Configuration for message ingestion and retrieval
  • Hands-on: Demonstrating Kafka resilience
  • Kafka performance: I/O operations
  • Kafka performance: Network (RED)
  • Kafka performance: RAM usage
  • Kafka performance: CPU load
  • Kafka performance: Operating System (OS) optimization
  • Kafka performance: Other factors
  • Hands-on: Modifying Kafka broker configurations

Module 4: Advanced Kafka Configurations

  • Configuring Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
  • Message exchange via CLI, Java, and the Spring framework
  • Monitoring metrics using tools such as Confluent Control Center and Elasticsearch
  • Managing log files and offsets
  • Ensuring high availability and disaster recovery
  • Achieving high availability through replication
  • Optimizing producer and consumer performance
  • Developing disaster recovery strategies
  • Controlling failover and recovering data
  • Setting up connectors
  • Implementing Kafka Connect
  • Enabling Kafka security features

Summary and Recommended Next Steps

Requirements

  • Working knowledge of distributed systems and messaging principles
  • Proficiency with the Linux command-line interface
  • Fundamental understanding of networking and system administration

Target Audience

  • System administrators
  • DevOps engineers
  • Platform and infrastructure teams

Number of participants


Price per participant

Testimonials (2)

Provisional Upcoming Courses (Require 5+ participants)

Related Categories