Get in Touch
 Duration 16 hours

Course Outline

Module 1: Fundamentals of Confluent Apache Kafka Architecture and Cluster Configuration

  • Overview of Apache Kafka and the Confluent Platform
  • Core concepts: Kafka broker, producer, consumer, and topics
  • The role of Kafka in data streaming and messaging pipelines
  • Confluent extensions: REST Proxy, Schema Registry, and Control Center
  • Kafka cluster architecture: brokers, partitions, and replication

Module 2: Configuring Zookeeper Quorum

  • Introduction to Zookeeper
  • Zookeeper’s function within a Kafka cluster
  • Determining Zookeeper quorum size
  • Zookeeper configuration details
  • Implementing SSH on servers
  • Hands-on: Configuring Zookeeper (as a team and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Setting up Zookeeper quorum
  • Zookeeper’s internal file system
  • Performance considerations for Zookeeper
  • Demo: Zookeeper management tools and Zoonavigator

Module 3: Configuring Kafka Clusters

  • Essential Kafka basics
  • Kafka configuration parameters
  • Hands-on: Configuring Kafka on a single broker
  • Hands-on: Running Kafka commands
  • Hands-on: Establishing a Kafka multi-broker (cluster) setup
  • Hands-on: Testing the Kafka cluster
  • Verification of Kafka cluster connectivity
  • Advertised.listeners configuration: critical settings
  • Topic configuration specifics
  • Configuring message ingestion and delivery across topics
  • Hands-on: Demonstrating Kafka resilience
  • Kafka performance: I/O, network, RAM, CPU, and OS factors
  • Kafka performance: additional influencing elements
  • Hands-on: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Message sending and receiving (via CLI, Java, Spring Framework)
  • Metrics and monitoring tools (Confluent Control Center, Elasticsearch, etc.)
  • Log files and offset management
  • High availability and disaster recovery concepts
  • Ensuring high availability through replication
  • Performance tuning for producers and consumers
  • Disaster recovery strategies
  • Failover control and data recovery processes
  • Setting up connectors
  • Implementing Kafka Connect
  • Kafka security features

Summary and Next Steps

Requirements

  • Proficiency with Linux-based systems and command-line utilities
  • Working knowledge of distributed systems principles
  • Familiarity with fundamental networking and system configuration concepts

Target Audience

  • DevOps and SRE teams overseeing Kafka deployments
  • System administrators managing Confluent and Zookeeper infrastructures
  • Kafka developers and architects accountable for scalable system designs

Number of participants


Price per participant

Testimonials (2)

Provisional Upcoming Courses (Require 5+ participants)

Related Categories