Get in Touch
 Duration 16 hours

Course Outline

Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration

  • Overview of Apache Kafka and the Confluent Platform capabilities.
  • Core concepts: Kafka brokers, producers, consumers, and topics.
  • The strategic role of Kafka in data streaming and messaging pipelines.
  • Confluent extensions such as REST Proxy, Schema Registry, and Control Center.
  • Deep dive into Kafka cluster architecture, including brokers, partitions, and replication.

Module 2: Zookeeper Quorum Configuration

  • Foundational understanding of Zookeeper.
  • How Zookeeper functions within a Kafka cluster infrastructure.
  • Determining appropriate Zookeeper quorum sizes.
  • Detailed Zookeeper configuration processes.
  • Implementing SSH for secure server access.
  • Hands-on: Configuring Zookeeper both as a team-managed instance and a system service.
  • Utilizing the Zookeeper Command Line Interface (CLI).
  • Hands-on: Establishing a functional Zookeeper quorum setup.
  • Exploring Zookeeper’s internal file system structure.
  • Analyzing performance factors that impact Zookeeper efficiency.
  • Demo: Utilizing Zookeeper management tools and Zoonavigator.

Module 3: Kafka Cluster Configuration

  • Review of fundamental Kafka operations.
  • Essential Kafka configuration parameters.
  • Hands-on: Configuring Kafka on a single broker node.
  • Hands-on: Executing core Kafka commands.
  • Hands-on: Setting up a multi-broker (clustered) Kafka environment.
  • Hands-on: Conducting comprehensive Kafka cluster tests.
  • Verifying connectivity to the Kafka cluster.
  • Configuring Advertised.listeners: a critical setting for network routing.
  • Managing topic-specific configurations.
  • Setting up message ingestion and delivery mechanisms within topics.
  • Hands-on: Demonstrating Kafka’s resilience and fault tolerance.
  • Kafka performance optimization covering I/O, network, RAM, CPU, and OS interactions.
  • Addressing additional factors influencing Kafka performance.
  • Hands-on: Modifying broker configurations for optimal performance.

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry.
  • Techniques for sending and receiving messages via CLI, Java, and Spring Framework.
  • Implementing metrics and monitoring using tools like Confluent Control Center and Elasticsearch.
  • Managing log files and offset tracking.
  • Strategies for high availability and disaster recovery.
  • Ensuring continuous operation through effective replication.
  • Performance tuning for producers and consumers.
  • Developing comprehensive disaster recovery strategies.
  • Controlling failover mechanisms and executing data recovery.
  • Setting up and managing connectors.
  • Implementing Kafka Connect for data integration.
  • Implementing Kafka security features to protect data integrity.

Summary and Next Steps

Requirements

  • Practical experience with Linux-based operating systems and command-line utilities.
  • Familiarity with core concepts of distributed systems.
  • A solid understanding of basic networking principles and system configuration.

Target Audience

  • DevOps and SRE teams responsible for managing Kafka deployments.
  • System administrators working with Confluent and Zookeeper infrastructure.
  • Kafka developers and architects tasked with building and maintaining scalable systems.

Number of participants


Price per participant

Testimonials (2)

Provisional Upcoming Courses (Require 5+ participants)

Related Categories