Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 16 hours
Course Outline
Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration
- Overview of Apache Kafka and the Confluent Platform capabilities.
- Core concepts: Kafka brokers, producers, consumers, and topics.
- The strategic role of Kafka in data streaming and messaging pipelines.
- Confluent extensions such as REST Proxy, Schema Registry, and Control Center.
- Deep dive into Kafka cluster architecture, including brokers, partitions, and replication.
Module 2: Zookeeper Quorum Configuration
- Foundational understanding of Zookeeper.
- How Zookeeper functions within a Kafka cluster infrastructure.
- Determining appropriate Zookeeper quorum sizes.
- Detailed Zookeeper configuration processes.
- Implementing SSH for secure server access.
- Hands-on: Configuring Zookeeper both as a team-managed instance and a system service.
- Utilizing the Zookeeper Command Line Interface (CLI).
- Hands-on: Establishing a functional Zookeeper quorum setup.
- Exploring Zookeeper’s internal file system structure.
- Analyzing performance factors that impact Zookeeper efficiency.
- Demo: Utilizing Zookeeper management tools and Zoonavigator.
Module 3: Kafka Cluster Configuration
- Review of fundamental Kafka operations.
- Essential Kafka configuration parameters.
- Hands-on: Configuring Kafka on a single broker node.
- Hands-on: Executing core Kafka commands.
- Hands-on: Setting up a multi-broker (clustered) Kafka environment.
- Hands-on: Conducting comprehensive Kafka cluster tests.
- Verifying connectivity to the Kafka cluster.
- Configuring Advertised.listeners: a critical setting for network routing.
- Managing topic-specific configurations.
- Setting up message ingestion and delivery mechanisms within topics.
- Hands-on: Demonstrating Kafka’s resilience and fault tolerance.
- Kafka performance optimization covering I/O, network, RAM, CPU, and OS interactions.
- Addressing additional factors influencing Kafka performance.
- Hands-on: Modifying broker configurations for optimal performance.
Module 4: Advanced Kafka Configuration
- Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry.
- Techniques for sending and receiving messages via CLI, Java, and Spring Framework.
- Implementing metrics and monitoring using tools like Confluent Control Center and Elasticsearch.
- Managing log files and offset tracking.
- Strategies for high availability and disaster recovery.
- Ensuring continuous operation through effective replication.
- Performance tuning for producers and consumers.
- Developing comprehensive disaster recovery strategies.
- Controlling failover mechanisms and executing data recovery.
- Setting up and managing connectors.
- Implementing Kafka Connect for data integration.
- Implementing Kafka security features to protect data integrity.
Summary and Next Steps
Requirements
- Practical experience with Linux-based operating systems and command-line utilities.
- Familiarity with core concepts of distributed systems.
- A solid understanding of basic networking principles and system configuration.
Target Audience
- DevOps and SRE teams responsible for managing Kafka deployments.
- System administrators working with Confluent and Zookeeper infrastructure.
- Kafka developers and architects tasked with building and maintaining scalable systems.
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)