Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Module 1: Introduction to the architecture and configuration of the Confluent Apache Kafka cluster
- The role of Kafka in modern data pipelines.
- Distinguishing between Apache Kafka and Confluent Kafka.
- Core components: producers, consumers, brokers, topics, and partitions.
- Deployment models for Kafka clusters and scaling considerations.
Module 2: Zookeeper Quorum Configuration
- Understanding Zookeeper.
- The role of Zookeeper within a Kafka cluster.
- Defining the Zookeeper Quorum size.
- Zookeeper configuration parameters.
- Implementing SSH on servers.
- Practical Exercise: Configuring Zookeeper (as a team service).
- Utilizing the Zookeeper Command Line Interface (CLI).
- Practical Exercise: Setting up the Zookeeper Quorum.
- Overview of the Zookeeper internal file system.
- Performance factors influencing Zookeeper.
- Demonstration of management tools for Zookeeper and Zoonavigator.
Module 3: Kafka Cluster Configuration
- Fundamental Kafka concepts.
- Kafka configuration basics.
- Practical Exercise: Configuring a Kafka broker.
- Practical Exercise: Executing Kafka commands.
- Practical Exercise: Setting up a Multi-Broker Kafka Cluster.
- Practical Exercise: Testing the Kafka cluster.
- Verifying connectivity to your Kafka cluster.
- The critical 'Advertised.listeners' configuration setting.
- Topic configuration details.
- Configuration for downloading and ingesting messages into topics.
- Practical Demonstration: Kafka resilience.
- Kafka performance factors: I/O operations.
- Kafka performance factors: Network latency (RED).
- Kafka performance factors: RAM usage.
- Kafka performance factors: CPU utilization.
- Kafka performance factors: Operating System (OS) optimization.
- Additional Kafka performance considerations.
- Practical Exercise: Modifying Kafka broker configuration.
Module 4: Advanced Kafka Configuration
- Configuring the Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry.
- Sending and receiving messages via CLI, Java, and the Spring framework.
- Monitoring metrics using tools such as Confluent Control Center and Elasticsearch.
- Managing log files and offsets.
- Implementing high availability and disaster recovery strategies.
- Achieving high availability through replication.
- Tuning producer and consumer performance.
- Comprehensive disaster recovery plans.
- Failover control and data recovery procedures.
- Configuring connectors.
- Implementing Kafka Connect.
- Exploring Kafka security features.
Summary and Next Steps
Requirements
- Familiarity with distributed systems and messaging concepts.
- Experience operating the Linux command line.
- Basic understanding of networking and system administration.
Audience
- System administrators.
- DevOps engineers.
- Platform and infrastructure teams.
21 Hours
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
