Course Outline
Module 1: Introduction to the architecture and configuration of the Confluent Apache Kafka cluster
- The role of Kafka in contemporary data pipelines.
- Distinguishing between Apache Kafka and Confluent Kafka.
- Key components: producers, consumers, brokers, topics, and partitions.
- Cluster deployment models and considerations for scaling.
Module 2: Zookeeper Quorum Configuration
- An introduction to Zookeeper.
- The function of Zookeeper within a Kafka cluster.
- Determining the appropriate Zookeeper Quorum size.
- Configuring Zookeeper settings.
- Setting up SSH on servers.
- Practical exercise: Configuring Zookeeper as a team and as a service.
- Utilizing the Zookeeper Command Line Interface (CLI).
- Practical exercise: Configuring the Zookeeper Quorum.
- Overview of the Zookeeper internal file system.
- Performance factors that impact Zookeeper.
- Demonstration of management tools for Zookeeper and Zoonavigator.
Module 3: Kafka Cluster Configuration
- Fundamental Kafka concepts.
- General Kafka configuration.
- Practical exercise: Configuring Kafka brokers.
- Practical exercise: Executing Kafka commands.
- Practical exercise: Configuring a Kafka Multi-Broker Cluster.
- Practical exercise: Testing the Kafka cluster.
- Verifying connectivity to the Kafka cluster.
- Configuring Advertised.listeners: a critical setting.
- Topic configuration.
- Settings for downloading and ingesting messages into topics.
- Practical exercise: Demonstrating Kafka resilience.
- Kafka performance: I/O considerations.
- Kafka performance: Network (RED).
- Kafka performance: RAM utilization.
- Kafka performance: CPU usage.
- Kafka performance: Operating System (OS) factors.
- Kafka performance: Other influences.
- Practical exercise: Modifying Kafka broker configuration.
Module 4: Advanced Kafka Configuration
- Configuring the Landoop Kafka topic user interface, Confluent REST Proxy, and Confluent Schema Registry.
- Handling message transmission and reception via CLI, Java, and the Spring framework.
- Monitoring metrics and utilizing tools such as Confluent Control Center and Elasticsearch.
- Managing log files and offsets.
- Ensuring high availability and disaster recovery.
- Guaranteeing high availability through replication.
- Optimizing producer and consumer performance.
- Implementing disaster recovery strategies.
- Controlling failover and managing data recovery.
- Configuring connectors.
- Implementing Kafka Connect.
- Exploring Kafka security features.
Summary and Next Steps
Requirements
- Working knowledge of distributed systems and messaging principles.
- Proficiency with the Linux command line.
- Fundamental understanding of networking and system administration.
Target Audience
- System administrators.
- DevOps engineers.
- Platform and infrastructure teams.
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4800 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
