Course Outline
Module 1: Introduction to the architecture and configuration of the Confluent Apache Kafka cluster
- The role of Kafka in modern data pipelines.
- Differences between Apache Kafka and Confluent Kafka.
- Core components: producers, consumers, brokers, topics, and partitions.
- Kafka cluster deployment models and scaling considerations.
Module 2: Zookeeper Quorum Configuration
- Understanding Zookeeper.
- Zookeeper’s role within a Kafka cluster.
- Determining the appropriate Zookeeper Quorum size.
- Zookeeper configuration settings.
- Implementing SSH on our servers.
- Practical session: Zookeeper configuration (team-based and as a service).
- Utilising the Zookeeper Command Line Interface (CLI).
- Practical session: Zookeeper Quorum configuration.
- Understanding the Zookeeper internal file system.
- Performance factors affecting Zookeeper.
- Demonstration of management tools for Zookeeper and Zoonavigator.
Module 3: Kafka Cluster Configuration
- Fundamental Kafka concepts.
- Kafka configuration settings.
- Practical session: Configuring a Kafka broker.
- Practical session: Executing Kafka commands.
- Practical session: Configuring a Kafka Multi-Broker Cluster.
- Practical session: Testing the Kafka cluster.
- Connectivity to your Kafka cluster.
- Advertised.listeners configuration: the most critical setting.
- Topic configuration.
- Configuration for downloading and ingesting messages into topics.
- Practical session: Demonstrating Kafka resilience.
- Kafka performance factors: I/O.
- Kafka performance factors: Network (RED).
- Kafka performance factors: RAM.
- Kafka performance factors: CPU.
- Kafka performance factors: Operating System (OS).
- Kafka performance factors: Other considerations.
- Practical session: Modifying Kafka broker configuration.
Module 4: Advanced Kafka Configuration
- Landoop Kafka topic user interface, Confluent REST Proxy, and Confluent Schema Registry configuration.
- Sending and receiving messages via CLI, Java, and Spring framework.
- Monitoring metrics and tools (Confluent Control Center, Elasticsearch, etc.).
- Managing log files and offsets.
- High availability and disaster recovery strategies.
- Ensuring high availability through replication.
- Tuning producer and consumer performance.
- Disaster recovery strategies.
- Failover control and data recovery.
- Connector configuration.
- Kafka Connect implementation.
- Kafka security features.
Summary and Next Steps
Requirements
- Familiarity with distributed systems and messaging concepts.
- Experience using the Linux command line.
- Basic understanding of networking and system administration.
Audience
- System administrators.
- DevOps engineers.
- Platform and infrastructure teams.
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4800 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
