Course Outline
Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration
- An overview of Apache Kafka and the Confluent Platform.
- Core concepts: Kafka brokers, producers, consumers, and topics.
- The role of Kafka in facilitating data streaming and messaging pipelines.
- Confluent-specific extensions: REST Proxy, Schema Registry, and Control Center.
- Kafka cluster architecture details: brokers, partitions, and replication.
Module 2: Zookeeper Quorum Configuration
- Fundamentals of Zookeeper.
- The function of Zookeeper within a Kafka cluster.
- Determining appropriate Zookeeper quorum sizes.
- Configuring Zookeeper parameters.
- Setting up SSH access on server infrastructure.
- Hands-on: Configuring Zookeeper as both a team and a service.
- Utilizing the Zookeeper Command Line Interface (CLI).
- Hands-on: Establishing a Zookeeper quorum.
- Understanding Zookeeper’s internal file system.
- Performance variables that impact Zookeeper operation.
- Demo: Exploring Zookeeper management tools and Zoonavigator.
Module 3: Kafka Cluster Configuration
- Essential Kafka concepts.
- General Kafka configuration practices.
- Hands-on: Configuring Kafka on a single broker.
- Hands-on: Running standard Kafka commands.
- Hands-on: Setting up a multi-broker Kafka cluster.
- Hands-on: Testing Kafka cluster functionality.
- Verifying connectivity to the Kafka cluster.
- Configuring Advertised.listeners: a critical setting.
- Managing topic configurations.
- Establishing message ingestion and delivery workflows within topics.
- Hands-on: Demonstrating Kafka resilience capabilities.
- Kafka performance factors: I/O, network, RAM, CPU, and OS settings.
- Additional Kafka performance considerations.
- Hands-on: Modifying broker configurations effectively.
Module 4: Advanced Kafka Configuration
- Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry.
- Message transmission methods via CLI, Java, and the Spring Framework.
- Using metrics and monitoring tools such as Confluent Control Center and Elasticsearch.
- Managing log files and offsets.
- Implementing high availability and disaster recovery plans.
- Maintaining high availability through replication strategies.
- Performance tuning for producers and consumers.
- Strategies for disaster recovery.
- Controlling failover mechanisms and data recovery.
- Setting up connectors.
- Implementing Kafka Connect.
- Reviewing Kafka security features.
Summary and Next Steps
Requirements
- Practical experience with Linux-based operating systems and command-line utilities.
- Working knowledge of distributed systems principles.
- A solid grasp of fundamental networking and system configuration concepts.
Intended Audience
- DevOps and SRE teams responsible for managing Kafka deployments.
- System administrators working with Confluent and Zookeeper infrastructure.
- Kafka developers and architects tasked with building scalable systems.
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4800 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)