Get in Touch
 Duration 16 hours

Course Outline

Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration

  • An overview of Apache Kafka and the Confluent Platform.
  • Core concepts: Kafka brokers, producers, consumers, and topics.
  • The role of Kafka in facilitating data streaming and messaging pipelines.
  • Confluent-specific extensions: REST Proxy, Schema Registry, and Control Center.
  • Kafka cluster architecture details: brokers, partitions, and replication.

Module 2: Zookeeper Quorum Configuration

  • Fundamentals of Zookeeper.
  • The function of Zookeeper within a Kafka cluster.
  • Determining appropriate Zookeeper quorum sizes.
  • Configuring Zookeeper parameters.
  • Setting up SSH access on server infrastructure.
  • Hands-on: Configuring Zookeeper as both a team and a service.
  • Utilizing the Zookeeper Command Line Interface (CLI).
  • Hands-on: Establishing a Zookeeper quorum.
  • Understanding Zookeeper’s internal file system.
  • Performance variables that impact Zookeeper operation.
  • Demo: Exploring Zookeeper management tools and Zoonavigator.

Module 3: Kafka Cluster Configuration

  • Essential Kafka concepts.
  • General Kafka configuration practices.
  • Hands-on: Configuring Kafka on a single broker.
  • Hands-on: Running standard Kafka commands.
  • Hands-on: Setting up a multi-broker Kafka cluster.
  • Hands-on: Testing Kafka cluster functionality.
  • Verifying connectivity to the Kafka cluster.
  • Configuring Advertised.listeners: a critical setting.
  • Managing topic configurations.
  • Establishing message ingestion and delivery workflows within topics.
  • Hands-on: Demonstrating Kafka resilience capabilities.
  • Kafka performance factors: I/O, network, RAM, CPU, and OS settings.
  • Additional Kafka performance considerations.
  • Hands-on: Modifying broker configurations effectively.

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry.
  • Message transmission methods via CLI, Java, and the Spring Framework.
  • Using metrics and monitoring tools such as Confluent Control Center and Elasticsearch.
  • Managing log files and offsets.
  • Implementing high availability and disaster recovery plans.
  • Maintaining high availability through replication strategies.
  • Performance tuning for producers and consumers.
  • Strategies for disaster recovery.
  • Controlling failover mechanisms and data recovery.
  • Setting up connectors.
  • Implementing Kafka Connect.
  • Reviewing Kafka security features.

Summary and Next Steps

Requirements

  • Practical experience with Linux-based operating systems and command-line utilities.
  • Working knowledge of distributed systems principles.
  • A solid grasp of fundamental networking and system configuration concepts.

Intended Audience

  • DevOps and SRE teams responsible for managing Kafka deployments.
  • System administrators working with Confluent and Zookeeper infrastructure.
  • Kafka developers and architects tasked with building scalable systems.

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from 4800 € + VAT*

Contact us for an exact quote and to hear our latest promotions

Testimonials (2)

Provisional Upcoming Courses (Contact Us For More Information)

Related Categories