Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 16 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Setup
- Defining Apache Kafka and the Confluent Platform
- Core concepts of Kafka brokers, producers, consumers, and topics
- The function of Kafka in data streaming and messaging workflows
- Confluent-specific extensions: REST Proxy, Schema Registry, and Control Center
- Cluster structure: brokers, partitions, and replication mechanics
Module 2: Configuring the Zookeeper Quorum
- An introduction to Zookeeper
- Zookeeper's function within the Kafka cluster ecosystem
- Determining appropriate Zookeeper quorum sizes
- Configuring Zookeeper settings
- Implementing SSH on server infrastructure
- Practical Exercise: Configuring Zookeeper (both as a team and as a service)
- Utilizing the Zookeeper Command Line Interface (CLI)
- Practical Exercise: Establishing the Zookeeper quorum
- Understanding Zookeeper's internal file system
- Key performance factors influencing Zookeeper
- Demonstration: Overview of Zookeeper management tools and Zoonavigator
Module 3: Kafka Cluster Configuration
- Fundamental Kafka concepts
- Core Kafka configuration settings
- Practical Exercise: Setting up Kafka on a single broker
- Practical Exercise: Running Kafka commands
- Practical Exercise: Deploying a multi-broker Kafka cluster
- Practical Exercise: Testing the Kafka cluster
- Verifying connectivity to the Kafka cluster
- Configuring Advertised.listeners: critical settings
- Topic-level configurations
- Establishing message ingestion and delivery mechanisms within topics
- Practical Exercise: Illustrating Kafka resilience
- Kafka performance factors: I/O, network, RAM, CPU, and OS
- Additional elements impacting Kafka performance
- Practical Exercise: Modifying broker configurations
Module 4: Advanced Kafka Configuration
- Configuration of Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
- Message transmission and reception (via CLI, Java, Spring Framework)
- Monitoring and metrics tools (Confluent Control Center, Elasticsearch, and others)
- Log file management and offset control
- High availability and disaster recovery planning
- Maintaining high availability through replication
- Performance tuning for producers and consumers
- Strategies for disaster recovery
- Managing failover and data restoration
- Configuring connectors
- Implementing Kafka Connect
- Kafka security features and best practices
Summary and Recommended Next Steps
Requirements
- Proficiency with Linux-based operating systems and command-line utilities
- Working knowledge of distributed system principles
- Foundational understanding of networking and system configuration
Target Audience
- DevOps and SRE professionals overseeing Kafka deployments
- System administrators interacting with Confluent and Zookeeper
- Kafka developers and architects tasked with building scalable systems
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
