Master Apache Kafka configuration, monitoring, and optimization for production environments. This hands-on course teaches you to design high-availability topic architectures, diagnose performance bottlenecks using consumer lag analysis, and tune producers and consumers for maximum throughput while meeting strict latency SLAs. Through real-world scenarios based on challenges faced by companies like Netflix, LinkedIn, Uber, and Walmart, you'll learn to prevent data loss during broker failures, eliminate consumer lag issues, and optimize Kafka clusters processing millions of events per second. By the end of this course, you'll have the skills to build, monitor, and optimize production Kafka infrastructure that handles massive scale while maintaining reliability and performance.
This course is designed for software engineers, data platform specialists, and DevOps professionals who work with real-time data systems and want to deepen their expertise in Apache Kafka. Ideal learners already understand basic Kafka concepts and distributed systems fundamentals but seek to enhance their ability to configure, monitor, and optimize Kafka clusters for high-throughput, low-latency production environments. It’s also valuable for those preparing for roles in data engineering, site reliability, or systems performance optimization.
Learners should have a basic understanding of distributed systems and networking concepts, familiarity with command-line interfaces, and introductory knowledge of Apache Kafka fundamentals such as topics, producers, and consumers. Prior experience with Linux environments, Docker, or monitoring tools like Grafana and Prometheus will be helpful but not required.
By the end of this course, you’ll be able to configure and optimize Apache Kafka clusters for high throughput, low latency, and maximum availability. You’ll gain hands-on experience in monitoring broker health, diagnosing consumer lag, and tuning producer and consumer performance for real-world production environments. With these skills, you’ll be ready to build, scale, and maintain data streaming systems that power modern, high-performance applications.
Learn to configure Kafka topics with appropriate replication factors, partition counts, and durability settings to ensure data availability during failures while optimizing for throughput and parallelism.
涵盖的内容
4个视频2篇阅读材料1次同伴评审
显示有关单元内容的信息
4个视频•总计26分钟
Welcome to Kafka Optimization•5分钟
Replication Factors and Data Durability•9分钟
Partition Strategy for Parallelism•7分钟
Topic Configuration Best Practices•6分钟
2篇阅读材料•总计10分钟
Welcome to the Course: Course Overview•5分钟
Kafka Replication and Partition Design Guide•5分钟
1次同伴评审•总计20分钟
Hands-On-Learning: Create and Configure High-Availability Sales Events Topic•20分钟
Monitor Performance and Identify Bottlenecks
第 2 单元•小时 后完成
单元详情
Master consumer lag monitoring, broker health metrics, and throughput analysis to identify and diagnose performance bottlenecks before they impact production systems.
涵盖的内容
3个视频1篇阅读材料1次同伴评审
显示有关单元内容的信息
3个视频•总计23分钟
Understanding Consumer Lag and Its Impact•7分钟
Consumer Group Sizing and Partition Assignment•8分钟
Broker Health Monitoring and Alerts•8分钟
1篇阅读材料•总计5分钟
Consumer Lag Monitoring and Troubleshooting•5分钟
1次同伴评审•总计20分钟
Hands-On-Learning: Investigate and Resolve Inventory-Updates Consumer Lag•20分钟
Optimize Producer and Consumer Performance
第 3 单元•小时 后完成
单元详情
Learn to tune producer batching, compression, and consumer fetch settings to maximize throughput while meeting latency SLAs. Balance competing performance requirements for production workloads.
涵盖的内容
4个视频1篇阅读材料1个作业2次同伴评审
显示有关单元内容的信息
4个视频•总计29分钟
Producer Batching and Compression Strategies•9分钟
Consumer Fetch Optimization•7分钟
Broker-Side Performance Tuning•9分钟
Course Wrap-Up and Your Kafka Journey Ahead•5分钟
1篇阅读材料•总计5分钟
Kafka Performance Tuning Guide•5分钟
1个作业•总计20分钟
Optimize Kafka for Speed & Availability•20分钟
2次同伴评审•总计80分钟
Hands-On-Learning: Tune Producer for High Throughput While Meeting Latency SLAs•20分钟
Project: Build and Optimize Production Kafka Cluster for E-commerce Platform•60分钟
Coursera brings together a diverse network of subject matter experts who have demonstrated their expertise through professional industry experience or strong academic backgrounds. These instructors design and teach courses that make practical, career-relevant skills accessible to learners worldwide.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.