Ship data and schema changes without outages. This hands-on course teaches you how to treat schemas as contracts, evolve them safely, and keep producers, consumers, and warehouses green end-to-end. You’ll design compatibility policies in a Schema Registry (backward/forward/full, transitive), automate checks in CI, and practice expand → adapt → contract rollouts. In streaming labs, you’ll capture OLTP changes with Debezium, deliver Avro-encoded events to Kafka, and route malformed records to a DLQ with actionable alerts. On the analytics side, you’ll evolve BigQuery/Iceberg schemas additively (NULLABLE/defaulted columns), shield downstream users with views/contracts, and validate correctness with queries and time travel. Realistic scenarios walk you through enum expansions, type widening, null/tombstone semantics, and subject naming rules.
This course is for data engineers, backend engineers, and analytics engineers who work with real-time or streaming data systems and need to evolve schemas without downtime. It’s also useful for platform engineers and architects responsible for data contracts, CDC pipelines, or Kafka-based platforms.
Learners should have basic SQL knowledge and a general understanding of streaming systems such as Kafka, along with familiarity with Git and the command line. Experience with schemas, CDC, Docker, or cloud data warehouses is helpful but not required.
By the end, you’ll have runnable templates, governance checklists, and a portfolio-ready project that proves you can design zero-downtime change—confidently and repeatably. For more information, check out the document.
Establish the why/what/how of schema evolution in streaming systems. Cover compatibility modes, additive vs. breaking changes, deprecation, and common anti‑patterns.
涵盖的内容
4个视频2篇阅读材料1次同伴评审
显示有关单元内容的信息
4个视频•总计34分钟
Why Schema Evolution Matters in Real-Time•4分钟
Compatibility 101: Backward, Forward, and Full•11分钟
Implementing Contracts with Registries & CI/CD (Condensed Reading)
第 2 单元•小时 后完成
单元详情
Learners review registry basics, CI checks, rollout playbooks, and observability as self‑study materials. No in‑session time is allocated in the 60‑minute run.
涵盖的内容
3个视频1篇阅读材料1次同伴评审
显示有关单元内容的信息
3个视频•总计33分钟
Registries in Practice: Subjects, Versions, and Rules•10分钟
Ship Safer: CI Checks + Rollout Playbooks•12分钟
Observability & Guardrails for Runtime Evolution•12分钟
1篇阅读材料•总计5分钟
Registry Rules & API Cheatsheet (Confluent + Apicurio)•5分钟
1次同伴评审•总计20分钟
Hands-On-Learning: Enforcing Global Schema Compatibility and Safe Recovery •20分钟
Zero-Downtime Data Changes: CDC, Compatibility, and Rollouts
第 3 单元•小时 后完成
单元详情
This module teaches you how to ship schema and data-model changes without outages using CDC pipelines, registries, and guardrails. You’ll learn rollout patterns (expand → adapt → contract), handle nulls/tombstones in Debezium, and make warehouses (e.g., BigQuery) resilient with nullable fields and views. By the end, you can design end-to-end plans with DLQs, alerts, and rollback levers that keep producers, consumers, and analytics running smoothly.
涵盖的内容
4个视频1篇阅读材料1个作业2次同伴评审
显示有关单元内容的信息
4个视频•总计38分钟
CDC + Streams: Handling Deletes, Reorders, and Schema Drift•12分钟
Downstream Models that Tolerate Change: Contracts, Views & Nullability•10分钟
From OLTP to Warehouse•13分钟
Ship Changes with Confidence•4分钟
1篇阅读材料•总计5分钟
Warehouse-Side Evolution: BigQuery Schema Updates in Practice•5分钟
1个作业•总计20分钟
Manage Schema Evolution in Real‑Time Data•20分钟
2次同伴评审•总计80分钟
Hands-On-Learning: Building customer_orders_latest with Zero-Downtime Additive Evolution •20分钟
Project: Governing Schema Evolution in a Real-Time CDC Pipeline (Zero Downtime) •60分钟
Coursera brings together a diverse network of subject matter experts who have demonstrated their expertise through professional industry experience or strong academic backgrounds. These instructors design and teach courses that make practical, career-relevant skills accessible to learners worldwide.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.