The modern data landscape demands professionals who can seamlessly bridge the gap between data lakes and data warehouses. This course transforms your ability to architect, implement, and optimize lakehouse platforms that deliver both flexibility and performance.
This Short Course was created to help data engineering professionals accomplish scalable data platform implementation using advanced SQL and lakehouse patterns.
By completing this course, you'll be able to register massive file-based datasets as queryable external tables, make informed decisions between Delta Lake, Iceberg, and Hudi formats, and automate robust data ingestion pipelines that keep your warehouse synchronized with your lake.
By the end of this course, you will be able to:
- Apply configurations to register file-based datasets as external tables
- Analyze the technical capabilities of different open-source table formats
- Create a data ingestion pipeline within a lakehouse architecture
This course is unique because it combines hands-on SQL implementation with strategic architectural decision-making, giving you both the technical skills and analytical framework needed for enterprise-scale data platforms.
To be successful in this course, you should have a background in SQL, data warehousing concepts, and distributed systems fundamentals.
Learners will master the technical implementation of external table configurations to enable direct querying of file-based datasets in cloud storage.
SQL Syntax and Configuration Parameters for External Tables•7分钟
1篇阅读材料•总计10分钟
External Table Architecture and Implementation Patterns•10分钟
2个作业•总计21分钟
Configure Multi-Format External Tables for Enterprise Data Lake•18分钟
External Table Configuration Knowledge Check•3分钟
Module 2: Open-Source Table Format Analysis
第 2 单元•小时 后完成
单元详情
Learners will develop analytical frameworks to evaluate and compare the technical capabilities of Delta Lake, Apache Iceberg, and Apache Hudi for specific business requirements.
涵盖的内容
2个视频1篇阅读材料2个作业
显示有关单元内容的信息
2个视频•总计13分钟
Feature Comparison Matrix: Schema Evolution and Time Travel•5分钟
Building Technical Capability Comparison Matrices•8分钟
1篇阅读材料•总计10分钟
Comprehensive Analysis of Delta Lake, Iceberg, and Hudi Capabilities•10分钟
2个作业•总计23分钟
Develop Strategic Table Format Recommendation Framework•20分钟
Table Format Analysis and Selection Knowledge Check•3分钟
Module 3: Data Ingestion Pipeline Implementation
第 3 单元•小时 后完成
单元详情
Learners will architect and implement automated data ingestion pipelines that orchestrate data movement across medallion architecture zones within lakehouse platforms.
涵盖的内容
2个视频1篇阅读材料2个作业1个非评分实验室
显示有关单元内容的信息
2个视频•总计10分钟
The Cost of Manual Data Pipeline Management•3分钟
COPY INTO Commands and Incremental Loading Strategies•7分钟
1篇阅读材料•总计10分钟
Medallion Architecture and Pipeline Orchestration Patterns•10分钟
2个作业•总计18分钟
Lakehouse Data Pipeline Implementation Assessment•15分钟
Data Ingestion Pipeline Implementation Knowledge Check•3分钟
1个非评分实验室•总计20分钟
Build Automated Data Ingestion Pipeline for Lakehouse Architecture•20分钟
Coursera brings together a diverse network of subject matter experts who have demonstrated their expertise through professional industry experience or strong academic backgrounds. These instructors design and teach courses that make practical, career-relevant skills accessible to learners worldwide.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.