By 2025, 80% of enterprises will integrate GenAI into production workflows, yet only 15% feel confident deploying reliable RAG systems. This Short Course was created to help Machine Learning and Artificial Intelligence professionals build, optimize, and evaluate production-grade GenAI applications on the Databricks platform. By completing this course, you'll be able to construct vector search pipelines from raw data, fine-tune models with MLflow tracking, and implement rigorous evaluation frameworks that ensure your GenAI systems meet real-world SLA requirements—skills you can apply immediately to customer-facing AI deployments.
By the end of this course, you will be able to:
• Apply Databricks Lakehouse and vector search features to build a retrieval-augmented generation pipeline from raw data to queryable embeddings
• Analyze fine-tuning experiment results in MLflow to select adapter parameters that balance output quality and latency constraints
• Evaluate GenAI model responses for relevance, hallucination rate, cost, and latency, iterating prompt and context configurations to meet acceptance criteria
This course is unique because it combines hands-on Databricks Lakehouse workflows with MLflow experiment tracking and production-grade evaluation metrics, bridging the gap between GenAI prototypes and enterprise deployments. To be successful in this course, you should have working knowledge of Python programming, basic machine learning concepts, and familiarity with cloud data platforms at the CB2 intermediate level.
Learners apply Databricks Lakehouse and vector search features to construct a retrieval-augmented generation pipeline from raw customer support documents to queryable embeddings.
涵盖的内容
3个视频1篇阅读材料2个作业
显示有关单元内容的信息
3个视频•总计15分钟
When RAG Goes Wrong: The Cost of Static LLMs•3分钟
Lakehouse Architecture and Vector Search Fundamentals•5分钟
Building a Vector Search Index in Databricks•7分钟
1篇阅读材料•总计10分钟
RAG Pipeline Components: From Documents to Queryable Embeddings•10分钟
2个作业•总计21分钟
Design a RAG Pipeline Architecture for a Customer Support Use Case•15分钟
Knowledge Check: Building a RAG Pipeline on Databricks•6分钟
Module 2: Optimizing Fine-Tuning Experiments with MLflow
第 2 单元•小时 后完成
单元详情
Learners analyze fine-tuning experiment results in MLflow to select adapter parameters that balance output quality and latency constraints for production GenAI deployments.
涵盖的内容
2个视频2篇阅读材料1个作业
显示有关单元内容的信息
2个视频•总计11分钟
Interpreting Experiment Results: Selecting the Right Adapter Parameters•6分钟
Comparing MLflow Experiment Runs for Fine-Tuning Decisions•5分钟
2篇阅读材料•总计20分钟
MLflow Experiment Tracking for Fine-Tuning: Concepts and Metrics•10分钟
Evaluating Fine-Tuning Configurations: A Guided Analysis Framework•10分钟
1个作业•总计6分钟
Knowledge Check: Optimizing Fine-Tuning Experiments with MLflow•6分钟
Module 3: Evaluating GenAI Responses for Production Readiness
第 3 单元•小时 后完成
单元详情
Learners evaluate GenAI model responses across relevance, hallucination rate, cost, and latency metrics, iterating prompt and context configurations to meet enterprise acceptance criteria for production deployment.
涵盖的内容
3个视频1篇阅读材料3个作业
显示有关单元内容的信息
3个视频•总计14分钟
The Evaluation Gap: Why GenAI Systems Fail in Production•3分钟
Iterating Prompt and Context Configurations for SLA Compliance•6分钟
Running GenAI Evaluations in Databricks with MLflow•5分钟
1篇阅读材料•总计10分钟
GenAI Evaluation Metrics: Relevance, Hallucination, Cost, and Latency•10分钟
3个作业•总计51分钟
Build an Evaluation Report for a GenAI Deployment Scenario•15分钟
Knowledge Check: Evaluating GenAI Responses for Production Readiness•6分钟
Course Assessment: Build GenAI Apps on Databricks•30分钟
Coursera brings together a diverse network of subject matter experts who have demonstrated their expertise through professional industry experience or strong academic backgrounds. These instructors design and teach courses that make practical, career-relevant skills accessible to learners worldwide.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I purchase the Certificate?
When you purchase a Certificate you get access to all course materials, including graded assignments. Upon completing the course, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.