In today’s AI-driven world, optimizing large language models for specific domains while managing cost is a key competitive skill. This course trains AI engineers, ML practitioners, and data scientists to transform baseline generative models into efficient, production-ready solutions. Through hands-on labs using Hugging Face Transformers, PEFT, and Evaluate, you’ll master decoding strategies (temperature, top-k, top-p, beam search), automated evaluation (BLEU, ROUGE, BERTScore, custom metrics), and parameter-efficient fine-tuning (LoRA) that cuts trainable parameters by 99% without losing quality. Real-world projects cover fine-tuning 7B+ models for legal, medical, and financial applications while analyzing GPU and inference costs. The capstone simulates real constraints—limited GPU memory, latency, budget, and compliance—requiring technical, analytical, and executive deliverables. By course end, you’ll confidently optimize and evaluate LLMs, balancing quality, performance, and cost for advanced roles in LLM engineering, MLOps, and AI product development.
This course is ideal for DevOps engineers, SREs, cloud engineers, and developers who manage containerized applications and want to streamline deployments using Helm. It’s also suited for technical leads and engineers who design or maintain CI/CD or GitOps pipelines for modern, scalable systems.
Participants should have basic proficiency in Python, an understanding of machine learning fundamentals, and familiarity with natural language processing (NLP) concepts and machine learning frameworks to fully engage with the course content.
Participants should have basic proficiency in Python, an understanding of machine learning fundamentals, and familiarity with natural language processing (NLP) concepts and machine learning frameworks to fully engage with the course content.
This module introduces learners to decoding strategies and parameters that control how generative AI models produce text. Learners will explore the mechanics of temperature, top-k, top-p sampling, and beam search, understanding how these parameters influence output diversity, coherence, and relevance. Through hands-on experimentation, learners will gain practical skills in tuning these parameters for different use cases.
涵盖的内容
5个视频2篇阅读材料1次同伴评审
显示有关单元内容的信息
5个视频•总计41分钟
Welcome to Generative AI Optimization•2分钟
How Generative Models Produce Text: From Probabilities to Words•7分钟
Temperature, Top-k, and Top-p: The Control Knobs of Generation•9分钟
Tuning Decoding Parameters in Practice Part 1•12分钟
Tuning Decoding Parameters in Practice part 2•11分钟
2篇阅读材料•总计10分钟
Welcome to the Course: Course Overview•5分钟
Beam Search vs. Sampling: Choosing the Right Strategy for Your Application•5分钟
1次同伴评审•总计20分钟
Hands-On-Learning: Tuning LLM Decoding Parameters for Content Generation•20分钟
Evaluating Generative AI Output Quality
第 2 单元•小时 后完成
单元详情
This module equips learners with systematic approaches to evaluate AI-generated text using automated metrics and evaluation frameworks. Learners will explore metrics like BLEU, ROUGE, perplexity, BERTScore, and task-specific evaluation methods, understanding both their capabilities and limitations. The module emphasizes when automated metrics suffice and when human evaluation remains essential.
涵盖的内容
4个视频1篇阅读材料1次同伴评审
显示有关单元内容的信息
4个视频•总计36分钟
Traditional Metrics: BLEU, ROUGE, and Perplexity Explained•9分钟
Task-Specific Evaluation: Factuality, Coherence, and Relevance•9分钟
Building an Automated Evaluation Pipeline Part 1•9分钟
Building an Automated Evaluation Pipeline Part 2•8分钟
1篇阅读材料•总计5分钟
Modern Semantic Metrics: BERTScore, BLEURT, and Beyond•5分钟
1次同伴评审•总计20分钟
Hands-On-Learning: The Evaluation Breakdown: When Metrics Mislead and How to Fix It •20分钟
Parameter-Efficient Fine-Tuning for Domain Adaptation
第 3 单元•小时 后完成
单元详情
This module introduces learners to parameter-efficient fine-tuning (PEFT) techniques that enable domain adaptation of large language models without the computational and memory costs of full fine-tuning. Learners will explore methods like LoRA, prefix tuning, and adapter layers, understanding the cost-performance trade-offs and practical implementation strategies for real-world applications.
涵盖的内容
4个视频1篇阅读材料1个作业2次同伴评审
显示有关单元内容的信息
4个视频•总计28分钟
The Cost Problem: Why Full Fine-Tuning Doesn't Scale•6分钟
PEFT Methods Compared: LoRA, Prefix Tuning, and Adapters•8分钟
Implementing LoRA Fine-Tuning with PEFT Library•13分钟
Course Wrap-Up•2分钟
1篇阅读材料•总计5分钟
LoRA Deep Dive: Low-Rank Adaptation Explained•5分钟
1个作业•总计20分钟
Fine-Tune & Optimize Generative AI Models•20分钟
2次同伴评审•总计120分钟
Hands-On-Learning: The Domain Adaptation Dilemma: LoRA vs Full Fine-Tuning for Medical AI •60分钟
Project: Building and Optimizing a Domain-Specific Generative AI Assistant•60分钟
Coursera brings together a diverse network of subject matter experts who have demonstrated their expertise through professional industry experience or strong academic backgrounds. These instructors design and teach courses that make practical, career-relevant skills accessible to learners worldwide.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.