Production ML models failing your latency targets? Learn how to make them run 3-5x faster without losing accuracy. This course helps ML engineers and data scientists optimize neural network inference for real-world deployment—across mobile, edge, and cloud environments. If you face slow model inference, high infrastructure costs, or deployment constraints, this course provides practical solutions. You'll master profiling techniques to identify performance bottlenecks, apply quantization to cut precision requirements, and make smart trade-offs between speed, accuracy, and resource constraints. You'll learn to benchmark optimization techniques and select the right approach for deployment scenarios. You'll explore inference profiling and metrics, pruning strategies, and quantization methods. You'll practice with real-world cases—from streaming platforms to autonomous vehicles—using industry-standard tools like PyTorch Profiler, TensorRT, and pruning utilities.
This course is ideal for machine learning engineers, data scientists, and AI practitioners who are deploying or optimizing models in production. It’s also valuable for MLOps professionals and system engineers responsible for performance tuning in resource-constrained environments (e.g., mobile, embedded, or cloud inference systems).
Learners should have a good grasp of Python and basic experience with PyTorch or TensorFlow. Familiarity with machine learning concepts, such as model training and evaluation, is expected. Understanding how neural networks work and basic performance metrics like latency and accuracy will help you get the most from this course.
By the end of this course, you’ll confidently optimize production models, cut inference costs, meet latency goals, and deploy ML systems that scale efficiently.
In this module, learners will master profiling techniques to identify bottlenecks and understand the fundamental trade-offs in model inference optimization. You'll use industry-standard tools like PyTorch Profiler to diagnose where models waste time—whether in computation, memory bandwidth, or data transfer. By the end, you'll confidently analyze profiling data, prioritize optimization efforts, and establish performance baselines for production ML systems.
涵盖的内容
4个视频2篇阅读材料1次同伴评审
显示有关单元内容的信息
4个视频•总计34分钟
Course Intro: Optimize AI Inference Speed & Accuracy•4分钟
Understanding Inference Bottlenecks•7分钟
Profiling Tools in Action•11分钟
Evaluating ML Inference Performance in Production•12分钟
2篇阅读材料•总计10分钟
Welcome to the Course: Course Overview•5分钟
NVIDIA Deep Learning Performance Guide•5分钟
1次同伴评审•总计20分钟
Hands-On-Learning: Profile and Optimize Real-Time Fraud Detection System•20分钟
Model Pruning: Reducing Complexity Without Losing Power
第 2 单元•小时 后完成
单元详情
In this module, learners will master pruning techniques to reduce neural network complexity without sacrificing accuracy. You'll explore both structured and unstructured pruning approaches, implement them using PyTorch pruning utilities, and discover how to recover accuracy through fine-tuning and knowledge distillation. By the end, you'll confidently apply pruning to optimize models for resource-constrained environments like mobile devices and edge hardware.
涵盖的内容
3个视频1篇阅读材料1次同伴评审
显示有关单元内容的信息
3个视频•总计32分钟
Pruning Theory and Techniques•8分钟
Implementing Pruning in PyTorch•12分钟
Fine-tuning and Recovery Strategies•12分钟
1篇阅读材料•总计5分钟
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks•5分钟
1次同伴评审•总计20分钟
Hands-On-Learning: Prune and Deploy Mobile Image Classifier Under Size Constraints•20分钟
Quantization and Secure Deployment: Speed Meets Security
第 3 单元•小时 后完成
单元详情
In this module, learners will master quantization techniques to reduce numerical precision while maintaining model accuracy. You'll implement both post-training quantization and quantization-aware training using PyTorch, then compare quantization against pruning across speed, accuracy, and security dimensions. By the end, you'll understand how optimization choices affect adversarial robustness and confidently select the right technique for secure, high-performance deployments in mission-critical applications.
涵盖的内容
4个视频1篇阅读材料1个作业2次同伴评审
显示有关单元内容的信息
4个视频•总计41分钟
Quantization Fundamentals•11分钟
Implementing Quantization Workflows•12分钟
Benchmarking: Pruning vs Quantization•13分钟
Your Optimization Mastery•5分钟
1篇阅读材料•总计5分钟
Adversarial Robustness in Model Compression•5分钟
1个作业•总计20分钟
Optimize AI Inference Speed & Accuracy•20分钟
2次同伴评审•总计80分钟
Hands-On-Learning: Optimize and Deploy Real-Time Video Analytics with Quantization•20分钟
Project: Enterprise AI Inference Optimization: Production Deployment Under Constraints•60分钟
Coursera brings together a diverse network of subject matter experts who have demonstrated their expertise through professional industry experience or strong academic backgrounds. These instructors design and teach courses that make practical, career-relevant skills accessible to learners worldwide.
Inference optimization in this course means improving how a trained AI model runs at prediction time so it is faster and more efficient without giving up acceptable accuracy. The emphasis is on finding what slows inference down and choosing practical fixes for production use under latency and resource constraints.
When would you use inference optimization?
You would use inference optimization when a model performs well in development but is too slow, too heavy, or too expensive to run in its target environment. The course focuses on these situations in mobile, edge, and cloud deployment, where speed, memory, and accuracy have to be balanced.
How does inference optimization fit into a broader workflow?
Inference optimization fits after you already have a working model and before or during production deployment. In this course, it serves as the stage where you profile performance, set a baseline, and decide which changes will best meet runtime constraints.
How is inference optimization different from model training?
Model training is about learning a model's parameters, while inference optimization is about making that trained model run efficiently when it is used. Here, the focus shifts from improving training results to improving runtime behavior, resource use, and the speed-accuracy trade-off.
Do you need any prerequisites before learning inference optimization?
A basic understanding of Python, neural networks, and model training and evaluation is helpful before learning inference optimization. It also helps to be comfortable with basic performance ideas such as latency and accuracy, since the course assumes you are improving a model that already exists.
What tools, platforms, or methods are used in this course?
The course uses PyTorch-based tooling for profiling and optimization, along with production-oriented deployment tools. Method-wise, it focuses on profiling bottlenecks and model compression through pruning and quantization.
What specific tasks will you practice or complete in this course?
You practice profiling and interpreting inference performance, applying pruning or quantization, and benchmarking speed-accuracy trade-offs on trained models. You also validate the optimized model and turn your findings into a practical optimization plan for production deployment.