Chevron Left
返回到 Big Data Analysis with Scala and Spark

学生对 École Polytechnique Fédérale de Lausanne 提供的 Big Data Analysis with Scala and Spark 的评价和反馈

4.6
2,595 个评分

课程概述

Manipulating big data distributed over a cluster using functional concepts is rampant in industry, and is arguably one of the first widespread industrial uses of functional ideas. This is evidenced by the popularity of MapReduce and Hadoop, and most recently Apache Spark, a fast, in-memory distributed collections framework written in Scala. In this course, we'll see how the data parallel paradigm can be extended to the distributed case, using Spark throughout. We'll cover Spark's programming model in detail, being careful to understand how and when it differs from familiar programming models, like shared-memory parallel collections or sequential Scala collections. Through hands-on examples in Spark and Scala, we'll learn when important issues related to distribution like latency and network communication should be considered and how they can be addressed effectively for improved performance. Learning Outcomes. By the end of this course you will be able to: - read data from persistent storage and load it into Apache Spark, - manipulate data with Spark and Scala, - express algorithms for data analysis in a functional style, - recognize how to avoid shuffles and recomputation in Spark, Recommended background: You should have at least one year programming experience. Proficiency with Java or C# is ideal, but experience with other languages such as C/C++, Python, Javascript or Ruby is also sufficient. You should have some familiarity using the command line. This course is intended to be taken after Parallel Programming: https://hua.dididi.sbs/learn/parprog1....

热门审阅

MP

Apr 8, 2017

Excellent material. Very good flow. Heather has an amazing way of walking through the flow and simplifying the concepts. Great assignments -- takes a bit longer than 3 hours.

WD

Dec 31, 2017

Great course to get going with Apache Spark. Would recommend to someone who has java or scala experience already and wants to learn about distributed processing.

筛选依据:

176 - Big Data Analysis with Scala and Spark 的 200 个评论(共 511 个)

创建者 Adel b

Apr 16, 2019

Everything was excellent. This was one of the best courses I have attended so far

创建者 Ark K

Aug 6, 2017

Very good for Scala beginners and students who are entering the world of Big Data

创建者 Nicolas D

Apr 13, 2017

Amazingly polished and well taught course although being given for the first time

创建者 Joseph C A A

Apr 7, 2017

Excelente curso, muy bien material y explicado de manera muy dinámica y practica.

创建者 Victoire T

Oct 21, 2022

Detailed and clair explanation given by the lecturice. Challenging exercices.

创建者 Симкин И М

Mar 10, 2019

Perfectly. Very competent teacher and good tasks. Requires knowledge of scala.

创建者 Javier R C

Jun 30, 2017

Great introduction to Spark. Very interesting lectures, slides and assignments

创建者 Andrzej J

Mar 20, 2017

Great course, presentations prepared with passion, exercise of right level....

创建者 Aitor G N

Sep 27, 2021

Buen curso, recomiendo saber o tener bases de scala, sino te pierdes un poco

创建者 Fábio A R

May 13, 2019

Excellent course, very handful for whoever is starting his studies in spark.

创建者 Alberto C B

Jun 30, 2018

Great introductory course on Spark with Scala. Touched many important things

创建者 Arthur-Lance

Sep 15, 2018

really great course, it help me fast get into the new area. thanks a lot!!!

创建者 Giuliano C

Jul 2, 2017

Excellent course, my only suggestion would be to split week 4 into 2 weeks

创建者 Teng Z

Oct 19, 2024

Good course with well-designed assignments, I got a lot from this course!

创建者 Matthias T

Aug 17, 2017

Great introduction to Spark accessed through Scala. Didactically awesome.

创建者 Andreas K

Jul 26, 2017

It was a pleasure to follow the video lectures and solve the assignments.

创建者 Ramesh K

Apr 23, 2017

Instructor has been explaining the concepts with more practical direction

创建者 Fabio P

Jun 2, 2020

Best course so far in the Functional Programming in Scala Specialization

创建者 Karim M

Oct 15, 2018

Amazing course, i learned a lot even if i'm working with scala and spark

创建者 Deleted A

Jul 11, 2017

Easy to follow. Really well explained and planned. Strongly recommended.

创建者 Ronald C M

May 13, 2019

The best way to get to know Spark Fundamentals and Spark Core libraries

创建者 Francisco D

May 6, 2018

Accurate content and good explanations. I have got fun with this course

创建者 Mostafa J

Jun 12, 2017

Very challenging but I learned a lot.

Thanks a lot, Dr. Heather Miller!

创建者 AOC

May 17, 2019

Very engaging and tutor showed excellent delivery. thanks to Coursera.

创建者 Rafa M

Jun 19, 2017

Content was useful, overall a good course. Lectures were kind of dull.