Chevron Left
返回到 Big Data Analysis with Scala and Spark

学生对 École Polytechnique Fédérale de Lausanne 提供的 Big Data Analysis with Scala and Spark 的评价和反馈

4.6
星
2,598 个评分

课程概述

Manipulating big data distributed over a cluster using functional concepts is rampant in industry, and is arguably one of the first widespread industrial uses of functional ideas. This is evidenced by the popularity of MapReduce and Hadoop, and most recently Apache Spark, a fast, in-memory distributed collections framework written in Scala. In this course, we'll see how the data parallel paradigm can be extended to the distributed case, using Spark throughout. We'll cover Spark's programming model in detail, being careful to understand how and when it differs from familiar programming models, like shared-memory parallel collections or sequential Scala collections. Through hands-on examples in Spark and Scala, we'll learn when important issues related to distribution like latency and network communication should be considered and how they can be addressed effectively for improved performance. Learning Outcomes. By the end of this course you will be able to: - read data from persistent storage and load it into Apache Spark, - manipulate data with Spark and Scala, - express algorithms for data analysis in a functional style, - recognize how to avoid shuffles and recomputation in Spark, Recommended background: You should have at least one year programming experience. Proficiency with Java or C# is ideal, but experience with other languages such as C/C++, Python, Javascript or Ruby is also sufficient. You should have some familiarity using the command line. This course is intended to be taken after Parallel Programming: https://hua.dididi.sbs/learn/parprog1....

热门审阅

CR

Apr 9, 2017

Great introduction to spark. Fun assignments. Since it was the first ever session, there were quite a few kinks with the assignments. But the discussion forums rescued me any time I was stuck.

SA

Sep 22, 2019

Awesome course and awesome teacher! Nevertheless, to grasp the most of this course, you should do the previous 3 courses of the "Functional Programming in Scala" specialization.

筛选依据：

301 - Big Data Analysis with Scala and Spark 的 325 个评论（共 512 个）

创建者 bechir n

•

Nov 21, 2020

It really helped me at Work

创建者 savitri v v

•

Jul 26, 2018

Very good learning portal

创建者 Jorge B C

•

May 1, 2017

Very interesting course!!

创建者 Peter S

•

Apr 2, 2017

Another fun Scala course!

创建者 Z

•

Mar 27, 2017

Very fun and informative!

创建者 Canh S L

•

Mar 25, 2017

really good, informative

创建者 vijay k k

•

May 7, 2018

Good course to learn it

创建者 Hermann H

•

Jul 19, 2017

Great material !!! ;-)

创建者 vikas s

•

Jul 28, 2017

awesome course content

创建者 Deleted A

•

Jun 26, 2017

Great course. Thanks!

创建者 Marija N

•

Jul 5, 2019

Absolutely fantastic!

创建者 Subodh C

•

Mar 29, 2019

Thanks Prof. Miller !

创建者 Nebiyou T

•

Dec 26, 2017

Very good instructor!

创建者 Dinesh G

•

Apr 2, 2017

good course on spark.

创建者 jose r

•

Nov 24, 2017

Great Course, thanks

创建者 Konstantin

•

May 29, 2017

Nice course, thanks!

创建者 Luis M M S

•

Feb 17, 2023

I loved this course

创建者 abhinav d

•

Dec 10, 2017

Wonderful course!!!

创建者 prashant b

•

Apr 7, 2017

very nicely taught

创建者 Manish M D

•

Sep 15, 2019

Excellent course.

创建者 DAVID J A

•

Mar 1, 2018

Simply brilliant.

创建者 Rajesh G

•

Dec 1, 2017

Excellent course!

创建者 Georgi Y

•

Jul 6, 2017

Excellent course!

创建者 Taneli L

•

Apr 9, 2017

Excellent course.

创建者 Tal G

•

Apr 8, 2017

Excellent teacher