Chevron Left
返回到 Big Data Analysis with Scala and Spark

学生对 École Polytechnique Fédérale de Lausanne 提供的 Big Data Analysis with Scala and Spark 的评价和反馈

4.6
星
2,595 个评分

课程概述

Manipulating big data distributed over a cluster using functional concepts is rampant in industry, and is arguably one of the first widespread industrial uses of functional ideas. This is evidenced by the popularity of MapReduce and Hadoop, and most recently Apache Spark, a fast, in-memory distributed collections framework written in Scala. In this course, we'll see how the data parallel paradigm can be extended to the distributed case, using Spark throughout. We'll cover Spark's programming model in detail, being careful to understand how and when it differs from familiar programming models, like shared-memory parallel collections or sequential Scala collections. Through hands-on examples in Spark and Scala, we'll learn when important issues related to distribution like latency and network communication should be considered and how they can be addressed effectively for improved performance. Learning Outcomes. By the end of this course you will be able to: - read data from persistent storage and load it into Apache Spark, - manipulate data with Spark and Scala, - express algorithms for data analysis in a functional style, - recognize how to avoid shuffles and recomputation in Spark, Recommended background: You should have at least one year programming experience. Proficiency with Java or C# is ideal, but experience with other languages such as C/C++, Python, Javascript or Ruby is also sufficient. You should have some familiarity using the command line. This course is intended to be taken after Parallel Programming: https://hua.dididi.sbs/learn/parprog1....

热门审阅

CH

Nov 16, 2017

although spark part is taught nicely, it also takes a lot of time to understand the sql part and remember a lot of sql operations as a zero background man in sql

NG

Mar 27, 2017

goot as introduction about spark and big data. Small notice: it is incorrect to compare performance hadoop and spark. As I understand, spark was expected to be compacred with MapReduce.

筛选依据：

226 - Big Data Analysis with Scala and Spark 的 250 个评论（共 511 个）

创建者 Sivakumar P

•

Nov 29, 2018

Course is very useful to understand Spark and Scala things.

创建者 Giang N

•

Sep 23, 2021

Great assigments make me work hard to earn perfect points

创建者 passionbytes b

•

Sep 14, 2017

Superb course..very detailed and useful.. highly recommend

创建者 Ravi S

•

Jul 6, 2017

Course material is pretty good. Week 2 assignment is hard.

创建者 Nikhil R

•

Nov 9, 2019

Helpful for anyoe who wants to start with basics of Spark

创建者 Art P

•

Mar 10, 2018

Thank you! Some additional examples would be appreciable.

创建者 Evaldas M

•

Apr 8, 2017

great course, finally understand what spark is all about!

创建者 GIORGIO L

•

May 27, 2020

Very good course to understand Apache Spark using scala.

创建者 Charmy g

•

Jan 13, 2020

Loved it all!! Thanks for the good information on Spark.

创建者 Ismail I

•

Apr 9, 2017

A very interesting and useful course.

Highly Recommended!

创建者 sheng w

•

Jan 10, 2019

Very useful course and great materials and assignments.

创建者 Pushkin G

•

May 6, 2018

Very useful lessons. Great way to get started on Spark.

创建者 Faiaz S

•

Jul 13, 2017

There is some little mistakes in course(like on slides)

创建者 David A

•

Apr 28, 2020

Excellent material and challenging exercises, love it!

创建者 Mohamed B

•

Jun 30, 2020

Amazing course, thanks for the professor and Coursera

创建者 Anand S

•

Aug 14, 2018

good implementation of programming knowledge recieved

创建者 Oleg O

•

Jul 29, 2017

Good course, but sometime there are too much details.

创建者 Ravikumar

•

Apr 9, 2017

It is very good course material for Spark with scala.

创建者 Dmitriy K

•

Mar 20, 2017

Thanks Heather! You did a great job with this course.

创建者 Robson R S P

•

Apr 12, 2020

If you are a spark beginner, this is a great course.

创建者 Alexey A

•

Jul 13, 2019

The most interesting course in whole specialization.

创建者 李东恒

•

Jan 24, 2020

Very good course for learning and practicing Spark.

创建者 Yuri R

•

Oct 24, 2019

Liked the course. Wasn't familiar with spark before

创建者 Cliff R

•

Jul 22, 2018

Gives a good grounding in the fundamentals of Spark

创建者 Kovalenko S

•

Jul 17, 2017

Курс очень понравился, спасибо большое за ваш труд!