What are the down-sides of Spark? It sounds pretty good based on the rest of the lecture.
yuel1
From a recent 15-319 Project, Spark is not nearly as well documented as Hadoop. And unlike a fully functional languages you can't have nested RDDs which would be really nice for the programmer but a nightmare I'd imagine for the scheduler.
http://spark.apache.org
What are the down-sides of Spark? It sounds pretty good based on the rest of the lecture.
From a recent 15-319 Project, Spark is not nearly as well documented as Hadoop. And unlike a fully functional languages you can't have nested RDDs which would be really nice for the programmer but a nightmare I'd imagine for the scheduler.