spark notes
Ctrlk
  • Introduction
  • Databricks
  • Concepts
  • Spark Execution Flow
  • Resilient Distributed Dataset (RDD)
  • Spark job submission breakdown
  • Why Cluster Manager
  • SparkContext and its components
  • Spark Architecture
  • Spark Deployment Modes
  • Running Modes
  • Spark Execution Flow
  • DataFrames, Datasets,RDDs
  • SparkSQL
  • Where Does Map Reduce Does not Fit
  • Actions
  • DataSets
  • Spark Application Garbage Collector
  • How Mapreduce works in spark
  • Notes
  • Scala
  • Spark 2.0
  • Types Of RDDs
  • Spark UI
  • Optimization
  • Spark Streaming
  • FlatMap - Different Variations
  • Examples
  • Testing Spark
  • Passing functions to Spark
  • CONFIGURATION, MONITORING, AND TUNING
  • References
Powered by GitBook
On this page

Spark job submission breakdown

Map Reduce Job

https://stackoverflow.com/questions/37528047/how-are-stages-split-into-tasks-in-spark?rq=1![](/assets/mr.png)

PreviousHow Many Partitions Does An RDD HaveNextWhy Cluster Manager

Last updated 6 years ago

Was this helpful?

Was this helpful?