spark notes
search
⌘Ctrlk
spark notes
  • Introduction
  • Databricks
  • Concepts
  • Spark Execution Flow
  • Resilient Distributed Dataset (RDD)
  • Spark job submission breakdown
  • Why Cluster Manager
  • SparkContext and its components
  • Spark Architecture
  • Spark Deployment Modes
  • Running Modes
  • Spark Execution Flow
  • DataFrames, Datasets,RDDs
  • SparkSQL
  • Where Does Map Reduce Does not Fit
  • Actions
  • DataSets
  • Spark Application Garbage Collector
  • How Mapreduce works in spark
  • Notes
  • Scala
  • Spark 2.0
  • Types Of RDDs
  • Spark UI
  • Optimization
  • Spark Streaming
  • FlatMap - Different Variations
  • Examples
  • Testing Spark
  • Passing functions to Spark
  • CONFIGURATION, MONITORING, AND TUNING
  • References
gitbookPowered by GitBook
block-quoteOn this pagechevron-down

Spark job submission breakdown

Map Reduce Job

https://stackoverflow.com/questions/37528047/how-are-stages-split-into-tasks-in-spark?rq=1![](/assets/mr.pngarrow-up-right)

PreviousHow Many Partitions Does An RDD Havechevron-leftNextWhy Cluster Managerchevron-right

Last updated 6 years ago