Few Spark Concepts :

  1. Spark SQL Execution Plan
  2. Lineage Vs. Dag
  3. Narrow Vs. Wide Dependency
  4. How Does Spark Read Large File

1. SPARK SQL EXECUTION PLAN:

2. LINEAGE vs. DAG:

3. NARROW and WIDE DEPENDENCIES:

4. HOW DOES SPARK READ LARGE FILE?

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Nabarun Chakraborti

Nabarun Chakraborti

Big Data Solution Architect and pySpark Developer