3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7851 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
12 ms
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.9 KiB / 533
Shuffle Write Size / Records:
4.2 KiB / 210
Associated Job Ids:
3840
DAG Visualization
digraph G { subgraph clusterstage_7851 { label="Stage 7851"; subgraph cluster51273 { label="AQEShuffleRead"; 22676 [labelType="html" label="ShuffledRowRDD [22676] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51270 { label="WholeStageCodegen (17)"; 22677 [labelType="html" label="MapPartitionsRDD [22677] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51278 { label="AQEShuffleRead"; 22678 [labelType="html" label="ShuffledRowRDD [22678] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51275 { label="WholeStageCodegen (18)"; 22679 [labelType="html" label="MapPartitionsRDD [22679] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51266 { label="WholeStageCodegen (19)"; 22680 [labelType="html" label="ZippedPartitionsRDD2 [22680] [Unordered]<br>parquet at PersistJob.java:35"]; 22681 [labelType="html" label="MapPartitionsRDD [22681] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51283 { label="Scan csv "; 22682 [labelType="html" label="FileScanRDD [22682]<br>parquet at PersistJob.java:35"]; 22683 [labelType="html" label="MapPartitionsRDD [22683]<br>parquet at PersistJob.java:35"]; } subgraph cluster51279 { label="WholeStageCodegen (20)"; 22684 [labelType="html" label="MapPartitionsRDD [22684]<br>parquet at PersistJob.java:35"]; } subgraph cluster51265 { label="CartesianProduct"; 22685 [labelType="html" label="UnsafeCartesianRDD [22685] [Unordered]<br>parquet at PersistJob.java:35"]; 22686 [labelType="html" label="MapPartitionsRDD [22686] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51262 { label="WholeStageCodegen (21)"; 22687 [labelType="html" label="MapPartitionsRDD [22687] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51261 { label="Exchange"; 22688 [labelType="html" label="MapPartitionsRDD [22688] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22676->22677; 22678->22679; 22677->22680; 22679->22680; 22680->22681; 22682->22683; 22683->22684; 22681->22685; 22684->22685; 22685->22686; 22686->22687; 22687->22688; }
22671,22676
22675,22678
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time