3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16704 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 9
Input Size / Records:
1575.0 B / 9
Shuffle Read Size / Records:
22.0 MiB / 1115964
Shuffle Write Size / Records:
4.1 MiB / 270457
Associated Job Ids:
8135
DAG Visualization
digraph G { subgraph clusterstage_16704 { label="Stage 16704"; subgraph cluster106692 { label="AQEShuffleRead"; 45536 [labelType="html" label="ShuffledRowRDD [45536] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106689 { label="WholeStageCodegen (4)"; 45537 [labelType="html" label="MapPartitionsRDD [45537] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106697 { label="AQEShuffleRead"; 45538 [labelType="html" label="ShuffledRowRDD [45538] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106694 { label="WholeStageCodegen (5)"; 45539 [labelType="html" label="MapPartitionsRDD [45539] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106685 { label="WholeStageCodegen (6)"; 45540 [labelType="html" label="ZippedPartitionsRDD2 [45540] [Unordered]<br>parquet at PersistJob.java:35"]; 45541 [labelType="html" label="MapPartitionsRDD [45541] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106702 { label="Scan csv "; 45542 [labelType="html" label="FileScanRDD [45542]<br>parquet at PersistJob.java:35"]; 45543 [labelType="html" label="MapPartitionsRDD [45543]<br>parquet at PersistJob.java:35"]; } subgraph cluster106698 { label="WholeStageCodegen (7)"; 45544 [labelType="html" label="MapPartitionsRDD [45544]<br>parquet at PersistJob.java:35"]; } subgraph cluster106684 { label="CartesianProduct"; 45545 [labelType="html" label="UnsafeCartesianRDD [45545] [Unordered]<br>parquet at PersistJob.java:35"]; 45546 [labelType="html" label="MapPartitionsRDD [45546] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106679 { label="WholeStageCodegen (8)"; 45547 [labelType="html" label="MapPartitionsRDD [45547] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106678 { label="Exchange"; 45548 [labelType="html" label="MapPartitionsRDD [45548] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45536->45537; 45538->45539; 45537->45540; 45539->45540; 45540->45541; 45542->45543; 45543->45544; 45541->45545; 45544->45545; 45545->45546; 45546->45547; 45547->45548; }
45527,45536
45531,45538
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time