3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 10397 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
12 s
Locality Level Summary:
Any: 7
Shuffle Read Size / Records:
20.2 MiB / 790666
Shuffle Write Size / Records:
20.2 MiB / 790389
Associated Job Ids:
4555
DAG Visualization
digraph G { subgraph clusterstage_10397 { label="Stage 10397"; subgraph cluster60818 { label="AQEShuffleRead"; 25770 [labelType="html" label="ShuffledRowRDD [25770] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60815 { label="WholeStageCodegen (24)"; 25771 [labelType="html" label="MapPartitionsRDD [25771] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60823 { label="AQEShuffleRead"; 25772 [labelType="html" label="ShuffledRowRDD [25772] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60820 { label="WholeStageCodegen (25)"; 25773 [labelType="html" label="MapPartitionsRDD [25773] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60811 { label="WholeStageCodegen (26)"; 25774 [labelType="html" label="ZippedPartitionsRDD2 [25774] [Unordered]<br>parquet at PersistJob.java:35"]; 25775 [labelType="html" label="MapPartitionsRDD [25775] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60828 { label="AQEShuffleRead"; 25776 [labelType="html" label="ShuffledRowRDD [25776] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60825 { label="WholeStageCodegen (27)"; 25777 [labelType="html" label="MapPartitionsRDD [25777] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60807 { label="WholeStageCodegen (28)"; 25778 [labelType="html" label="ZippedPartitionsRDD2 [25778] [Unordered]<br>parquet at PersistJob.java:35"]; 25779 [labelType="html" label="MapPartitionsRDD [25779] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60833 { label="AQEShuffleRead"; 25780 [labelType="html" label="ShuffledRowRDD [25780] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60830 { label="WholeStageCodegen (29)"; 25781 [labelType="html" label="MapPartitionsRDD [25781] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60803 { label="WholeStageCodegen (30)"; 25782 [labelType="html" label="ZippedPartitionsRDD2 [25782] [Unordered]<br>parquet at PersistJob.java:35"]; 25783 [labelType="html" label="MapPartitionsRDD [25783] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60802 { label="Exchange"; 25784 [labelType="html" label="MapPartitionsRDD [25784] [Unordered]<br>parquet at PersistJob.java:35"]; } } 25770->25771; 25772->25773; 25771->25774; 25773->25774; 25774->25775; 25776->25777; 25775->25778; 25777->25778; 25778->25779; 25780->25781; 25779->25782; 25781->25782; 25782->25783; 25783->25784; }
25769,25770
25720,25772
25724,25776
25728,25780
Event Timeline
Enable zooming
Tasks: 7. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time