3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14886 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
5.5 MiB / 86170
Shuffle Write Size / Records:
4.9 MiB / 85895
Associated Job Ids:
7869
DAG Visualization
digraph G { subgraph clusterstage_14886 { label="Stage 14886"; subgraph cluster95898 { label="AQEShuffleRead"; 40480 [labelType="html" label="ShuffledRowRDD [40480] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95895 { label="WholeStageCodegen (38)"; 40481 [labelType="html" label="MapPartitionsRDD [40481] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95903 { label="AQEShuffleRead"; 40482 [labelType="html" label="ShuffledRowRDD [40482] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95900 { label="WholeStageCodegen (39)"; 40483 [labelType="html" label="MapPartitionsRDD [40483] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95891 { label="WholeStageCodegen (40)"; 40484 [labelType="html" label="ZippedPartitionsRDD2 [40484] [Unordered]<br>parquet at PersistJob.java:35"]; 40485 [labelType="html" label="MapPartitionsRDD [40485] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95908 { label="AQEShuffleRead"; 40486 [labelType="html" label="ShuffledRowRDD [40486] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95905 { label="WholeStageCodegen (41)"; 40487 [labelType="html" label="MapPartitionsRDD [40487] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95885 { label="WholeStageCodegen (42)"; 40488 [labelType="html" label="ZippedPartitionsRDD2 [40488] [Unordered]<br>parquet at PersistJob.java:35"]; 40489 [labelType="html" label="MapPartitionsRDD [40489] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95884 { label="Exchange"; 40490 [labelType="html" label="MapPartitionsRDD [40490] [Unordered]<br>parquet at PersistJob.java:35"]; } } 40480->40481; 40482->40483; 40481->40484; 40483->40484; 40484->40485; 40486->40487; 40485->40488; 40487->40488; 40488->40489; 40489->40490; }
40479,40480
40402,40482
40406,40486
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time