3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16003 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 2
Shuffle Read Size / Records:
2.1 MiB / 122413
Shuffle Write Size / Records:
1681.7 KiB / 37268
Associated Job Ids:
7804
DAG Visualization
digraph G { subgraph clusterstage_16003 { label="Stage 16003"; subgraph cluster102031 { label="AQEShuffleRead"; 43587 [labelType="html" label="ShuffledRowRDD [43587] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102028 { label="WholeStageCodegen (7)"; 43588 [labelType="html" label="MapPartitionsRDD [43588] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102036 { label="AQEShuffleRead"; 43589 [labelType="html" label="ShuffledRowRDD [43589] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102033 { label="WholeStageCodegen (8)"; 43590 [labelType="html" label="MapPartitionsRDD [43590] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102024 { label="WholeStageCodegen (9)"; 43591 [labelType="html" label="ZippedPartitionsRDD2 [43591] [Unordered]<br>parquet at PersistJob.java:35"]; 43592 [labelType="html" label="MapPartitionsRDD [43592] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102023 { label="ObjectHashAggregate"; 43593 [labelType="html" label="MapPartitionsRDD [43593] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102022 { label="Exchange"; 43594 [labelType="html" label="MapPartitionsRDD [43594] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43587->43588; 43589->43590; 43588->43591; 43590->43591; 43591->43592; 43592->43593; 43593->43594; }
43578,43587
43582,43589
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time