3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14905 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
4.9 MiB / 85932
Shuffle Write Size / Records:
6.7 MiB / 85895
Associated Job Ids:
7870
DAG Visualization
digraph G { subgraph clusterstage_14905 { label="Stage 14905"; subgraph cluster95924 { label="AQEShuffleRead"; 40491 [labelType="html" label="ShuffledRowRDD [40491] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95921 { label="WholeStageCodegen (43)"; 40492 [labelType="html" label="MapPartitionsRDD [40492] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95929 { label="AQEShuffleRead"; 40493 [labelType="html" label="ShuffledRowRDD [40493] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95926 { label="WholeStageCodegen (44)"; 40494 [labelType="html" label="MapPartitionsRDD [40494] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95915 { label="WholeStageCodegen (45)"; 40495 [labelType="html" label="ZippedPartitionsRDD2 [40495] [Unordered]<br>parquet at PersistJob.java:35"]; 40496 [labelType="html" label="MapPartitionsRDD [40496] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95934 { label="AQEShuffleRead"; 40497 [labelType="html" label="ShuffledRowRDD [40497] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95931 { label="WholeStageCodegen (46)"; 40498 [labelType="html" label="MapPartitionsRDD [40498] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95910 { label="WholeStageCodegen (47)"; 40499 [labelType="html" label="ZippedPartitionsRDD2 [40499] [Unordered]<br>parquet at PersistJob.java:35"]; 40500 [labelType="html" label="MapPartitionsRDD [40500] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95909 { label="Exchange"; 40501 [labelType="html" label="MapPartitionsRDD [40501] [Unordered]<br>parquet at PersistJob.java:35"]; } } 40491->40492; 40493->40494; 40492->40495; 40494->40495; 40495->40496; 40497->40498; 40496->40499; 40498->40499; 40499->40500; 40500->40501; }
40490,40491
40414,40493
40418,40497
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time