3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15360 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
19.7 MiB / 259086
Shuffle Write Size / Records:
8.4 MiB / 175588
Associated Job Ids:
8076
DAG Visualization
digraph G { subgraph clusterstage_15360 { label="Stage 15360"; subgraph cluster99306 { label="Exchange"; 41933 [labelType="html" label="ShuffledRowRDD [41933] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99302 { label="WholeStageCodegen (12)"; 41934 [labelType="html" label="MapPartitionsRDD [41934] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99301 { label="Window"; 41935 [labelType="html" label="MapPartitionsRDD [41935] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99297 { label="WholeStageCodegen (13)"; 41936 [labelType="html" label="MapPartitionsRDD [41936] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99318 { label="AQEShuffleRead"; 41937 [labelType="html" label="ShuffledRowRDD [41937] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99315 { label="WholeStageCodegen (14)"; 41938 [labelType="html" label="MapPartitionsRDD [41938] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99325 { label="AQEShuffleRead"; 41939 [labelType="html" label="ShuffledRowRDD [41939] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99324 { label="ObjectHashAggregate"; 41940 [labelType="html" label="MapPartitionsRDD [41940] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99320 { label="WholeStageCodegen (15)"; 41941 [labelType="html" label="MapPartitionsRDD [41941] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99307 { label="WholeStageCodegen (16)"; 41942 [labelType="html" label="ZippedPartitionsRDD2 [41942] [Unordered]<br>parquet at PersistJob.java:35"]; 41943 [labelType="html" label="MapPartitionsRDD [41943] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99296 { label="Union"; 41944 [labelType="html" label="UnionRDD [41944] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99330 { label="Scan csv "; 41945 [labelType="html" label="FileScanRDD [41945]<br>parquet at PersistJob.java:35"]; 41946 [labelType="html" label="MapPartitionsRDD [41946]<br>parquet at PersistJob.java:35"]; } subgraph cluster99326 { label="WholeStageCodegen (17)"; 41947 [labelType="html" label="MapPartitionsRDD [41947]<br>parquet at PersistJob.java:35"]; } subgraph cluster99295 { label="CartesianProduct"; 41948 [labelType="html" label="UnsafeCartesianRDD [41948] [Unordered]<br>parquet at PersistJob.java:35"]; 41949 [labelType="html" label="MapPartitionsRDD [41949] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99294 { label="Exchange"; 41950 [labelType="html" label="MapPartitionsRDD [41950] [Unordered]<br>parquet at PersistJob.java:35"]; } } 41933->41934; 41934->41935; 41935->41936; 41937->41938; 41939->41940; 41940->41941; 41938->41942; 41941->41942; 41942->41943; 41936->41944; 41943->41944; 41945->41946; 41946->41947; 41944->41948; 41947->41948; 41948->41949; 41949->41950; }
41926,41933
41915,41937
41932,41939
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time