3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15328 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
19.7 MiB / 259086
Shuffle Write Size / Records:
8.4 MiB / 175588
Associated Job Ids:
8067
DAG Visualization
digraph G { subgraph clusterstage_15328 { label="Stage 15328"; subgraph cluster99098 { label="Exchange"; 41857 [labelType="html" label="ShuffledRowRDD [41857] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99094 { label="WholeStageCodegen (12)"; 41858 [labelType="html" label="MapPartitionsRDD [41858] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99093 { label="Window"; 41859 [labelType="html" label="MapPartitionsRDD [41859] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99089 { label="WholeStageCodegen (13)"; 41860 [labelType="html" label="MapPartitionsRDD [41860] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99110 { label="AQEShuffleRead"; 41861 [labelType="html" label="ShuffledRowRDD [41861] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99107 { label="WholeStageCodegen (14)"; 41862 [labelType="html" label="MapPartitionsRDD [41862] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99117 { label="AQEShuffleRead"; 41863 [labelType="html" label="ShuffledRowRDD [41863] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99116 { label="ObjectHashAggregate"; 41864 [labelType="html" label="MapPartitionsRDD [41864] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99112 { label="WholeStageCodegen (15)"; 41865 [labelType="html" label="MapPartitionsRDD [41865] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99099 { label="WholeStageCodegen (16)"; 41866 [labelType="html" label="ZippedPartitionsRDD2 [41866] [Unordered]<br>rdd at PersistJob.java:28"]; 41867 [labelType="html" label="MapPartitionsRDD [41867] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99088 { label="Union"; 41868 [labelType="html" label="UnionRDD [41868] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99122 { label="Scan csv "; 41869 [labelType="html" label="FileScanRDD [41869]<br>rdd at PersistJob.java:28"]; 41870 [labelType="html" label="MapPartitionsRDD [41870]<br>rdd at PersistJob.java:28"]; } subgraph cluster99118 { label="WholeStageCodegen (17)"; 41871 [labelType="html" label="MapPartitionsRDD [41871]<br>rdd at PersistJob.java:28"]; } subgraph cluster99087 { label="CartesianProduct"; 41872 [labelType="html" label="UnsafeCartesianRDD [41872] [Unordered]<br>rdd at PersistJob.java:28"]; 41873 [labelType="html" label="MapPartitionsRDD [41873] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99086 { label="Exchange"; 41874 [labelType="html" label="MapPartitionsRDD [41874] [Unordered]<br>rdd at PersistJob.java:28"]; } } 41857->41858; 41858->41859; 41859->41860; 41861->41862; 41863->41864; 41864->41865; 41862->41866; 41865->41866; 41866->41867; 41860->41868; 41867->41868; 41869->41870; 41870->41871; 41868->41872; 41871->41872; 41872->41873; 41873->41874; }
41850,41857
41839,41861
41856,41863
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time