3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15368 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
18 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
28.5 MiB / 598988
Shuffle Read Size / Records:
8.4 MiB / 175588
Associated Job Ids:
8077
DAG Visualization
digraph G { subgraph clusterstage_15368 { label="Stage 15368"; subgraph cluster99352 { label="AQEShuffleRead"; 41951 [labelType="html" label="ShuffledRowRDD [41951] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99349 { label="WholeStageCodegen (18)"; 41952 [labelType="html" label="MapPartitionsRDD [41952] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99348 { label="Window"; 41953 [labelType="html" label="MapPartitionsRDD [41953] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99346 { label="Filter"; 41954 [labelType="html" label="MapPartitionsRDD [41954] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99345 { label="Project"; 41955 [labelType="html" label="MapPartitionsRDD [41955] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99344 { label="Project"; 41956 [labelType="html" label="MapPartitionsRDD [41956] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99343 { label="Project"; 41957 [labelType="html" label="MapPartitionsRDD [41957] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99342 { label="Project"; 41958 [labelType="html" label="MapPartitionsRDD [41958] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99341 { label="Project"; 41959 [labelType="html" label="MapPartitionsRDD [41959] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99358 { label="Scan parquet "; 41960 [labelType="html" label="FileScanRDD [41960]<br>parquet at PersistJob.java:35"]; 41961 [labelType="html" label="MapPartitionsRDD [41961]<br>parquet at PersistJob.java:35"]; } subgraph cluster99353 { label="WholeStageCodegen (20)"; 41962 [labelType="html" label="MapPartitionsRDD [41962]<br>parquet at PersistJob.java:35"]; } subgraph cluster99332 { label="Union"; 41963 [labelType="html" label="UnionRDD [41963] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster99331 { label="Exchange"; 41964 [labelType="html" label="MapPartitionsRDD [41964] [Unordered]<br>parquet at PersistJob.java:35"]; 41965 [labelType="html" label="MapPartitionsRDD [41965] [Unordered]<br>parquet at PersistJob.java:35"]; 41966 [labelType="html" label="MapPartitionsRDD [41966] [Unordered]<br>parquet at PersistJob.java:35"]; } } 41951->41952; 41952->41953; 41953->41954; 41954->41955; 41955->41956; 41956->41957; 41957->41958; 41958->41959; 41960->41961; 41961->41962; 41959->41963; 41962->41963; 41963->41964; 41964->41965; 41965->41966; }
41950,41951
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time