3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14809 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
4.9 MiB / 85932
Shuffle Write Size / Records:
6.7 MiB / 85895
Associated Job Ids:
7850
DAG Visualization
digraph G { subgraph clusterstage_14809 { label="Stage 14809"; subgraph cluster95635 { label="AQEShuffleRead"; 40347 [labelType="html" label="ShuffledRowRDD [40347] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95632 { label="WholeStageCodegen (43)"; 40348 [labelType="html" label="MapPartitionsRDD [40348] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95640 { label="AQEShuffleRead"; 40349 [labelType="html" label="ShuffledRowRDD [40349] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95637 { label="WholeStageCodegen (44)"; 40350 [labelType="html" label="MapPartitionsRDD [40350] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95626 { label="WholeStageCodegen (45)"; 40351 [labelType="html" label="ZippedPartitionsRDD2 [40351] [Unordered]<br>rdd at PersistJob.java:28"]; 40352 [labelType="html" label="MapPartitionsRDD [40352] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95645 { label="AQEShuffleRead"; 40353 [labelType="html" label="ShuffledRowRDD [40353] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95642 { label="WholeStageCodegen (46)"; 40354 [labelType="html" label="MapPartitionsRDD [40354] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95621 { label="WholeStageCodegen (47)"; 40355 [labelType="html" label="ZippedPartitionsRDD2 [40355] [Unordered]<br>rdd at PersistJob.java:28"]; 40356 [labelType="html" label="MapPartitionsRDD [40356] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95620 { label="Exchange"; 40357 [labelType="html" label="MapPartitionsRDD [40357] [Unordered]<br>rdd at PersistJob.java:28"]; } } 40347->40348; 40349->40350; 40348->40351; 40350->40351; 40351->40352; 40353->40354; 40352->40355; 40354->40355; 40355->40356; 40356->40357; }
40346,40347
40265,40349
40269,40353
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time