3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14790 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
5.5 MiB / 86170
Shuffle Write Size / Records:
4.9 MiB / 85895
Associated Job Ids:
7849
DAG Visualization
digraph G { subgraph clusterstage_14790 { label="Stage 14790"; subgraph cluster95609 { label="AQEShuffleRead"; 40336 [labelType="html" label="ShuffledRowRDD [40336] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95606 { label="WholeStageCodegen (38)"; 40337 [labelType="html" label="MapPartitionsRDD [40337] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95614 { label="AQEShuffleRead"; 40338 [labelType="html" label="ShuffledRowRDD [40338] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95611 { label="WholeStageCodegen (39)"; 40339 [labelType="html" label="MapPartitionsRDD [40339] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95602 { label="WholeStageCodegen (40)"; 40340 [labelType="html" label="ZippedPartitionsRDD2 [40340] [Unordered]<br>rdd at PersistJob.java:28"]; 40341 [labelType="html" label="MapPartitionsRDD [40341] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95619 { label="AQEShuffleRead"; 40342 [labelType="html" label="ShuffledRowRDD [40342] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95616 { label="WholeStageCodegen (41)"; 40343 [labelType="html" label="MapPartitionsRDD [40343] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95596 { label="WholeStageCodegen (42)"; 40344 [labelType="html" label="ZippedPartitionsRDD2 [40344] [Unordered]<br>rdd at PersistJob.java:28"]; 40345 [labelType="html" label="MapPartitionsRDD [40345] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster95595 { label="Exchange"; 40346 [labelType="html" label="MapPartitionsRDD [40346] [Unordered]<br>rdd at PersistJob.java:28"]; } } 40336->40337; 40338->40339; 40337->40340; 40339->40340; 40340->40341; 40342->40343; 40341->40344; 40343->40344; 40344->40345; 40345->40346; }
40335,40336
40253,40338
40257,40342
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time