3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14470 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
158.0 KiB / 788252
Shuffle Write Size / Records:
157.0 B / 5
Associated Job Ids:
7675
DAG Visualization
digraph G { subgraph clusterstage_14470 { label="Stage 14470"; subgraph cluster93677 { label="AQEShuffleRead"; 39491 [labelType="html" label="ShuffledRowRDD [39491] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster93674 { label="WholeStageCodegen (3)"; 39492 [labelType="html" label="MapPartitionsRDD [39492] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster93682 { label="AQEShuffleRead"; 39493 [labelType="html" label="ShuffledRowRDD [39493] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster93679 { label="WholeStageCodegen (4)"; 39494 [labelType="html" label="MapPartitionsRDD [39494] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster93669 { label="WholeStageCodegen (5)"; 39495 [labelType="html" label="ZippedPartitionsRDD2 [39495] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 39496 [labelType="html" label="MapPartitionsRDD [39496] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster93668 { label="Exchange"; 39497 [labelType="html" label="MapPartitionsRDD [39497] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 39491->39492; 39493->39494; 39492->39495; 39494->39495; 39495->39496; 39496->39497; }
39486,39491
39490,39493
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time