3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13041 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
109.8 KiB / 543835
Shuffle Write Size / Records:
145.0 B / 5
Associated Job Ids:
6442
DAG Visualization
digraph G { subgraph clusterstage_13041 { label="Stage 13041"; subgraph cluster84705 { label="AQEShuffleRead"; 35996 [labelType="html" label="ShuffledRowRDD [35996] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster84702 { label="WholeStageCodegen (3)"; 35997 [labelType="html" label="MapPartitionsRDD [35997] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster84710 { label="AQEShuffleRead"; 35998 [labelType="html" label="ShuffledRowRDD [35998] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster84707 { label="WholeStageCodegen (4)"; 35999 [labelType="html" label="MapPartitionsRDD [35999] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster84697 { label="WholeStageCodegen (5)"; 36000 [labelType="html" label="ZippedPartitionsRDD2 [36000] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 36001 [labelType="html" label="MapPartitionsRDD [36001] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster84696 { label="Exchange"; 36002 [labelType="html" label="MapPartitionsRDD [36002] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 35996->35997; 35998->35999; 35997->36000; 35999->36000; 36000->36001; 36001->36002; }
35991,35996
35995,35998
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time