3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 558 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
48.2 KiB / 236355
Shuffle Write Size / Records:
152.0 B / 5
Associated Job Ids:
403
DAG Visualization
digraph G { subgraph clusterstage_558 { label="Stage 558"; subgraph cluster3710 { label="AQEShuffleRead"; 1474 [labelType="html" label="ShuffledRowRDD [1474] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3707 { label="WholeStageCodegen (3)"; 1475 [labelType="html" label="MapPartitionsRDD [1475] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3715 { label="AQEShuffleRead"; 1476 [labelType="html" label="ShuffledRowRDD [1476] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3712 { label="WholeStageCodegen (4)"; 1477 [labelType="html" label="MapPartitionsRDD [1477] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3702 { label="WholeStageCodegen (5)"; 1478 [labelType="html" label="ZippedPartitionsRDD2 [1478] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 1479 [labelType="html" label="MapPartitionsRDD [1479] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3701 { label="Exchange"; 1480 [labelType="html" label="MapPartitionsRDD [1480] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 1474->1475; 1476->1477; 1475->1478; 1477->1478; 1478->1479; 1479->1480; }
1469,1474
1473,1476
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time