3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 20986 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
42 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
339.1 KiB / 21591
Shuffle Write Size / Records:
334.2 KiB / 21131
Associated Job Ids:
10501
DAG Visualization
digraph G { subgraph clusterstage_20986 { label="Stage 20986"; subgraph cluster137664 { label="AQEShuffleRead"; 59706 [labelType="html" label="ShuffledRowRDD [59706] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137661 { label="WholeStageCodegen (8)"; 59707 [labelType="html" label="MapPartitionsRDD [59707] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137670 { label="AQEShuffleRead"; 59708 [labelType="html" label="ShuffledRowRDD [59708] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137666 { label="WholeStageCodegen (9)"; 59709 [labelType="html" label="MapPartitionsRDD [59709] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137657 { label="WholeStageCodegen (10)"; 59710 [labelType="html" label="ZippedPartitionsRDD2 [59710] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 59711 [labelType="html" label="MapPartitionsRDD [59711] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137656 { label="Exchange"; 59712 [labelType="html" label="MapPartitionsRDD [59712] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 59706->59707; 59708->59709; 59707->59710; 59709->59710; 59710->59711; 59711->59712; }
59705,59706
59694,59708
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time