3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9236 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1697.0 B / 21
Shuffle Write Size / Records:
937.0 B / 7
Associated Job Ids:
4205
DAG Visualization
digraph G { subgraph clusterstage_9236 { label="Stage 9236"; subgraph cluster55573 { label="AQEShuffleRead"; 23730 [labelType="html" label="ShuffledRowRDD [23730] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55570 { label="WholeStageCodegen (31)"; 23731 [labelType="html" label="MapPartitionsRDD [23731] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55578 { label="AQEShuffleRead"; 23732 [labelType="html" label="ShuffledRowRDD [23732] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55575 { label="WholeStageCodegen (32)"; 23733 [labelType="html" label="MapPartitionsRDD [23733] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55564 { label="WholeStageCodegen (33)"; 23734 [labelType="html" label="ZippedPartitionsRDD2 [23734] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 23735 [labelType="html" label="MapPartitionsRDD [23735] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55583 { label="AQEShuffleRead"; 23736 [labelType="html" label="ShuffledRowRDD [23736] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55580 { label="WholeStageCodegen (34)"; 23737 [labelType="html" label="MapPartitionsRDD [23737] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55559 { label="WholeStageCodegen (35)"; 23738 [labelType="html" label="ZippedPartitionsRDD2 [23738] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 23739 [labelType="html" label="MapPartitionsRDD [23739] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55558 { label="Exchange"; 23740 [labelType="html" label="MapPartitionsRDD [23740] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 23730->23731; 23732->23733; 23731->23734; 23733->23734; 23734->23735; 23736->23737; 23735->23738; 23737->23738; 23738->23739; 23739->23740; }
23729,23730
23674,23732
23678,23736
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time