3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8262 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1697.0 B / 21
Shuffle Write Size / Records:
937.0 B / 7
Associated Job Ids:
3899
DAG Visualization
digraph G { subgraph clusterstage_8262 { label="Stage 8262"; subgraph cluster50993 { label="AQEShuffleRead"; 21962 [labelType="html" label="ShuffledRowRDD [21962] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50990 { label="WholeStageCodegen (31)"; 21963 [labelType="html" label="MapPartitionsRDD [21963] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50998 { label="AQEShuffleRead"; 21964 [labelType="html" label="ShuffledRowRDD [21964] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50995 { label="WholeStageCodegen (32)"; 21965 [labelType="html" label="MapPartitionsRDD [21965] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50984 { label="WholeStageCodegen (33)"; 21966 [labelType="html" label="ZippedPartitionsRDD2 [21966] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 21967 [labelType="html" label="MapPartitionsRDD [21967] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster51003 { label="AQEShuffleRead"; 21968 [labelType="html" label="ShuffledRowRDD [21968] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster51000 { label="WholeStageCodegen (34)"; 21969 [labelType="html" label="MapPartitionsRDD [21969] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50979 { label="WholeStageCodegen (35)"; 21970 [labelType="html" label="ZippedPartitionsRDD2 [21970] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 21971 [labelType="html" label="MapPartitionsRDD [21971] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50978 { label="Exchange"; 21972 [labelType="html" label="MapPartitionsRDD [21972] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 21962->21963; 21964->21965; 21963->21966; 21965->21966; 21966->21967; 21968->21969; 21967->21970; 21969->21970; 21970->21971; 21971->21972; }
21961,21962
21895,21964
21901,21968
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time