3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17356 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Input Size / Records:
174.0 B / 1
Shuffle Read Size / Records:
7.6 KiB / 500
Shuffle Write Size / Records:
3.8 KiB / 177
Associated Job Ids:
9194
DAG Visualization
digraph G { subgraph clusterstage_17356 { label="Stage 17356"; subgraph cluster112995 { label="AQEShuffleRead"; 48045 [labelType="html" label="ShuffledRowRDD [48045] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112992 { label="WholeStageCodegen (17)"; 48046 [labelType="html" label="MapPartitionsRDD [48046] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113000 { label="AQEShuffleRead"; 48047 [labelType="html" label="ShuffledRowRDD [48047] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112997 { label="WholeStageCodegen (18)"; 48048 [labelType="html" label="MapPartitionsRDD [48048] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112988 { label="WholeStageCodegen (19)"; 48049 [labelType="html" label="ZippedPartitionsRDD2 [48049] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 48050 [labelType="html" label="MapPartitionsRDD [48050] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113005 { label="Scan csv "; 48051 [labelType="html" label="FileScanRDD [48051]<br>takeAsList at DataFrameCommonJob.java:145"]; 48052 [labelType="html" label="MapPartitionsRDD [48052]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113001 { label="WholeStageCodegen (20)"; 48053 [labelType="html" label="MapPartitionsRDD [48053]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112987 { label="CartesianProduct"; 48054 [labelType="html" label="UnsafeCartesianRDD [48054] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 48055 [labelType="html" label="MapPartitionsRDD [48055] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112984 { label="WholeStageCodegen (21)"; 48056 [labelType="html" label="MapPartitionsRDD [48056] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112983 { label="Exchange"; 48057 [labelType="html" label="MapPartitionsRDD [48057] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 48045->48046; 48047->48048; 48046->48049; 48048->48049; 48049->48050; 48051->48052; 48052->48053; 48050->48054; 48053->48054; 48054->48055; 48055->48056; 48056->48057; }
48040,48045
48044,48047
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time