3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12817 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
696.6 KiB / 73164
Shuffle Write Size / Records:
628.8 KiB / 73164
Associated Job Ids:
6297
DAG Visualization
digraph G { subgraph clusterstage_12817 { label="Stage 12817"; subgraph cluster82942 { label="AQEShuffleRead"; 35262 [labelType="html" label="ShuffledRowRDD [35262] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82939 { label="WholeStageCodegen (4)"; 35263 [labelType="html" label="MapPartitionsRDD [35263] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82938 { label="Window"; 35264 [labelType="html" label="MapPartitionsRDD [35264] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82934 { label="WholeStageCodegen (5)"; 35265 [labelType="html" label="MapPartitionsRDD [35265] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82947 { label="Scan csv "; 35266 [labelType="html" label="FileScanRDD [35266]<br>parquet at PersistJob.java:35"]; 35267 [labelType="html" label="MapPartitionsRDD [35267]<br>parquet at PersistJob.java:35"]; } subgraph cluster82943 { label="WholeStageCodegen (6)"; 35268 [labelType="html" label="MapPartitionsRDD [35268]<br>parquet at PersistJob.java:35"]; } subgraph cluster82933 { label="CartesianProduct"; 35269 [labelType="html" label="UnsafeCartesianRDD [35269] [Unordered]<br>parquet at PersistJob.java:35"]; 35270 [labelType="html" label="MapPartitionsRDD [35270] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82926 { label="WholeStageCodegen (7)"; 35271 [labelType="html" label="MapPartitionsRDD [35271] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82925 { label="Exchange"; 35272 [labelType="html" label="MapPartitionsRDD [35272] [Unordered]<br>parquet at PersistJob.java:35"]; } } 35262->35263; 35263->35264; 35264->35265; 35266->35267; 35267->35268; 35265->35269; 35268->35269; 35269->35270; 35270->35271; 35271->35272; }
35251,35262
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time