3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15770 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Any: 1
Input Size / Records:
110.0 B / 1
Shuffle Read Size / Records:
1737.3 KiB / 48729
Shuffle Write Size / Records:
1433.7 KiB / 21885
Associated Job Ids:
7987
DAG Visualization
digraph G { subgraph clusterstage_15770 { label="Stage 15770"; subgraph cluster103160 { label="AQEShuffleRead"; 44142 [labelType="html" label="ShuffledRowRDD [44142] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103157 { label="WholeStageCodegen (60)"; 44143 [labelType="html" label="MapPartitionsRDD [44143] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103156 { label="Window"; 44144 [labelType="html" label="MapPartitionsRDD [44144] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103150 { label="WholeStageCodegen (61)"; 44145 [labelType="html" label="MapPartitionsRDD [44145] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103165 { label="Scan csv "; 44146 [labelType="html" label="FileScanRDD [44146]<br>rdd at PersistJob.java:28"]; 44147 [labelType="html" label="MapPartitionsRDD [44147]<br>rdd at PersistJob.java:28"]; } subgraph cluster103161 { label="WholeStageCodegen (62)"; 44148 [labelType="html" label="MapPartitionsRDD [44148]<br>rdd at PersistJob.java:28"]; } subgraph cluster103149 { label="CartesianProduct"; 44149 [labelType="html" label="UnsafeCartesianRDD [44149] [Unordered]<br>rdd at PersistJob.java:28"]; 44150 [labelType="html" label="MapPartitionsRDD [44150] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103148 { label="Exchange"; 44151 [labelType="html" label="MapPartitionsRDD [44151] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44142->44143; 44143->44144; 44144->44145; 44146->44147; 44147->44148; 44145->44149; 44148->44149; 44149->44150; 44150->44151; }
44141,44142
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time