3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12863 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.9 KiB / 533
Shuffle Write Size / Records:
4.1 KiB / 210
Associated Job Ids:
6325
DAG Visualization
digraph G { subgraph clusterstage_12863 { label="Stage 12863"; subgraph cluster83373 { label="AQEShuffleRead"; 35444 [labelType="html" label="ShuffledRowRDD [35444] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83370 { label="WholeStageCodegen (17)"; 35445 [labelType="html" label="MapPartitionsRDD [35445] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83378 { label="AQEShuffleRead"; 35446 [labelType="html" label="ShuffledRowRDD [35446] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83375 { label="WholeStageCodegen (18)"; 35447 [labelType="html" label="MapPartitionsRDD [35447] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83366 { label="WholeStageCodegen (19)"; 35448 [labelType="html" label="ZippedPartitionsRDD2 [35448] [Unordered]<br>rdd at PersistJob.java:28"]; 35449 [labelType="html" label="MapPartitionsRDD [35449] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83383 { label="Scan csv "; 35450 [labelType="html" label="FileScanRDD [35450]<br>rdd at PersistJob.java:28"]; 35451 [labelType="html" label="MapPartitionsRDD [35451]<br>rdd at PersistJob.java:28"]; } subgraph cluster83379 { label="WholeStageCodegen (20)"; 35452 [labelType="html" label="MapPartitionsRDD [35452]<br>rdd at PersistJob.java:28"]; } subgraph cluster83365 { label="CartesianProduct"; 35453 [labelType="html" label="UnsafeCartesianRDD [35453] [Unordered]<br>rdd at PersistJob.java:28"]; 35454 [labelType="html" label="MapPartitionsRDD [35454] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83362 { label="WholeStageCodegen (21)"; 35455 [labelType="html" label="MapPartitionsRDD [35455] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83361 { label="Exchange"; 35456 [labelType="html" label="MapPartitionsRDD [35456] [Unordered]<br>rdd at PersistJob.java:28"]; } } 35444->35445; 35446->35447; 35445->35448; 35447->35448; 35448->35449; 35450->35451; 35451->35452; 35449->35453; 35452->35453; 35453->35454; 35454->35455; 35455->35456; }
35439,35444
35443,35446
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time