3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15340 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
124.3 KiB / 10488
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
7752
DAG Visualization
digraph G { subgraph clusterstage_15340 { label="Stage 15340"; subgraph cluster99894 { label="AQEShuffleRead"; 42448 [labelType="html" label="ShuffledRowRDD [42448] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99891 { label="WholeStageCodegen (4)"; 42449 [labelType="html" label="MapPartitionsRDD [42449] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99899 { label="AQEShuffleRead"; 42450 [labelType="html" label="ShuffledRowRDD [42450] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99896 { label="WholeStageCodegen (5)"; 42451 [labelType="html" label="MapPartitionsRDD [42451] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99887 { label="WholeStageCodegen (6)"; 42452 [labelType="html" label="ZippedPartitionsRDD2 [42452] [Unordered]<br>count at ColumnStatJob.java:47"]; 42453 [labelType="html" label="MapPartitionsRDD [42453] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99904 { label="AQEShuffleRead"; 42454 [labelType="html" label="ShuffledRowRDD [42454] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99901 { label="WholeStageCodegen (7)"; 42455 [labelType="html" label="MapPartitionsRDD [42455] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99881 { label="WholeStageCodegen (8)"; 42456 [labelType="html" label="ZippedPartitionsRDD2 [42456] [Unordered]<br>count at ColumnStatJob.java:47"]; 42457 [labelType="html" label="MapPartitionsRDD [42457] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99880 { label="Exchange"; 42458 [labelType="html" label="MapPartitionsRDD [42458] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 42448->42449; 42450->42451; 42449->42452; 42451->42452; 42452->42453; 42454->42455; 42453->42456; 42455->42456; 42456->42457; 42457->42458; }
42439,42448
42443,42450
42447,42454
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time