3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 6368 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
12 ms
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.9 KiB / 533
Shuffle Write Size / Records:
4.2 KiB / 210
Associated Job Ids:
3389
DAG Visualization
digraph G { subgraph clusterstage_6368 { label="Stage 6368"; subgraph cluster42771 { label="AQEShuffleRead"; 18462 [labelType="html" label="ShuffledRowRDD [18462] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42768 { label="WholeStageCodegen (17)"; 18463 [labelType="html" label="MapPartitionsRDD [18463] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42776 { label="AQEShuffleRead"; 18464 [labelType="html" label="ShuffledRowRDD [18464] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42773 { label="WholeStageCodegen (18)"; 18465 [labelType="html" label="MapPartitionsRDD [18465] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42764 { label="WholeStageCodegen (19)"; 18466 [labelType="html" label="ZippedPartitionsRDD2 [18466] [Unordered]<br>count at ColumnStatJob.java:47"]; 18467 [labelType="html" label="MapPartitionsRDD [18467] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42781 { label="Scan csv "; 18468 [labelType="html" label="FileScanRDD [18468]<br>count at ColumnStatJob.java:47"]; 18469 [labelType="html" label="MapPartitionsRDD [18469]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42777 { label="WholeStageCodegen (20)"; 18470 [labelType="html" label="MapPartitionsRDD [18470]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42763 { label="CartesianProduct"; 18471 [labelType="html" label="UnsafeCartesianRDD [18471] [Unordered]<br>count at ColumnStatJob.java:47"]; 18472 [labelType="html" label="MapPartitionsRDD [18472] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42760 { label="WholeStageCodegen (21)"; 18473 [labelType="html" label="MapPartitionsRDD [18473] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42759 { label="Exchange"; 18474 [labelType="html" label="MapPartitionsRDD [18474] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 18462->18463; 18464->18465; 18463->18466; 18465->18466; 18466->18467; 18468->18469; 18469->18470; 18467->18471; 18470->18471; 18471->18472; 18472->18473; 18473->18474; }
18457,18462
18461,18464
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time