3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15185 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
605.6 KiB / 47098
Shuffle Write Size / Records:
794.8 KiB / 43029
Associated Job Ids:
7992
DAG Visualization
digraph G { subgraph clusterstage_15185 { label="Stage 15185"; subgraph cluster97923 { label="AQEShuffleRead"; 41373 [labelType="html" label="ShuffledRowRDD [41373] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97920 { label="WholeStageCodegen (7)"; 41374 [labelType="html" label="MapPartitionsRDD [41374] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97928 { label="AQEShuffleRead"; 41375 [labelType="html" label="ShuffledRowRDD [41375] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97925 { label="WholeStageCodegen (8)"; 41376 [labelType="html" label="MapPartitionsRDD [41376] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97916 { label="WholeStageCodegen (9)"; 41377 [labelType="html" label="ZippedPartitionsRDD2 [41377] [Unordered]<br>parquet at PersistJob.java:35"]; 41378 [labelType="html" label="MapPartitionsRDD [41378] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97933 { label="AQEShuffleRead"; 41379 [labelType="html" label="ShuffledRowRDD [41379] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97930 { label="WholeStageCodegen (10)"; 41380 [labelType="html" label="MapPartitionsRDD [41380] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97912 { label="WholeStageCodegen (11)"; 41381 [labelType="html" label="ZippedPartitionsRDD2 [41381] [Unordered]<br>parquet at PersistJob.java:35"]; 41382 [labelType="html" label="MapPartitionsRDD [41382] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97911 { label="ObjectHashAggregate"; 41383 [labelType="html" label="MapPartitionsRDD [41383] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97910 { label="Exchange"; 41384 [labelType="html" label="MapPartitionsRDD [41384] [Unordered]<br>parquet at PersistJob.java:35"]; } } 41373->41374; 41375->41376; 41374->41377; 41376->41377; 41377->41378; 41379->41380; 41378->41381; 41380->41381; 41381->41382; 41382->41383; 41383->41384; }
41364,41373
41368,41375
41372,41379
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time