3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7795 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Any: 5
Output Size / Records:
43.0 KiB / 740
Shuffle Read Size / Records:
8.4 MiB / 552077
Associated Job Ids:
3801
DAG Visualization
digraph G { subgraph clusterstage_7795 { label="Stage 7795"; subgraph cluster50547 { label="AQEShuffleRead"; 22373 [labelType="html" label="ShuffledRowRDD [22373] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50544 { label="WholeStageCodegen (8)"; 22374 [labelType="html" label="MapPartitionsRDD [22374] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50552 { label="AQEShuffleRead"; 22375 [labelType="html" label="ShuffledRowRDD [22375] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50549 { label="WholeStageCodegen (9)"; 22376 [labelType="html" label="MapPartitionsRDD [22376] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50540 { label="WholeStageCodegen (10)"; 22377 [labelType="html" label="ZippedPartitionsRDD2 [22377] [Unordered]<br>parquet at PersistJob.java:35"]; 22378 [labelType="html" label="MapPartitionsRDD [22378] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50558 { label="AQEShuffleRead"; 22379 [labelType="html" label="ShuffledRowRDD [22379] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50557 { label="ObjectHashAggregate"; 22380 [labelType="html" label="MapPartitionsRDD [22380] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50554 { label="WholeStageCodegen (11)"; 22381 [labelType="html" label="MapPartitionsRDD [22381] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50534 { label="WholeStageCodegen (12)"; 22382 [labelType="html" label="ZippedPartitionsRDD2 [22382] [Unordered]<br>parquet at PersistJob.java:35"]; 22383 [labelType="html" label="MapPartitionsRDD [22383] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50533 { label="WriteFiles"; 22384 [labelType="html" label="MapPartitionsRDD [22384] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22373->22374; 22375->22376; 22374->22377; 22376->22377; 22377->22378; 22379->22380; 22380->22381; 22378->22382; 22381->22382; 22382->22383; 22383->22384; }
22367,22373
22329,22375
22334,22379
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time