3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16964 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1052.8 KiB / 79703
Shuffle Write Size / Records:
1449.0 KiB / 74906
Associated Job Ids:
8256
DAG Visualization
digraph G { subgraph clusterstage_16964 { label="Stage 16964"; subgraph cluster108507 { label="AQEShuffleRead"; 46400 [labelType="html" label="ShuffledRowRDD [46400] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108504 { label="WholeStageCodegen (7)"; 46401 [labelType="html" label="MapPartitionsRDD [46401] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108512 { label="AQEShuffleRead"; 46402 [labelType="html" label="ShuffledRowRDD [46402] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108509 { label="WholeStageCodegen (8)"; 46403 [labelType="html" label="MapPartitionsRDD [46403] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108500 { label="WholeStageCodegen (9)"; 46404 [labelType="html" label="ZippedPartitionsRDD2 [46404] [Unordered]<br>parquet at PersistJob.java:35"]; 46405 [labelType="html" label="MapPartitionsRDD [46405] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108517 { label="AQEShuffleRead"; 46406 [labelType="html" label="ShuffledRowRDD [46406] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108514 { label="WholeStageCodegen (10)"; 46407 [labelType="html" label="MapPartitionsRDD [46407] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108496 { label="WholeStageCodegen (11)"; 46408 [labelType="html" label="ZippedPartitionsRDD2 [46408] [Unordered]<br>parquet at PersistJob.java:35"]; 46409 [labelType="html" label="MapPartitionsRDD [46409] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108495 { label="ObjectHashAggregate"; 46410 [labelType="html" label="MapPartitionsRDD [46410] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108494 { label="Exchange"; 46411 [labelType="html" label="MapPartitionsRDD [46411] [Unordered]<br>parquet at PersistJob.java:35"]; } } 46400->46401; 46402->46403; 46401->46404; 46403->46404; 46404->46405; 46406->46407; 46405->46408; 46407->46408; 46408->46409; 46409->46410; 46410->46411; }
46391,46400
46395,46402
46399,46406
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time