3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16970 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 5
Output Size / Records:
52.6 KiB / 534
Shuffle Read Size / Records:
4.9 MiB / 123182
Associated Job Ids:
8257
DAG Visualization
digraph G { subgraph clusterstage_16970 { label="Stage 16970"; subgraph cluster108529 { label="AQEShuffleRead"; 46412 [labelType="html" label="ShuffledRowRDD [46412] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108526 { label="WholeStageCodegen (12)"; 46413 [labelType="html" label="MapPartitionsRDD [46413] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108535 { label="AQEShuffleRead"; 46414 [labelType="html" label="ShuffledRowRDD [46414] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108534 { label="ObjectHashAggregate"; 46415 [labelType="html" label="MapPartitionsRDD [46415] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108531 { label="WholeStageCodegen (13)"; 46416 [labelType="html" label="MapPartitionsRDD [46416] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108519 { label="WholeStageCodegen (14)"; 46417 [labelType="html" label="ZippedPartitionsRDD2 [46417] [Unordered]<br>parquet at PersistJob.java:35"]; 46418 [labelType="html" label="MapPartitionsRDD [46418] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108518 { label="WriteFiles"; 46419 [labelType="html" label="MapPartitionsRDD [46419] [Unordered]<br>parquet at PersistJob.java:35"]; } } 46412->46413; 46414->46415; 46415->46416; 46413->46417; 46416->46417; 46417->46418; 46418->46419; }
46387,46412
46411,46414
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time