3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 10411 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
15 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
20.2 MiB / 790403
Shuffle Write Size / Records:
27.9 MiB / 790389
Associated Job Ids:
4556
DAG Visualization
digraph G { subgraph clusterstage_10411 { label="Stage 10411"; subgraph cluster60849 { label="AQEShuffleRead"; 25785 [labelType="html" label="ShuffledRowRDD [25785] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60846 { label="WholeStageCodegen (31)"; 25786 [labelType="html" label="MapPartitionsRDD [25786] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60854 { label="AQEShuffleRead"; 25787 [labelType="html" label="ShuffledRowRDD [25787] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60851 { label="WholeStageCodegen (32)"; 25788 [labelType="html" label="MapPartitionsRDD [25788] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60840 { label="WholeStageCodegen (33)"; 25789 [labelType="html" label="ZippedPartitionsRDD2 [25789] [Unordered]<br>parquet at PersistJob.java:35"]; 25790 [labelType="html" label="MapPartitionsRDD [25790] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60859 { label="AQEShuffleRead"; 25791 [labelType="html" label="ShuffledRowRDD [25791] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60856 { label="WholeStageCodegen (34)"; 25792 [labelType="html" label="MapPartitionsRDD [25792] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60835 { label="WholeStageCodegen (35)"; 25793 [labelType="html" label="ZippedPartitionsRDD2 [25793] [Unordered]<br>parquet at PersistJob.java:35"]; 25794 [labelType="html" label="MapPartitionsRDD [25794] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster60834 { label="Exchange"; 25795 [labelType="html" label="MapPartitionsRDD [25795] [Unordered]<br>parquet at PersistJob.java:35"]; } } 25785->25786; 25787->25788; 25786->25789; 25788->25789; 25789->25790; 25791->25792; 25790->25793; 25792->25793; 25793->25794; 25794->25795; }
25784,25785
25732,25787
25736,25791
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time