3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15774 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 5
Shuffle Read Size / Records:
5.4 MiB / 85947
Shuffle Write Size / Records:
5.5 MiB / 85895
Associated Job Ids:
7735
DAG Visualization
digraph G { subgraph clusterstage_15774 { label="Stage 15774"; subgraph cluster100870 { label="AQEShuffleRead"; 43084 [labelType="html" label="ShuffledRowRDD [43084] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100867 { label="WholeStageCodegen (35)"; 43085 [labelType="html" label="MapPartitionsRDD [43085] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100875 { label="AQEShuffleRead"; 43086 [labelType="html" label="ShuffledRowRDD [43086] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100872 { label="WholeStageCodegen (36)"; 43087 [labelType="html" label="MapPartitionsRDD [43087] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100861 { label="WholeStageCodegen (37)"; 43088 [labelType="html" label="ZippedPartitionsRDD2 [43088] [Unordered]<br>parquet at PersistJob.java:35"]; 43089 [labelType="html" label="MapPartitionsRDD [43089] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100860 { label="Exchange"; 43090 [labelType="html" label="MapPartitionsRDD [43090] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43084->43085; 43086->43087; 43085->43088; 43087->43088; 43088->43089; 43089->43090; }
43083,43084
43009,43086
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time