3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15790 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
5.5 MiB / 86170
Shuffle Write Size / Records:
4.9 MiB / 85895
Associated Job Ids:
7736
DAG Visualization
digraph G { subgraph clusterstage_15790 { label="Stage 15790"; subgraph cluster100890 { label="AQEShuffleRead"; 43091 [labelType="html" label="ShuffledRowRDD [43091] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100887 { label="WholeStageCodegen (38)"; 43092 [labelType="html" label="MapPartitionsRDD [43092] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100895 { label="AQEShuffleRead"; 43093 [labelType="html" label="ShuffledRowRDD [43093] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100892 { label="WholeStageCodegen (39)"; 43094 [labelType="html" label="MapPartitionsRDD [43094] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100883 { label="WholeStageCodegen (40)"; 43095 [labelType="html" label="ZippedPartitionsRDD2 [43095] [Unordered]<br>parquet at PersistJob.java:35"]; 43096 [labelType="html" label="MapPartitionsRDD [43096] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100900 { label="AQEShuffleRead"; 43097 [labelType="html" label="ShuffledRowRDD [43097] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100897 { label="WholeStageCodegen (41)"; 43098 [labelType="html" label="MapPartitionsRDD [43098] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100877 { label="WholeStageCodegen (42)"; 43099 [labelType="html" label="ZippedPartitionsRDD2 [43099] [Unordered]<br>parquet at PersistJob.java:35"]; 43100 [labelType="html" label="MapPartitionsRDD [43100] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100876 { label="Exchange"; 43101 [labelType="html" label="MapPartitionsRDD [43101] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43091->43092; 43093->43094; 43092->43095; 43094->43095; 43095->43096; 43097->43098; 43096->43099; 43098->43099; 43099->43100; 43100->43101; }
43090,43091
43013,43093
43017,43097
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time