3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7756 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 2
Shuffle Read Size / Records:
2.7 MiB / 124771
Shuffle Write Size / Records:
1747.4 KiB / 48482
Associated Job Ids:
3775
DAG Visualization
digraph G { subgraph clusterstage_7756 { label="Stage 7756"; subgraph cluster50101 { label="AQEShuffleRead"; 22157 [labelType="html" label="ShuffledRowRDD [22157] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50098 { label="WholeStageCodegen (8)"; 22158 [labelType="html" label="MapPartitionsRDD [22158] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50106 { label="AQEShuffleRead"; 22159 [labelType="html" label="ShuffledRowRDD [22159] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50103 { label="WholeStageCodegen (9)"; 22160 [labelType="html" label="MapPartitionsRDD [22160] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50094 { label="WholeStageCodegen (10)"; 22161 [labelType="html" label="ZippedPartitionsRDD2 [22161] [Unordered]<br>parquet at PersistJob.java:35"]; 22162 [labelType="html" label="MapPartitionsRDD [22162] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50093 { label="Exchange"; 22163 [labelType="html" label="MapPartitionsRDD [22163] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22157->22158; 22159->22160; 22158->22161; 22160->22161; 22161->22162; 22162->22163; }
22131,22157
22094,22159
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time