3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32570 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Output Size / Records:
189.4 KiB / 8737
Shuffle Read Size / Records:
1628.9 KiB / 48703
Associated Job Ids:
17940
DAG Visualization
digraph G { subgraph clusterstage_32570 { label="Stage 32570"; subgraph cluster207468 { label="AQEShuffleRead"; 89812 [labelType="html" label="ShuffledRowRDD [89812] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207465 { label="WholeStageCodegen (11)"; 89813 [labelType="html" label="MapPartitionsRDD [89813] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207473 { label="AQEShuffleRead"; 89814 [labelType="html" label="ShuffledRowRDD [89814] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207470 { label="WholeStageCodegen (12)"; 89815 [labelType="html" label="MapPartitionsRDD [89815] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207459 { label="WholeStageCodegen (13)"; 89816 [labelType="html" label="ZippedPartitionsRDD2 [89816] [Unordered]<br>parquet at PersistJob.java:35"]; 89817 [labelType="html" label="MapPartitionsRDD [89817] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207458 { label="WriteFiles"; 89818 [labelType="html" label="MapPartitionsRDD [89818] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89812->89813; 89814->89815; 89813->89816; 89815->89816; 89816->89817; 89817->89818; }
89793,89812
89761,89814
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time