3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7983 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
12 s
Locality Level Summary:
Any: 10
Shuffle Read Size / Records:
20.9 MiB / 259692
Shuffle Write Size / Records:
17.6 MiB / 259485
Associated Job Ids:
3897
DAG Visualization
digraph G { subgraph clusterstage_7983 { label="Stage 7983"; subgraph cluster52175 { label="Exchange"; 23023 [labelType="html" label="ShuffledRowRDD [23023] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52171 { label="WholeStageCodegen (7)"; 23024 [labelType="html" label="MapPartitionsRDD [23024] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52181 { label="Exchange"; 23025 [labelType="html" label="ShuffledRowRDD [23025] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52177 { label="WholeStageCodegen (8)"; 23026 [labelType="html" label="MapPartitionsRDD [23026] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52166 { label="WholeStageCodegen (9)"; 23027 [labelType="html" label="ZippedPartitionsRDD2 [23027] [Unordered]<br>parquet at PersistJob.java:35"]; 23028 [labelType="html" label="MapPartitionsRDD [23028] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52165 { label="Exchange"; 23029 [labelType="html" label="MapPartitionsRDD [23029] [Unordered]<br>parquet at PersistJob.java:35"]; } } 23023->23024; 23025->23026; 23024->23027; 23026->23027; 23027->23028; 23028->23029; }
23010,23023
23014,23025
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time