3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14870 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 5
Shuffle Read Size / Records:
5.4 MiB / 85947
Shuffle Write Size / Records:
5.5 MiB / 85895
Associated Job Ids:
7868
DAG Visualization
digraph G { subgraph clusterstage_14870 { label="Stage 14870"; subgraph cluster95878 { label="AQEShuffleRead"; 40473 [labelType="html" label="ShuffledRowRDD [40473] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95875 { label="WholeStageCodegen (35)"; 40474 [labelType="html" label="MapPartitionsRDD [40474] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95883 { label="AQEShuffleRead"; 40475 [labelType="html" label="ShuffledRowRDD [40475] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95880 { label="WholeStageCodegen (36)"; 40476 [labelType="html" label="MapPartitionsRDD [40476] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95869 { label="WholeStageCodegen (37)"; 40477 [labelType="html" label="ZippedPartitionsRDD2 [40477] [Unordered]<br>parquet at PersistJob.java:35"]; 40478 [labelType="html" label="MapPartitionsRDD [40478] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95868 { label="Exchange"; 40479 [labelType="html" label="MapPartitionsRDD [40479] [Unordered]<br>parquet at PersistJob.java:35"]; } } 40473->40474; 40475->40476; 40474->40477; 40476->40477; 40477->40478; 40478->40479; }
40472,40473
40398,40475
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time