3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32106 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Input Size / Records:
163.0 B / 1
Shuffle Read Size / Records:
1577.0 KiB / 453234
Shuffle Write Size / Records:
115.4 KiB / 8098
Associated Job Ids:
17797
DAG Visualization
digraph G { subgraph clusterstage_32106 { label="Stage 32106"; subgraph cluster205109 { label="AQEShuffleRead"; 88788 [labelType="html" label="ShuffledRowRDD [88788] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205106 { label="WholeStageCodegen (4)"; 88789 [labelType="html" label="MapPartitionsRDD [88789] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205114 { label="AQEShuffleRead"; 88790 [labelType="html" label="ShuffledRowRDD [88790] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205111 { label="WholeStageCodegen (5)"; 88791 [labelType="html" label="MapPartitionsRDD [88791] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205102 { label="WholeStageCodegen (6)"; 88792 [labelType="html" label="ZippedPartitionsRDD2 [88792] [Unordered]<br>parquet at PersistJob.java:35"]; 88793 [labelType="html" label="MapPartitionsRDD [88793] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205119 { label="Scan csv "; 88794 [labelType="html" label="FileScanRDD [88794]<br>parquet at PersistJob.java:35"]; 88795 [labelType="html" label="MapPartitionsRDD [88795]<br>parquet at PersistJob.java:35"]; } subgraph cluster205115 { label="WholeStageCodegen (7)"; 88796 [labelType="html" label="MapPartitionsRDD [88796]<br>parquet at PersistJob.java:35"]; } subgraph cluster205101 { label="CartesianProduct"; 88797 [labelType="html" label="UnsafeCartesianRDD [88797] [Unordered]<br>parquet at PersistJob.java:35"]; 88798 [labelType="html" label="MapPartitionsRDD [88798] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205096 { label="WholeStageCodegen (8)"; 88799 [labelType="html" label="MapPartitionsRDD [88799] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205095 { label="Exchange"; 88800 [labelType="html" label="MapPartitionsRDD [88800] [Unordered]<br>parquet at PersistJob.java:35"]; } } 88788->88789; 88790->88791; 88789->88792; 88791->88792; 88792->88793; 88794->88795; 88795->88796; 88793->88797; 88796->88797; 88797->88798; 88798->88799; 88799->88800; }
88779,88788
88783,88790
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time