3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14678 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
1037.2 KiB / 85714
Shuffle Write Size / Records:
892.3 KiB / 44963
Associated Job Ids:
7817
DAG Visualization
digraph G { subgraph clusterstage_14678 { label="Stage 14678"; subgraph cluster95111 { label="AQEShuffleRead"; 40122 [labelType="html" label="ShuffledRowRDD [40122] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95108 { label="WholeStageCodegen (4)"; 40123 [labelType="html" label="MapPartitionsRDD [40123] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95116 { label="AQEShuffleRead"; 40124 [labelType="html" label="ShuffledRowRDD [40124] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95113 { label="WholeStageCodegen (5)"; 40125 [labelType="html" label="MapPartitionsRDD [40125] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95104 { label="WholeStageCodegen (6)"; 40126 [labelType="html" label="ZippedPartitionsRDD2 [40126] [Unordered]<br>parquet at PersistJob.java:35"]; 40127 [labelType="html" label="MapPartitionsRDD [40127] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95121 { label="Scan csv "; 40128 [labelType="html" label="FileScanRDD [40128]<br>parquet at PersistJob.java:35"]; 40129 [labelType="html" label="MapPartitionsRDD [40129]<br>parquet at PersistJob.java:35"]; } subgraph cluster95117 { label="WholeStageCodegen (7)"; 40130 [labelType="html" label="MapPartitionsRDD [40130]<br>parquet at PersistJob.java:35"]; } subgraph cluster95103 { label="CartesianProduct"; 40131 [labelType="html" label="UnsafeCartesianRDD [40131] [Unordered]<br>parquet at PersistJob.java:35"]; 40132 [labelType="html" label="MapPartitionsRDD [40132] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95098 { label="WholeStageCodegen (8)"; 40133 [labelType="html" label="MapPartitionsRDD [40133] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95097 { label="Exchange"; 40134 [labelType="html" label="MapPartitionsRDD [40134] [Unordered]<br>parquet at PersistJob.java:35"]; } } 40122->40123; 40124->40125; 40123->40126; 40125->40126; 40126->40127; 40128->40129; 40129->40130; 40127->40131; 40130->40131; 40131->40132; 40132->40133; 40133->40134; }
40103,40122
40107,40124
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time