3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8287 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
15 ms
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.9 KiB / 533
Shuffle Write Size / Records:
4.2 KiB / 210
Associated Job Ids:
4094
DAG Visualization
digraph G { subgraph clusterstage_8287 { label="Stage 8287"; subgraph cluster54323 { label="AQEShuffleRead"; 23885 [labelType="html" label="ShuffledRowRDD [23885] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54320 { label="WholeStageCodegen (17)"; 23886 [labelType="html" label="MapPartitionsRDD [23886] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54328 { label="AQEShuffleRead"; 23887 [labelType="html" label="ShuffledRowRDD [23887] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54325 { label="WholeStageCodegen (18)"; 23888 [labelType="html" label="MapPartitionsRDD [23888] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54316 { label="WholeStageCodegen (19)"; 23889 [labelType="html" label="ZippedPartitionsRDD2 [23889] [Unordered]<br>parquet at PersistJob.java:35"]; 23890 [labelType="html" label="MapPartitionsRDD [23890] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54333 { label="Scan csv "; 23891 [labelType="html" label="FileScanRDD [23891]<br>parquet at PersistJob.java:35"]; 23892 [labelType="html" label="MapPartitionsRDD [23892]<br>parquet at PersistJob.java:35"]; } subgraph cluster54329 { label="WholeStageCodegen (20)"; 23893 [labelType="html" label="MapPartitionsRDD [23893]<br>parquet at PersistJob.java:35"]; } subgraph cluster54315 { label="CartesianProduct"; 23894 [labelType="html" label="UnsafeCartesianRDD [23894] [Unordered]<br>parquet at PersistJob.java:35"]; 23895 [labelType="html" label="MapPartitionsRDD [23895] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54312 { label="WholeStageCodegen (21)"; 23896 [labelType="html" label="MapPartitionsRDD [23896] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54311 { label="Exchange"; 23897 [labelType="html" label="MapPartitionsRDD [23897] [Unordered]<br>parquet at PersistJob.java:35"]; } } 23885->23886; 23887->23888; 23886->23889; 23888->23889; 23889->23890; 23891->23892; 23892->23893; 23890->23894; 23893->23894; 23894->23895; 23895->23896; 23896->23897; }
23880,23885
23884,23887
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time