3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15860 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 s
Locality Level Summary:
Any: 1
Input Size / Records:
110.0 B / 1
Shuffle Read Size / Records:
1737.3 KiB / 48729
Shuffle Write Size / Records:
1433.7 KiB / 21885
Associated Job Ids:
8016
DAG Visualization
digraph G { subgraph clusterstage_15860 { label="Stage 15860"; subgraph cluster103659 { label="AQEShuffleRead"; 44433 [labelType="html" label="ShuffledRowRDD [44433] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103656 { label="WholeStageCodegen (60)"; 44434 [labelType="html" label="MapPartitionsRDD [44434] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103655 { label="Window"; 44435 [labelType="html" label="MapPartitionsRDD [44435] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103649 { label="WholeStageCodegen (61)"; 44436 [labelType="html" label="MapPartitionsRDD [44436] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103664 { label="Scan csv "; 44437 [labelType="html" label="FileScanRDD [44437]<br>parquet at PersistJob.java:35"]; 44438 [labelType="html" label="MapPartitionsRDD [44438]<br>parquet at PersistJob.java:35"]; } subgraph cluster103660 { label="WholeStageCodegen (62)"; 44439 [labelType="html" label="MapPartitionsRDD [44439]<br>parquet at PersistJob.java:35"]; } subgraph cluster103648 { label="CartesianProduct"; 44440 [labelType="html" label="UnsafeCartesianRDD [44440] [Unordered]<br>parquet at PersistJob.java:35"]; 44441 [labelType="html" label="MapPartitionsRDD [44441] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103647 { label="Exchange"; 44442 [labelType="html" label="MapPartitionsRDD [44442] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44433->44434; 44434->44435; 44435->44436; 44437->44438; 44438->44439; 44436->44440; 44439->44440; 44440->44441; 44441->44442; }
44432,44433
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time