3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32587 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Input Size / Records:
163.0 B / 1
Shuffle Read Size / Records:
825.8 KiB / 87452
Shuffle Write Size / Records:
730.1 KiB / 87452
Associated Job Ids:
17951
DAG Visualization
digraph G { subgraph clusterstage_32587 { label="Stage 32587"; subgraph cluster207688 { label="AQEShuffleRead"; 89900 [labelType="html" label="ShuffledRowRDD [89900] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207685 { label="WholeStageCodegen (4)"; 89901 [labelType="html" label="MapPartitionsRDD [89901] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207684 { label="Window"; 89902 [labelType="html" label="MapPartitionsRDD [89902] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207680 { label="WholeStageCodegen (5)"; 89903 [labelType="html" label="MapPartitionsRDD [89903] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207693 { label="Scan csv "; 89904 [labelType="html" label="FileScanRDD [89904]<br>rdd at PersistJob.java:28"]; 89905 [labelType="html" label="MapPartitionsRDD [89905]<br>rdd at PersistJob.java:28"]; } subgraph cluster207689 { label="WholeStageCodegen (6)"; 89906 [labelType="html" label="MapPartitionsRDD [89906]<br>rdd at PersistJob.java:28"]; } subgraph cluster207679 { label="CartesianProduct"; 89907 [labelType="html" label="UnsafeCartesianRDD [89907] [Unordered]<br>rdd at PersistJob.java:28"]; 89908 [labelType="html" label="MapPartitionsRDD [89908] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207676 { label="WholeStageCodegen (7)"; 89909 [labelType="html" label="MapPartitionsRDD [89909] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207675 { label="Exchange"; 89910 [labelType="html" label="MapPartitionsRDD [89910] [Unordered]<br>rdd at PersistJob.java:28"]; } } 89900->89901; 89901->89902; 89902->89903; 89904->89905; 89905->89906; 89903->89907; 89906->89907; 89907->89908; 89908->89909; 89909->89910; }
89890,89900
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time