3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32094 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Input Size / Records:
163.0 B / 1
Shuffle Read Size / Records:
1577.0 KiB / 453234
Shuffle Write Size / Records:
115.4 KiB / 8098
Associated Job Ids:
17790
DAG Visualization
digraph G { subgraph clusterstage_32094 { label="Stage 32094"; subgraph cluster205008 { label="AQEShuffleRead"; 88729 [labelType="html" label="ShuffledRowRDD [88729] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205005 { label="WholeStageCodegen (4)"; 88730 [labelType="html" label="MapPartitionsRDD [88730] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205013 { label="AQEShuffleRead"; 88731 [labelType="html" label="ShuffledRowRDD [88731] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205010 { label="WholeStageCodegen (5)"; 88732 [labelType="html" label="MapPartitionsRDD [88732] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205001 { label="WholeStageCodegen (6)"; 88733 [labelType="html" label="ZippedPartitionsRDD2 [88733] [Unordered]<br>rdd at PersistJob.java:28"]; 88734 [labelType="html" label="MapPartitionsRDD [88734] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205018 { label="Scan csv "; 88735 [labelType="html" label="FileScanRDD [88735]<br>rdd at PersistJob.java:28"]; 88736 [labelType="html" label="MapPartitionsRDD [88736]<br>rdd at PersistJob.java:28"]; } subgraph cluster205014 { label="WholeStageCodegen (7)"; 88737 [labelType="html" label="MapPartitionsRDD [88737]<br>rdd at PersistJob.java:28"]; } subgraph cluster205000 { label="CartesianProduct"; 88738 [labelType="html" label="UnsafeCartesianRDD [88738] [Unordered]<br>rdd at PersistJob.java:28"]; 88739 [labelType="html" label="MapPartitionsRDD [88739] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster204995 { label="WholeStageCodegen (8)"; 88740 [labelType="html" label="MapPartitionsRDD [88740] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster204994 { label="Exchange"; 88741 [labelType="html" label="MapPartitionsRDD [88741] [Unordered]<br>rdd at PersistJob.java:28"]; } } 88729->88730; 88731->88732; 88730->88733; 88732->88733; 88733->88734; 88735->88736; 88736->88737; 88734->88738; 88737->88738; 88738->88739; 88739->88740; 88740->88741; }
88711,88729
88715,88731
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time