3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13561 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.9 MiB / 2231133
Shuffle Read Size / Records:
4.7 KiB / 10
Shuffle Write Size / Records:
399.0 B / 2
Associated Job Ids:
6800
DAG Visualization
digraph G { subgraph clusterstage_13561 { label="Stage 13561"; subgraph cluster88287 { label="Scan parquet "; 37543 [labelType="html" label="FileScanRDD [37543]<br>rdd at PersistJob.java:28"]; 37544 [labelType="html" label="MapPartitionsRDD [37544]<br>rdd at PersistJob.java:28"]; } subgraph cluster88282 { label="WholeStageCodegen (25)"; 37545 [labelType="html" label="MapPartitionsRDD [37545]<br>rdd at PersistJob.java:28"]; } subgraph cluster88290 { label="Exchange"; 37546 [labelType="html" label="ShuffledRowRDD [37546] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88288 { label="ObjectHashAggregate"; 37547 [labelType="html" label="MapPartitionsRDD [37547] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88281 { label="CartesianProduct"; 37548 [labelType="html" label="UnsafeCartesianRDD [37548] [Unordered]<br>rdd at PersistJob.java:28"]; 37549 [labelType="html" label="MapPartitionsRDD [37549] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88295 { label="Scan csv "; 37550 [labelType="html" label="FileScanRDD [37550]<br>rdd at PersistJob.java:28"]; 37551 [labelType="html" label="MapPartitionsRDD [37551]<br>rdd at PersistJob.java:28"]; } subgraph cluster88291 { label="WholeStageCodegen (26)"; 37552 [labelType="html" label="MapPartitionsRDD [37552]<br>rdd at PersistJob.java:28"]; } subgraph cluster88280 { label="CartesianProduct"; 37553 [labelType="html" label="UnsafeCartesianRDD [37553] [Unordered]<br>rdd at PersistJob.java:28"]; 37554 [labelType="html" label="MapPartitionsRDD [37554] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88276 { label="WholeStageCodegen (27)"; 37555 [labelType="html" label="MapPartitionsRDD [37555] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88275 { label="ObjectHashAggregate"; 37556 [labelType="html" label="MapPartitionsRDD [37556] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88274 { label="Exchange"; 37557 [labelType="html" label="MapPartitionsRDD [37557] [Unordered]<br>rdd at PersistJob.java:28"]; } } 37543->37544; 37544->37545; 37546->37547; 37545->37548; 37547->37548; 37548->37549; 37550->37551; 37551->37552; 37549->37553; 37552->37553; 37553->37554; 37554->37555; 37555->37556; 37556->37557; }
37462,37546
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time