3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9193 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 10
Input Size / Records:
2.3 MiB / 133183
Associated Job Ids:
4704
DAG Visualization
digraph G { subgraph clusterstage_9193 { label="Stage 9193"; subgraph cluster60534 { label="Scan parquet "; 26446 [labelType="html" label="FileScanRDD [26446]<br>rdd at PersistJob.java:28"]; 26447 [labelType="html" label="MapPartitionsRDD [26447]<br>rdd at PersistJob.java:28"]; } subgraph cluster60529 { label="WholeStageCodegen (2)"; 26448 [labelType="html" label="MapPartitionsRDD [26448]<br>rdd at PersistJob.java:28"]; } subgraph cluster60539 { label="Scan csv "; 26449 [labelType="html" label="FileScanRDD [26449]<br>rdd at PersistJob.java:28"]; 26450 [labelType="html" label="MapPartitionsRDD [26450]<br>rdd at PersistJob.java:28"]; } subgraph cluster60535 { label="WholeStageCodegen (3)"; 26451 [labelType="html" label="MapPartitionsRDD [26451]<br>rdd at PersistJob.java:28"]; } subgraph cluster60528 { label="CartesianProduct"; 26452 [labelType="html" label="UnsafeCartesianRDD [26452]<br>rdd at PersistJob.java:28"]; 26453 [labelType="html" label="MapPartitionsRDD [26453]<br>rdd at PersistJob.java:28"]; } subgraph cluster60524 { label="WholeStageCodegen (4)"; 26454 [labelType="html" label="MapPartitionsRDD [26454]<br>rdd at PersistJob.java:28"]; } subgraph cluster60523 { label="ObjectHashAggregate"; 26455 [labelType="html" label="MapPartitionsRDD [26455]<br>rdd at PersistJob.java:28"]; } subgraph cluster60522 { label="Exchange"; 26456 [labelType="html" label="MapPartitionsRDD [26456]<br>rdd at PersistJob.java:28"]; } } 26446->26447; 26447->26448; 26449->26450; 26450->26451; 26448->26452; 26451->26452; 26452->26453; 26453->26454; 26454->26455; 26455->26456; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time