3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32616 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 10
Input Size / Records:
2.8 MiB / 48625
Shuffle Write Size / Records:
3.3 MiB / 48615
Associated Job Ids:
17967
DAG Visualization
digraph G { subgraph clusterstage_32616 { label="Stage 32616"; subgraph cluster207972 { label="Scan parquet "; 90031 [labelType="html" label="FileScanRDD [90031]<br>rdd at PersistJob.java:28"]; 90032 [labelType="html" label="MapPartitionsRDD [90032]<br>rdd at PersistJob.java:28"]; } subgraph cluster207967 { label="WholeStageCodegen (1)"; 90033 [labelType="html" label="MapPartitionsRDD [90033]<br>rdd at PersistJob.java:28"]; } subgraph cluster207977 { label="Scan csv "; 90034 [labelType="html" label="FileScanRDD [90034]<br>rdd at PersistJob.java:28"]; 90035 [labelType="html" label="MapPartitionsRDD [90035]<br>rdd at PersistJob.java:28"]; } subgraph cluster207973 { label="WholeStageCodegen (2)"; 90036 [labelType="html" label="MapPartitionsRDD [90036]<br>rdd at PersistJob.java:28"]; } subgraph cluster207966 { label="CartesianProduct"; 90037 [labelType="html" label="UnsafeCartesianRDD [90037]<br>rdd at PersistJob.java:28"]; 90038 [labelType="html" label="MapPartitionsRDD [90038]<br>rdd at PersistJob.java:28"]; } subgraph cluster207921 { label="WholeStageCodegen (3)"; 90039 [labelType="html" label="MapPartitionsRDD [90039]<br>rdd at PersistJob.java:28"]; } subgraph cluster207920 { label="Exchange"; 90040 [labelType="html" label="MapPartitionsRDD [90040]<br>rdd at PersistJob.java:28"]; } } 90031->90032; 90032->90033; 90034->90035; 90035->90036; 90033->90037; 90036->90037; 90037->90038; 90038->90039; 90039->90040; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time