3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32624 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 10
Input Size / Records:
2.8 MiB / 48625
Shuffle Write Size / Records:
3.3 MiB / 48615
Associated Job Ids:
17972
DAG Visualization
digraph G { subgraph clusterstage_32624 { label="Stage 32624"; subgraph cluster208118 { label="Scan parquet "; 90075 [labelType="html" label="FileScanRDD [90075]<br>parquet at PersistJob.java:35"]; 90076 [labelType="html" label="MapPartitionsRDD [90076]<br>parquet at PersistJob.java:35"]; } subgraph cluster208113 { label="WholeStageCodegen (1)"; 90077 [labelType="html" label="MapPartitionsRDD [90077]<br>parquet at PersistJob.java:35"]; } subgraph cluster208123 { label="Scan csv "; 90078 [labelType="html" label="FileScanRDD [90078]<br>parquet at PersistJob.java:35"]; 90079 [labelType="html" label="MapPartitionsRDD [90079]<br>parquet at PersistJob.java:35"]; } subgraph cluster208119 { label="WholeStageCodegen (2)"; 90080 [labelType="html" label="MapPartitionsRDD [90080]<br>parquet at PersistJob.java:35"]; } subgraph cluster208112 { label="CartesianProduct"; 90081 [labelType="html" label="UnsafeCartesianRDD [90081]<br>parquet at PersistJob.java:35"]; 90082 [labelType="html" label="MapPartitionsRDD [90082]<br>parquet at PersistJob.java:35"]; } subgraph cluster208104 { label="WholeStageCodegen (3)"; 90083 [labelType="html" label="MapPartitionsRDD [90083]<br>parquet at PersistJob.java:35"]; } subgraph cluster208103 { label="Exchange"; 90084 [labelType="html" label="MapPartitionsRDD [90084]<br>parquet at PersistJob.java:35"]; } } 90075->90076; 90076->90077; 90078->90079; 90079->90080; 90077->90081; 90080->90081; 90081->90082; 90082->90083; 90083->90084; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time