3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 42876 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
93 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
600.0 KiB / 21886
Shuffle Write Size / Records:
1433.7 KiB / 21885
Associated Job Ids:
22492
DAG Visualization
digraph G { subgraph clusterstage_42876 { label="Stage 42876"; subgraph cluster294458 { label="Scan parquet "; 129076 [labelType="html" label="FileScanRDD [129076]<br>parquet at PersistJob.java:35"]; 129077 [labelType="html" label="MapPartitionsRDD [129077]<br>parquet at PersistJob.java:35"]; } subgraph cluster294454 { label="WholeStageCodegen (1)"; 129078 [labelType="html" label="MapPartitionsRDD [129078]<br>parquet at PersistJob.java:35"]; } subgraph cluster294463 { label="Scan csv "; 129079 [labelType="html" label="FileScanRDD [129079]<br>parquet at PersistJob.java:35"]; 129080 [labelType="html" label="MapPartitionsRDD [129080]<br>parquet at PersistJob.java:35"]; } subgraph cluster294459 { label="WholeStageCodegen (2)"; 129081 [labelType="html" label="MapPartitionsRDD [129081]<br>parquet at PersistJob.java:35"]; } subgraph cluster294453 { label="CartesianProduct"; 129082 [labelType="html" label="UnsafeCartesianRDD [129082]<br>parquet at PersistJob.java:35"]; 129083 [labelType="html" label="MapPartitionsRDD [129083]<br>parquet at PersistJob.java:35"]; } subgraph cluster294452 { label="Exchange"; 129084 [labelType="html" label="MapPartitionsRDD [129084]<br>parquet at PersistJob.java:35"]; } } 129076->129077; 129077->129078; 129079->129080; 129080->129081; 129078->129082; 129081->129082; 129082->129083; 129083->129084; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time