3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15063 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1427.5 KiB / 85900
Shuffle Write Size / Records:
790.5 KiB / 37268
Associated Job Ids:
7907
DAG Visualization
digraph G { subgraph clusterstage_15063 { label="Stage 15063"; subgraph cluster96610 { label="Scan parquet "; 40723 [labelType="html" label="FileScanRDD [40723]<br>rdd at PersistJob.java:28"]; 40724 [labelType="html" label="MapPartitionsRDD [40724]<br>rdd at PersistJob.java:28"]; } subgraph cluster96604 { label="WholeStageCodegen (1)"; 40725 [labelType="html" label="MapPartitionsRDD [40725]<br>rdd at PersistJob.java:28"]; } subgraph cluster96616 { label="Scan csv "; 40728 [labelType="html" label="FileScanRDD [40728]<br>rdd at PersistJob.java:28"]; 40729 [labelType="html" label="MapPartitionsRDD [40729]<br>rdd at PersistJob.java:28"]; } subgraph cluster96612 { label="WholeStageCodegen (2)"; 40730 [labelType="html" label="MapPartitionsRDD [40730]<br>rdd at PersistJob.java:28"]; } subgraph cluster96603 { label="CartesianProduct"; 40731 [labelType="html" label="UnsafeCartesianRDD [40731]<br>rdd at PersistJob.java:28"]; 40732 [labelType="html" label="MapPartitionsRDD [40732]<br>rdd at PersistJob.java:28"]; } subgraph cluster96598 { label="WholeStageCodegen (3)"; 40733 [labelType="html" label="MapPartitionsRDD [40733]<br>rdd at PersistJob.java:28"]; } subgraph cluster96597 { label="ObjectHashAggregate"; 40734 [labelType="html" label="MapPartitionsRDD [40734]<br>rdd at PersistJob.java:28"]; } subgraph cluster96596 { label="Exchange"; 40735 [labelType="html" label="MapPartitionsRDD [40735]<br>rdd at PersistJob.java:28"]; } } 40723->40724; 40724->40725; 40728->40729; 40729->40730; 40725->40731; 40730->40731; 40731->40732; 40732->40733; 40733->40734; 40734->40735; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time