3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15101 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Process local: 5
Input Size / Records:
2033.0 KiB / 85895
Associated Job Ids:
7935
DAG Visualization
digraph G { subgraph clusterstage_15101 { label="Stage 15101"; subgraph cluster97059 { label="Scan parquet "; 40959 [labelType="html" label="FileScanRDD [40959]<br>rdd at PersistJob.java:28"]; 40960 [labelType="html" label="MapPartitionsRDD [40960]<br>rdd at PersistJob.java:28"]; } subgraph cluster97054 { label="WholeStageCodegen (1)"; 40961 [labelType="html" label="MapPartitionsRDD [40961]<br>rdd at PersistJob.java:28"]; } subgraph cluster97064 { label="Scan csv "; 40962 [labelType="html" label="FileScanRDD [40962]<br>rdd at PersistJob.java:28"]; 40963 [labelType="html" label="MapPartitionsRDD [40963]<br>rdd at PersistJob.java:28"]; } subgraph cluster97060 { label="WholeStageCodegen (2)"; 40964 [labelType="html" label="MapPartitionsRDD [40964]<br>rdd at PersistJob.java:28"]; } subgraph cluster97053 { label="CartesianProduct"; 40965 [labelType="html" label="UnsafeCartesianRDD [40965]<br>rdd at PersistJob.java:28"]; 40966 [labelType="html" label="MapPartitionsRDD [40966]<br>rdd at PersistJob.java:28"]; } subgraph cluster97050 { label="WholeStageCodegen (3)"; 40967 [labelType="html" label="MapPartitionsRDD [40967]<br>rdd at PersistJob.java:28"]; } subgraph cluster97049 { label="Exchange"; 40968 [labelType="html" label="MapPartitionsRDD [40968]<br>rdd at PersistJob.java:28"]; } } 40959->40960; 40960->40961; 40962->40963; 40963->40964; 40961->40965; 40964->40965; 40965->40966; 40966->40967; 40967->40968; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time