3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9274 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
2.2 MiB / 133183
Shuffle Write Size / Records:
527.0 B / 5
Associated Job Ids:
4740
DAG Visualization
digraph G { subgraph clusterstage_9274 { label="Stage 9274"; subgraph cluster61067 { label="Scan parquet "; 26771 [labelType="html" label="FileScanRDD [26771]<br>parquet at PersistJob.java:35"]; 26772 [labelType="html" label="MapPartitionsRDD [26772]<br>parquet at PersistJob.java:35"]; } subgraph cluster61062 { label="WholeStageCodegen (12)"; 26773 [labelType="html" label="MapPartitionsRDD [26773]<br>parquet at PersistJob.java:35"]; } subgraph cluster61072 { label="Scan csv "; 26774 [labelType="html" label="FileScanRDD [26774]<br>parquet at PersistJob.java:35"]; 26775 [labelType="html" label="MapPartitionsRDD [26775]<br>parquet at PersistJob.java:35"]; } subgraph cluster61068 { label="WholeStageCodegen (13)"; 26776 [labelType="html" label="MapPartitionsRDD [26776]<br>parquet at PersistJob.java:35"]; } subgraph cluster61061 { label="CartesianProduct"; 26777 [labelType="html" label="UnsafeCartesianRDD [26777]<br>parquet at PersistJob.java:35"]; 26778 [labelType="html" label="MapPartitionsRDD [26778]<br>parquet at PersistJob.java:35"]; } subgraph cluster61057 { label="WholeStageCodegen (14)"; 26779 [labelType="html" label="MapPartitionsRDD [26779]<br>parquet at PersistJob.java:35"]; } subgraph cluster61056 { label="ObjectHashAggregate"; 26780 [labelType="html" label="MapPartitionsRDD [26780]<br>parquet at PersistJob.java:35"]; } subgraph cluster61055 { label="Exchange"; 26781 [labelType="html" label="MapPartitionsRDD [26781]<br>parquet at PersistJob.java:35"]; } } 26771->26772; 26772->26773; 26774->26775; 26775->26776; 26773->26777; 26776->26777; 26777->26778; 26778->26779; 26779->26780; 26780->26781; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time