3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15838 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 10
Input Size / Records:
14.5 MiB / 2231133
Shuffle Read Size / Records:
1480.0 B / 10
Associated Job Ids:
8009
DAG Visualization
digraph G { subgraph clusterstage_15838 { label="Stage 15838"; subgraph cluster103535 { label="Scan parquet "; 44370 [labelType="html" label="FileScanRDD [44370]<br>parquet at PersistJob.java:35"]; 44371 [labelType="html" label="MapPartitionsRDD [44371]<br>parquet at PersistJob.java:35"]; } subgraph cluster103530 { label="WholeStageCodegen (40)"; 44372 [labelType="html" label="MapPartitionsRDD [44372]<br>parquet at PersistJob.java:35"]; } subgraph cluster103538 { label="Exchange"; 44373 [labelType="html" label="ShuffledRowRDD [44373] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103536 { label="ObjectHashAggregate"; 44374 [labelType="html" label="MapPartitionsRDD [44374] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103529 { label="CartesianProduct"; 44375 [labelType="html" label="UnsafeCartesianRDD [44375] [Unordered]<br>parquet at PersistJob.java:35"]; 44376 [labelType="html" label="MapPartitionsRDD [44376] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103543 { label="Scan csv "; 44377 [labelType="html" label="FileScanRDD [44377]<br>parquet at PersistJob.java:35"]; 44378 [labelType="html" label="MapPartitionsRDD [44378]<br>parquet at PersistJob.java:35"]; } subgraph cluster103539 { label="WholeStageCodegen (41)"; 44379 [labelType="html" label="MapPartitionsRDD [44379]<br>parquet at PersistJob.java:35"]; } subgraph cluster103528 { label="CartesianProduct"; 44380 [labelType="html" label="UnsafeCartesianRDD [44380] [Unordered]<br>parquet at PersistJob.java:35"]; 44381 [labelType="html" label="MapPartitionsRDD [44381] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103524 { label="WholeStageCodegen (42)"; 44382 [labelType="html" label="MapPartitionsRDD [44382] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103523 { label="ObjectHashAggregate"; 44383 [labelType="html" label="MapPartitionsRDD [44383] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103522 { label="Exchange"; 44384 [labelType="html" label="MapPartitionsRDD [44384] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44370->44371; 44371->44372; 44373->44374; 44372->44375; 44374->44375; 44375->44376; 44377->44378; 44378->44379; 44376->44380; 44379->44380; 44380->44381; 44381->44382; 44382->44383; 44383->44384; }
44250,44373
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time