3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16140 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 5
Input Size / Records:
4.5 MiB / 74864
Shuffle Read Size / Records:
230.0 B / 5
Shuffle Write Size / Records:
338.5 KiB / 9322
Associated Job Ids:
8141
DAG Visualization
digraph G { subgraph clusterstage_16140 { label="Stage 16140"; subgraph cluster105614 { label="Scan parquet "; 45414 [labelType="html" label="FileScanRDD [45414]<br>parquet at PersistJob.java:35"]; 45415 [labelType="html" label="MapPartitionsRDD [45415]<br>parquet at PersistJob.java:35"]; } subgraph cluster105609 { label="WholeStageCodegen (46)"; 45416 [labelType="html" label="MapPartitionsRDD [45416]<br>parquet at PersistJob.java:35"]; } subgraph cluster105619 { label="Scan csv "; 45417 [labelType="html" label="FileScanRDD [45417]<br>parquet at PersistJob.java:35"]; 45418 [labelType="html" label="MapPartitionsRDD [45418]<br>parquet at PersistJob.java:35"]; } subgraph cluster105615 { label="WholeStageCodegen (47)"; 45419 [labelType="html" label="MapPartitionsRDD [45419]<br>parquet at PersistJob.java:35"]; } subgraph cluster105608 { label="CartesianProduct"; 45420 [labelType="html" label="UnsafeCartesianRDD [45420]<br>parquet at PersistJob.java:35"]; 45421 [labelType="html" label="MapPartitionsRDD [45421]<br>parquet at PersistJob.java:35"]; } subgraph cluster105605 { label="WholeStageCodegen (48)"; 45422 [labelType="html" label="MapPartitionsRDD [45422]<br>parquet at PersistJob.java:35"]; } subgraph cluster105624 { label="Exchange"; 45423 [labelType="html" label="ShuffledRowRDD [45423] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105620 { label="WholeStageCodegen (49)"; 45424 [labelType="html" label="MapPartitionsRDD [45424] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105604 { label="CartesianProduct"; 45425 [labelType="html" label="UnsafeCartesianRDD [45425] [Unordered]<br>parquet at PersistJob.java:35"]; 45426 [labelType="html" label="MapPartitionsRDD [45426] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105601 { label="WholeStageCodegen (50)"; 45427 [labelType="html" label="MapPartitionsRDD [45427] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105600 { label="Exchange"; 45428 [labelType="html" label="MapPartitionsRDD [45428] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45414->45415; 45415->45416; 45417->45418; 45418->45419; 45416->45420; 45419->45420; 45420->45421; 45421->45422; 45423->45424; 45422->45425; 45424->45425; 45425->45426; 45426->45427; 45427->45428; }
45289,45423
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time