3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16134 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Any: 5
Input Size / Records:
997.5 KiB / 74859
Shuffle Read Size / Records:
1365.0 B / 5
Associated Job Ids:
8138
DAG Visualization
digraph G { subgraph clusterstage_16134 { label="Stage 16134"; subgraph cluster105547 { label="Scan parquet "; 45369 [labelType="html" label="FileScanRDD [45369]<br>parquet at PersistJob.java:35"]; 45370 [labelType="html" label="MapPartitionsRDD [45370]<br>parquet at PersistJob.java:35"]; } subgraph cluster105542 { label="WholeStageCodegen (37)"; 45371 [labelType="html" label="MapPartitionsRDD [45371]<br>parquet at PersistJob.java:35"]; } subgraph cluster105550 { label="Exchange"; 45372 [labelType="html" label="ShuffledRowRDD [45372] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105548 { label="ObjectHashAggregate"; 45373 [labelType="html" label="MapPartitionsRDD [45373] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105541 { label="CartesianProduct"; 45374 [labelType="html" label="UnsafeCartesianRDD [45374] [Unordered]<br>parquet at PersistJob.java:35"]; 45375 [labelType="html" label="MapPartitionsRDD [45375] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105555 { label="Scan csv "; 45376 [labelType="html" label="FileScanRDD [45376]<br>parquet at PersistJob.java:35"]; 45377 [labelType="html" label="MapPartitionsRDD [45377]<br>parquet at PersistJob.java:35"]; } subgraph cluster105551 { label="WholeStageCodegen (38)"; 45378 [labelType="html" label="MapPartitionsRDD [45378]<br>parquet at PersistJob.java:35"]; } subgraph cluster105540 { label="CartesianProduct"; 45379 [labelType="html" label="UnsafeCartesianRDD [45379] [Unordered]<br>parquet at PersistJob.java:35"]; 45380 [labelType="html" label="MapPartitionsRDD [45380] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105536 { label="WholeStageCodegen (39)"; 45381 [labelType="html" label="MapPartitionsRDD [45381] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105535 { label="ObjectHashAggregate"; 45382 [labelType="html" label="MapPartitionsRDD [45382] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105534 { label="Exchange"; 45383 [labelType="html" label="MapPartitionsRDD [45383] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45369->45370; 45370->45371; 45372->45373; 45371->45374; 45373->45374; 45374->45375; 45376->45377; 45377->45378; 45375->45379; 45378->45379; 45379->45380; 45380->45381; 45381->45382; 45382->45383; }
45259,45372
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time