3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16138 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Any: 5
Input Size / Records:
997.5 KiB / 74864
Shuffle Read Size / Records:
1310.0 B / 5
Associated Job Ids:
8140
DAG Visualization
digraph G { subgraph clusterstage_16138 { label="Stage 16138"; subgraph cluster105591 { label="Scan parquet "; 45399 [labelType="html" label="FileScanRDD [45399]<br>parquet at PersistJob.java:35"]; 45400 [labelType="html" label="MapPartitionsRDD [45400]<br>parquet at PersistJob.java:35"]; } subgraph cluster105586 { label="WholeStageCodegen (43)"; 45401 [labelType="html" label="MapPartitionsRDD [45401]<br>parquet at PersistJob.java:35"]; } subgraph cluster105594 { label="Exchange"; 45402 [labelType="html" label="ShuffledRowRDD [45402] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105592 { label="ObjectHashAggregate"; 45403 [labelType="html" label="MapPartitionsRDD [45403] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105585 { label="CartesianProduct"; 45404 [labelType="html" label="UnsafeCartesianRDD [45404] [Unordered]<br>parquet at PersistJob.java:35"]; 45405 [labelType="html" label="MapPartitionsRDD [45405] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105599 { label="Scan csv "; 45406 [labelType="html" label="FileScanRDD [45406]<br>parquet at PersistJob.java:35"]; 45407 [labelType="html" label="MapPartitionsRDD [45407]<br>parquet at PersistJob.java:35"]; } subgraph cluster105595 { label="WholeStageCodegen (44)"; 45408 [labelType="html" label="MapPartitionsRDD [45408]<br>parquet at PersistJob.java:35"]; } subgraph cluster105584 { label="CartesianProduct"; 45409 [labelType="html" label="UnsafeCartesianRDD [45409] [Unordered]<br>parquet at PersistJob.java:35"]; 45410 [labelType="html" label="MapPartitionsRDD [45410] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105580 { label="WholeStageCodegen (45)"; 45411 [labelType="html" label="MapPartitionsRDD [45411] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105579 { label="ObjectHashAggregate"; 45412 [labelType="html" label="MapPartitionsRDD [45412] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105578 { label="Exchange"; 45413 [labelType="html" label="MapPartitionsRDD [45413] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45399->45400; 45400->45401; 45402->45403; 45401->45404; 45403->45404; 45404->45405; 45406->45407; 45407->45408; 45405->45409; 45408->45409; 45409->45410; 45410->45411; 45411->45412; 45412->45413; }
45274,45402
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time