3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13569 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.5 MiB / 2231123
Shuffle Read Size / Records:
2.7 KiB / 10
Associated Job Ids:
6804
DAG Visualization
digraph G { subgraph clusterstage_13569 { label="Stage 13569"; subgraph cluster88375 { label="Scan parquet "; 37603 [labelType="html" label="FileScanRDD [37603]<br>rdd at PersistJob.java:28"]; 37604 [labelType="html" label="MapPartitionsRDD [37604]<br>rdd at PersistJob.java:28"]; } subgraph cluster88370 { label="WholeStageCodegen (37)"; 37605 [labelType="html" label="MapPartitionsRDD [37605]<br>rdd at PersistJob.java:28"]; } subgraph cluster88378 { label="Exchange"; 37606 [labelType="html" label="ShuffledRowRDD [37606] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88376 { label="ObjectHashAggregate"; 37607 [labelType="html" label="MapPartitionsRDD [37607] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88369 { label="CartesianProduct"; 37608 [labelType="html" label="UnsafeCartesianRDD [37608] [Unordered]<br>rdd at PersistJob.java:28"]; 37609 [labelType="html" label="MapPartitionsRDD [37609] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88383 { label="Scan csv "; 37610 [labelType="html" label="FileScanRDD [37610]<br>rdd at PersistJob.java:28"]; 37611 [labelType="html" label="MapPartitionsRDD [37611]<br>rdd at PersistJob.java:28"]; } subgraph cluster88379 { label="WholeStageCodegen (38)"; 37612 [labelType="html" label="MapPartitionsRDD [37612]<br>rdd at PersistJob.java:28"]; } subgraph cluster88368 { label="CartesianProduct"; 37613 [labelType="html" label="UnsafeCartesianRDD [37613] [Unordered]<br>rdd at PersistJob.java:28"]; 37614 [labelType="html" label="MapPartitionsRDD [37614] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88364 { label="WholeStageCodegen (39)"; 37615 [labelType="html" label="MapPartitionsRDD [37615] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88363 { label="ObjectHashAggregate"; 37616 [labelType="html" label="MapPartitionsRDD [37616] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88362 { label="Exchange"; 37617 [labelType="html" label="MapPartitionsRDD [37617] [Unordered]<br>rdd at PersistJob.java:28"]; } } 37603->37604; 37604->37605; 37606->37607; 37605->37608; 37607->37608; 37608->37609; 37610->37611; 37611->37612; 37609->37613; 37612->37613; 37613->37614; 37614->37615; 37615->37616; 37616->37617; }
37493,37606
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time