3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16694 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 9
Input Size / Records:
1575.0 B / 9
Shuffle Read Size / Records:
22.0 MiB / 1115964
Shuffle Write Size / Records:
4.1 MiB / 270457
Associated Job Ids:
8130
DAG Visualization
digraph G { subgraph clusterstage_16694 { label="Stage 16694"; subgraph cluster106609 { label="AQEShuffleRead"; 45489 [labelType="html" label="ShuffledRowRDD [45489] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106606 { label="WholeStageCodegen (4)"; 45490 [labelType="html" label="MapPartitionsRDD [45490] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106614 { label="AQEShuffleRead"; 45491 [labelType="html" label="ShuffledRowRDD [45491] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106611 { label="WholeStageCodegen (5)"; 45492 [labelType="html" label="MapPartitionsRDD [45492] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106602 { label="WholeStageCodegen (6)"; 45493 [labelType="html" label="ZippedPartitionsRDD2 [45493] [Unordered]<br>rdd at PersistJob.java:28"]; 45494 [labelType="html" label="MapPartitionsRDD [45494] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106619 { label="Scan csv "; 45495 [labelType="html" label="FileScanRDD [45495]<br>rdd at PersistJob.java:28"]; 45496 [labelType="html" label="MapPartitionsRDD [45496]<br>rdd at PersistJob.java:28"]; } subgraph cluster106615 { label="WholeStageCodegen (7)"; 45497 [labelType="html" label="MapPartitionsRDD [45497]<br>rdd at PersistJob.java:28"]; } subgraph cluster106601 { label="CartesianProduct"; 45498 [labelType="html" label="UnsafeCartesianRDD [45498] [Unordered]<br>rdd at PersistJob.java:28"]; 45499 [labelType="html" label="MapPartitionsRDD [45499] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106596 { label="WholeStageCodegen (8)"; 45500 [labelType="html" label="MapPartitionsRDD [45500] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106595 { label="Exchange"; 45501 [labelType="html" label="MapPartitionsRDD [45501] [Unordered]<br>rdd at PersistJob.java:28"]; } } 45489->45490; 45491->45492; 45490->45493; 45492->45493; 45493->45494; 45495->45496; 45496->45497; 45494->45498; 45497->45498; 45498->45499; 45499->45500; 45500->45501; }
45480,45489
45484,45491
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time