3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7557 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 9
Input Size / Records:
1575.0 B / 9
Shuffle Read Size / Records:
22.0 MiB / 1115964
Shuffle Write Size / Records:
4.1 MiB / 270457
Associated Job Ids:
3694
DAG Visualization
digraph G { subgraph clusterstage_7557 { label="Stage 7557"; subgraph cluster49005 { label="AQEShuffleRead"; 21612 [labelType="html" label="ShuffledRowRDD [21612] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49002 { label="WholeStageCodegen (4)"; 21613 [labelType="html" label="MapPartitionsRDD [21613] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49010 { label="AQEShuffleRead"; 21614 [labelType="html" label="ShuffledRowRDD [21614] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49007 { label="WholeStageCodegen (5)"; 21615 [labelType="html" label="MapPartitionsRDD [21615] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48998 { label="WholeStageCodegen (6)"; 21616 [labelType="html" label="ZippedPartitionsRDD2 [21616] [Unordered]<br>parquet at PersistJob.java:35"]; 21617 [labelType="html" label="MapPartitionsRDD [21617] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49015 { label="Scan csv "; 21618 [labelType="html" label="FileScanRDD [21618]<br>parquet at PersistJob.java:35"]; 21619 [labelType="html" label="MapPartitionsRDD [21619]<br>parquet at PersistJob.java:35"]; } subgraph cluster49011 { label="WholeStageCodegen (7)"; 21620 [labelType="html" label="MapPartitionsRDD [21620]<br>parquet at PersistJob.java:35"]; } subgraph cluster48997 { label="CartesianProduct"; 21621 [labelType="html" label="UnsafeCartesianRDD [21621] [Unordered]<br>parquet at PersistJob.java:35"]; 21622 [labelType="html" label="MapPartitionsRDD [21622] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48992 { label="WholeStageCodegen (8)"; 21623 [labelType="html" label="MapPartitionsRDD [21623] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48991 { label="Exchange"; 21624 [labelType="html" label="MapPartitionsRDD [21624] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21612->21613; 21614->21615; 21613->21616; 21615->21616; 21616->21617; 21618->21619; 21619->21620; 21617->21621; 21620->21621; 21621->21622; 21622->21623; 21623->21624; }
21603,21612
21607,21614
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time