3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12869 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 ms
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.9 KiB / 533
Shuffle Write Size / Records:
4.1 KiB / 210
Associated Job Ids:
6329
DAG Visualization
digraph G { subgraph clusterstage_12869 { label="Stage 12869"; subgraph cluster83525 { label="AQEShuffleRead"; 35517 [labelType="html" label="ShuffledRowRDD [35517] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83522 { label="WholeStageCodegen (17)"; 35518 [labelType="html" label="MapPartitionsRDD [35518] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83530 { label="AQEShuffleRead"; 35519 [labelType="html" label="ShuffledRowRDD [35519] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83527 { label="WholeStageCodegen (18)"; 35520 [labelType="html" label="MapPartitionsRDD [35520] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83518 { label="WholeStageCodegen (19)"; 35521 [labelType="html" label="ZippedPartitionsRDD2 [35521] [Unordered]<br>parquet at PersistJob.java:35"]; 35522 [labelType="html" label="MapPartitionsRDD [35522] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83535 { label="Scan csv "; 35523 [labelType="html" label="FileScanRDD [35523]<br>parquet at PersistJob.java:35"]; 35524 [labelType="html" label="MapPartitionsRDD [35524]<br>parquet at PersistJob.java:35"]; } subgraph cluster83531 { label="WholeStageCodegen (20)"; 35525 [labelType="html" label="MapPartitionsRDD [35525]<br>parquet at PersistJob.java:35"]; } subgraph cluster83517 { label="CartesianProduct"; 35526 [labelType="html" label="UnsafeCartesianRDD [35526] [Unordered]<br>parquet at PersistJob.java:35"]; 35527 [labelType="html" label="MapPartitionsRDD [35527] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83514 { label="WholeStageCodegen (21)"; 35528 [labelType="html" label="MapPartitionsRDD [35528] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83513 { label="Exchange"; 35529 [labelType="html" label="MapPartitionsRDD [35529] [Unordered]<br>parquet at PersistJob.java:35"]; } } 35517->35518; 35519->35520; 35518->35521; 35520->35521; 35521->35522; 35523->35524; 35524->35525; 35522->35526; 35525->35526; 35526->35527; 35527->35528; 35528->35529; }
35512,35517
35516,35519
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time