3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7561 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Any: 3
Input Size / Records:
10.8 KiB / 3
Shuffle Read Size / Records:
4.1 MiB / 270457
Shuffle Write Size / Records:
1784.9 KiB / 76341
Associated Job Ids:
3695
DAG Visualization
digraph G { subgraph clusterstage_7561 { label="Stage 7561"; subgraph cluster49033 { label="AQEShuffleRead"; 21625 [labelType="html" label="ShuffledRowRDD [21625] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49030 { label="WholeStageCodegen (9)"; 21626 [labelType="html" label="MapPartitionsRDD [21626] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49029 { label="Window"; 21627 [labelType="html" label="MapPartitionsRDD [21627] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49026 { label="WholeStageCodegen (10)"; 21628 [labelType="html" label="MapPartitionsRDD [21628] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49025 { label="Window"; 21629 [labelType="html" label="MapPartitionsRDD [21629] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49021 { label="WholeStageCodegen (11)"; 21630 [labelType="html" label="MapPartitionsRDD [21630] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49038 { label="Scan parquet "; 21631 [labelType="html" label="FileScanRDD [21631]<br>parquet at PersistJob.java:35"]; 21632 [labelType="html" label="MapPartitionsRDD [21632]<br>parquet at PersistJob.java:35"]; } subgraph cluster49034 { label="WholeStageCodegen (12)"; 21633 [labelType="html" label="MapPartitionsRDD [21633]<br>parquet at PersistJob.java:35"]; } subgraph cluster49020 { label="CartesianProduct"; 21634 [labelType="html" label="UnsafeCartesianRDD [21634] [Unordered]<br>parquet at PersistJob.java:35"]; 21635 [labelType="html" label="MapPartitionsRDD [21635] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49017 { label="WholeStageCodegen (13)"; 21636 [labelType="html" label="MapPartitionsRDD [21636] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49016 { label="Exchange"; 21637 [labelType="html" label="MapPartitionsRDD [21637] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21625->21626; 21626->21627; 21627->21628; 21628->21629; 21629->21630; 21631->21632; 21632->21633; 21630->21634; 21633->21634; 21634->21635; 21635->21636; 21636->21637; }
21624,21625
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time