3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7845 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.9 KiB / 533
Shuffle Write Size / Records:
4.2 KiB / 210
Associated Job Ids:
3836
DAG Visualization
digraph G { subgraph clusterstage_7845 { label="Stage 7845"; subgraph cluster51120 { label="AQEShuffleRead"; 22603 [labelType="html" label="ShuffledRowRDD [22603] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51117 { label="WholeStageCodegen (17)"; 22604 [labelType="html" label="MapPartitionsRDD [22604] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51125 { label="AQEShuffleRead"; 22605 [labelType="html" label="ShuffledRowRDD [22605] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51122 { label="WholeStageCodegen (18)"; 22606 [labelType="html" label="MapPartitionsRDD [22606] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51113 { label="WholeStageCodegen (19)"; 22607 [labelType="html" label="ZippedPartitionsRDD2 [22607] [Unordered]<br>rdd at PersistJob.java:28"]; 22608 [labelType="html" label="MapPartitionsRDD [22608] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51130 { label="Scan csv "; 22609 [labelType="html" label="FileScanRDD [22609]<br>rdd at PersistJob.java:28"]; 22610 [labelType="html" label="MapPartitionsRDD [22610]<br>rdd at PersistJob.java:28"]; } subgraph cluster51126 { label="WholeStageCodegen (20)"; 22611 [labelType="html" label="MapPartitionsRDD [22611]<br>rdd at PersistJob.java:28"]; } subgraph cluster51112 { label="CartesianProduct"; 22612 [labelType="html" label="UnsafeCartesianRDD [22612] [Unordered]<br>rdd at PersistJob.java:28"]; 22613 [labelType="html" label="MapPartitionsRDD [22613] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51109 { label="WholeStageCodegen (21)"; 22614 [labelType="html" label="MapPartitionsRDD [22614] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51108 { label="Exchange"; 22615 [labelType="html" label="MapPartitionsRDD [22615] [Unordered]<br>rdd at PersistJob.java:28"]; } } 22603->22604; 22605->22606; 22604->22607; 22606->22607; 22607->22608; 22609->22610; 22610->22611; 22608->22612; 22611->22612; 22612->22613; 22613->22614; 22614->22615; }
22598,22603
22602,22605
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time