3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16992 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.6 KiB / 500
Shuffle Write Size / Records:
3.8 KiB / 177
Associated Job Ids:
8277
DAG Visualization
digraph G { subgraph clusterstage_16992 { label="Stage 16992"; subgraph cluster108809 { label="AQEShuffleRead"; 46527 [labelType="html" label="ShuffledRowRDD [46527] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108806 { label="WholeStageCodegen (17)"; 46528 [labelType="html" label="MapPartitionsRDD [46528] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108814 { label="AQEShuffleRead"; 46529 [labelType="html" label="ShuffledRowRDD [46529] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108811 { label="WholeStageCodegen (18)"; 46530 [labelType="html" label="MapPartitionsRDD [46530] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108802 { label="WholeStageCodegen (19)"; 46531 [labelType="html" label="ZippedPartitionsRDD2 [46531] [Unordered]<br>rdd at PersistJob.java:28"]; 46532 [labelType="html" label="MapPartitionsRDD [46532] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108819 { label="Scan csv "; 46533 [labelType="html" label="FileScanRDD [46533]<br>rdd at PersistJob.java:28"]; 46534 [labelType="html" label="MapPartitionsRDD [46534]<br>rdd at PersistJob.java:28"]; } subgraph cluster108815 { label="WholeStageCodegen (20)"; 46535 [labelType="html" label="MapPartitionsRDD [46535]<br>rdd at PersistJob.java:28"]; } subgraph cluster108801 { label="CartesianProduct"; 46536 [labelType="html" label="UnsafeCartesianRDD [46536] [Unordered]<br>rdd at PersistJob.java:28"]; 46537 [labelType="html" label="MapPartitionsRDD [46537] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108798 { label="WholeStageCodegen (21)"; 46538 [labelType="html" label="MapPartitionsRDD [46538] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108797 { label="Exchange"; 46539 [labelType="html" label="MapPartitionsRDD [46539] [Unordered]<br>rdd at PersistJob.java:28"]; } } 46527->46528; 46529->46530; 46528->46531; 46530->46531; 46531->46532; 46533->46534; 46534->46535; 46532->46536; 46535->46536; 46536->46537; 46537->46538; 46538->46539; }
46522,46527
46526,46529
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time