3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15344 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
17 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
28.5 MiB / 598988
Shuffle Read Size / Records:
8.4 MiB / 175588
Shuffle Write Size / Records:
33.4 MiB / 605004
Associated Job Ids:
8069
DAG Visualization
digraph G { subgraph clusterstage_15344 { label="Stage 15344"; subgraph cluster99144 { label="AQEShuffleRead"; 41875 [labelType="html" label="ShuffledRowRDD [41875] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99141 { label="WholeStageCodegen (18)"; 41876 [labelType="html" label="MapPartitionsRDD [41876] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99140 { label="Window"; 41877 [labelType="html" label="MapPartitionsRDD [41877] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99138 { label="Filter"; 41878 [labelType="html" label="MapPartitionsRDD [41878] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99137 { label="Project"; 41879 [labelType="html" label="MapPartitionsRDD [41879] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99136 { label="Project"; 41880 [labelType="html" label="MapPartitionsRDD [41880] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99135 { label="Project"; 41881 [labelType="html" label="MapPartitionsRDD [41881] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99134 { label="Project"; 41882 [labelType="html" label="MapPartitionsRDD [41882] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99133 { label="Project"; 41883 [labelType="html" label="MapPartitionsRDD [41883] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99150 { label="Scan parquet "; 41884 [labelType="html" label="FileScanRDD [41884]<br>rdd at PersistJob.java:28"]; 41885 [labelType="html" label="MapPartitionsRDD [41885]<br>rdd at PersistJob.java:28"]; } subgraph cluster99145 { label="WholeStageCodegen (20)"; 41886 [labelType="html" label="MapPartitionsRDD [41886]<br>rdd at PersistJob.java:28"]; } subgraph cluster99124 { label="Union"; 41887 [labelType="html" label="UnionRDD [41887] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99123 { label="Exchange"; 41891 [labelType="html" label="MapPartitionsRDD [41891] [Unordered]<br>rdd at PersistJob.java:28"]; } } 41875->41876; 41876->41877; 41877->41878; 41878->41879; 41879->41880; 41880->41881; 41881->41882; 41882->41883; 41884->41885; 41885->41886; 41883->41887; 41886->41887; 41887->41891; }
41874,41875
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time