3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 45032 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
48 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
86.7 MiB / 1904714
Shuffle Read Size / Records:
16.9 MiB / 344297
Shuffle Write Size / Records:
106.2 MiB / 1898859
Associated Job Ids:
23891
DAG Visualization
digraph G { subgraph clusterstage_45032 { label="Stage 45032"; subgraph cluster310437 { label="Exchange"; 135915 [labelType="html" label="ShuffledRowRDD [135915] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster310433 { label="WholeStageCodegen (18)"; 135916 [labelType="html" label="MapPartitionsRDD [135916] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster310432 { label="Window"; 135917 [labelType="html" label="MapPartitionsRDD [135917] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster310430 { label="Filter"; 135918 [labelType="html" label="MapPartitionsRDD [135918] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster310429 { label="Project"; 135919 [labelType="html" label="MapPartitionsRDD [135919] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster310428 { label="Project"; 135920 [labelType="html" label="MapPartitionsRDD [135920] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster310427 { label="Project"; 135921 [labelType="html" label="MapPartitionsRDD [135921] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster310426 { label="Project"; 135922 [labelType="html" label="MapPartitionsRDD [135922] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster310425 { label="Project"; 135923 [labelType="html" label="MapPartitionsRDD [135923] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster310443 { label="Scan parquet "; 135924 [labelType="html" label="FileScanRDD [135924]<br>parquet at PersistJob.java:35"]; 135925 [labelType="html" label="MapPartitionsRDD [135925]<br>parquet at PersistJob.java:35"]; } subgraph cluster310438 { label="WholeStageCodegen (20)"; 135926 [labelType="html" label="MapPartitionsRDD [135926]<br>parquet at PersistJob.java:35"]; } subgraph cluster310416 { label="Union"; 135927 [labelType="html" label="UnionRDD [135927] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster310415 { label="Exchange"; 136014 [labelType="html" label="MapPartitionsRDD [136014] [Unordered]<br>parquet at PersistJob.java:35"]; } } 135915->135916; 135916->135917; 135917->135918; 135918->135919; 135919->135920; 135920->135921; 135921->135922; 135922->135923; 135924->135925; 135925->135926; 135923->135927; 135926->135927; 135927->136014; }
135914,135915
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time