3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15740 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Any: 10
Input Size / Records:
16.3 MiB / 2231133
Shuffle Read Size / Records:
2020.0 B / 10
Shuffle Write Size / Records:
3.9 KiB / 78
Associated Job Ids:
7976
DAG Visualization
digraph G { subgraph clusterstage_15740 { label="Stage 15740"; subgraph cluster102948 { label="Scan parquet "; 44019 [labelType="html" label="FileScanRDD [44019]<br>rdd at PersistJob.java:28"]; 44020 [labelType="html" label="MapPartitionsRDD [44020]<br>rdd at PersistJob.java:28"]; } subgraph cluster102943 { label="WholeStageCodegen (28)"; 44021 [labelType="html" label="MapPartitionsRDD [44021]<br>rdd at PersistJob.java:28"]; } subgraph cluster102951 { label="Exchange"; 44022 [labelType="html" label="ShuffledRowRDD [44022] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102949 { label="ObjectHashAggregate"; 44023 [labelType="html" label="MapPartitionsRDD [44023] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102942 { label="CartesianProduct"; 44024 [labelType="html" label="UnsafeCartesianRDD [44024] [Unordered]<br>rdd at PersistJob.java:28"]; 44025 [labelType="html" label="MapPartitionsRDD [44025] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102956 { label="Scan csv "; 44026 [labelType="html" label="FileScanRDD [44026]<br>rdd at PersistJob.java:28"]; 44027 [labelType="html" label="MapPartitionsRDD [44027]<br>rdd at PersistJob.java:28"]; } subgraph cluster102952 { label="WholeStageCodegen (29)"; 44028 [labelType="html" label="MapPartitionsRDD [44028]<br>rdd at PersistJob.java:28"]; } subgraph cluster102941 { label="CartesianProduct"; 44029 [labelType="html" label="UnsafeCartesianRDD [44029] [Unordered]<br>rdd at PersistJob.java:28"]; 44030 [labelType="html" label="MapPartitionsRDD [44030] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102937 { label="WholeStageCodegen (30)"; 44031 [labelType="html" label="MapPartitionsRDD [44031] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102936 { label="ObjectHashAggregate"; 44032 [labelType="html" label="MapPartitionsRDD [44032] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102935 { label="Exchange"; 44033 [labelType="html" label="MapPartitionsRDD [44033] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44019->44020; 44020->44021; 44022->44023; 44021->44024; 44023->44024; 44024->44025; 44026->44027; 44027->44028; 44025->44029; 44028->44029; 44029->44030; 44030->44031; 44031->44032; 44032->44033; }
43939,44022
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time