3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13575 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Any: 10
Input Size / Records:
92.4 MiB / 2231133
Shuffle Read Size / Records:
460.0 B / 10
Shuffle Write Size / Records:
8.5 MiB / 256548
Associated Job Ids:
6807
DAG Visualization
digraph G { subgraph clusterstage_13575 { label="Stage 13575"; subgraph cluster88442 { label="Scan parquet "; 37648 [labelType="html" label="FileScanRDD [37648]<br>rdd at PersistJob.java:28"]; 37649 [labelType="html" label="MapPartitionsRDD [37649]<br>rdd at PersistJob.java:28"]; } subgraph cluster88437 { label="WholeStageCodegen (46)"; 37650 [labelType="html" label="MapPartitionsRDD [37650]<br>rdd at PersistJob.java:28"]; } subgraph cluster88447 { label="Scan csv "; 37651 [labelType="html" label="FileScanRDD [37651]<br>rdd at PersistJob.java:28"]; 37652 [labelType="html" label="MapPartitionsRDD [37652]<br>rdd at PersistJob.java:28"]; } subgraph cluster88443 { label="WholeStageCodegen (47)"; 37653 [labelType="html" label="MapPartitionsRDD [37653]<br>rdd at PersistJob.java:28"]; } subgraph cluster88436 { label="CartesianProduct"; 37654 [labelType="html" label="UnsafeCartesianRDD [37654]<br>rdd at PersistJob.java:28"]; 37655 [labelType="html" label="MapPartitionsRDD [37655]<br>rdd at PersistJob.java:28"]; } subgraph cluster88433 { label="WholeStageCodegen (48)"; 37656 [labelType="html" label="MapPartitionsRDD [37656]<br>rdd at PersistJob.java:28"]; } subgraph cluster88452 { label="Exchange"; 37657 [labelType="html" label="ShuffledRowRDD [37657] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88448 { label="WholeStageCodegen (49)"; 37658 [labelType="html" label="MapPartitionsRDD [37658] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88432 { label="CartesianProduct"; 37659 [labelType="html" label="UnsafeCartesianRDD [37659] [Unordered]<br>rdd at PersistJob.java:28"]; 37660 [labelType="html" label="MapPartitionsRDD [37660] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88429 { label="WholeStageCodegen (50)"; 37661 [labelType="html" label="MapPartitionsRDD [37661] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88428 { label="Exchange"; 37662 [labelType="html" label="MapPartitionsRDD [37662] [Unordered]<br>rdd at PersistJob.java:28"]; } } 37648->37649; 37649->37650; 37651->37652; 37652->37653; 37650->37654; 37653->37654; 37654->37655; 37655->37656; 37657->37658; 37656->37659; 37658->37659; 37659->37660; 37660->37661; 37661->37662; }
37523,37657
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time