3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15724 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
21 s
Locality Level Summary:
Process local: 10
Input Size / Records:
15.8 MiB / 2231133
Associated Job Ids:
7962
DAG Visualization
digraph G { subgraph clusterstage_15724 { label="Stage 15724"; subgraph cluster102808 { label="Scan parquet "; 43924 [labelType="html" label="FileScanRDD [43924]<br>rdd at PersistJob.java:28"]; 43925 [labelType="html" label="MapPartitionsRDD [43925]<br>rdd at PersistJob.java:28"]; } subgraph cluster102803 { label="WholeStageCodegen (2)"; 43926 [labelType="html" label="MapPartitionsRDD [43926]<br>rdd at PersistJob.java:28"]; } subgraph cluster102813 { label="Scan csv "; 43927 [labelType="html" label="FileScanRDD [43927]<br>rdd at PersistJob.java:28"]; 43928 [labelType="html" label="MapPartitionsRDD [43928]<br>rdd at PersistJob.java:28"]; } subgraph cluster102809 { label="WholeStageCodegen (3)"; 43929 [labelType="html" label="MapPartitionsRDD [43929]<br>rdd at PersistJob.java:28"]; } subgraph cluster102802 { label="CartesianProduct"; 43930 [labelType="html" label="UnsafeCartesianRDD [43930]<br>rdd at PersistJob.java:28"]; 43931 [labelType="html" label="MapPartitionsRDD [43931]<br>rdd at PersistJob.java:28"]; } subgraph cluster102798 { label="WholeStageCodegen (4)"; 43932 [labelType="html" label="MapPartitionsRDD [43932]<br>rdd at PersistJob.java:28"]; } subgraph cluster102797 { label="ObjectHashAggregate"; 43933 [labelType="html" label="MapPartitionsRDD [43933]<br>rdd at PersistJob.java:28"]; } subgraph cluster102796 { label="Exchange"; 43934 [labelType="html" label="MapPartitionsRDD [43934]<br>rdd at PersistJob.java:28"]; } } 43924->43925; 43925->43926; 43927->43928; 43928->43929; 43926->43930; 43929->43930; 43930->43931; 43931->43932; 43932->43933; 43933->43934; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time