3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7714 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 12
Input Size / Records:
20.4 MiB / 1115956
Associated Job Ids:
3741
DAG Visualization
digraph G { subgraph clusterstage_7714 { label="Stage 7714"; subgraph cluster49721 { label="Scan parquet "; 21920 [labelType="html" label="FileScanRDD [21920]<br>parquet at PersistJob.java:35"]; 21921 [labelType="html" label="MapPartitionsRDD [21921]<br>parquet at PersistJob.java:35"]; } subgraph cluster49717 { label="WholeStageCodegen (1)"; 21922 [labelType="html" label="MapPartitionsRDD [21922]<br>parquet at PersistJob.java:35"]; } subgraph cluster49726 { label="Scan csv "; 21923 [labelType="html" label="FileScanRDD [21923]<br>parquet at PersistJob.java:35"]; 21924 [labelType="html" label="MapPartitionsRDD [21924]<br>parquet at PersistJob.java:35"]; } subgraph cluster49722 { label="WholeStageCodegen (2)"; 21925 [labelType="html" label="MapPartitionsRDD [21925]<br>parquet at PersistJob.java:35"]; } subgraph cluster49716 { label="CartesianProduct"; 21926 [labelType="html" label="UnsafeCartesianRDD [21926]<br>parquet at PersistJob.java:35"]; 21927 [labelType="html" label="MapPartitionsRDD [21927]<br>parquet at PersistJob.java:35"]; } subgraph cluster49713 { label="WholeStageCodegen (3)"; 21928 [labelType="html" label="MapPartitionsRDD [21928]<br>parquet at PersistJob.java:35"]; } subgraph cluster49712 { label="Exchange"; 21929 [labelType="html" label="MapPartitionsRDD [21929]<br>parquet at PersistJob.java:35"]; } } 21920->21921; 21921->21922; 21923->21924; 21924->21925; 21922->21926; 21925->21926; 21926->21927; 21927->21928; 21928->21929; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time