3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7721 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 12
Input Size / Records:
19.0 MiB / 1115968
Associated Job Ids:
3748
DAG Visualization
digraph G { subgraph clusterstage_7721 { label="Stage 7721"; subgraph cluster49794 { label="Scan parquet "; 21968 [labelType="html" label="FileScanRDD [21968]<br>parquet at PersistJob.java:35"]; 21969 [labelType="html" label="MapPartitionsRDD [21969]<br>parquet at PersistJob.java:35"]; } subgraph cluster49789 { label="WholeStageCodegen (1)"; 21970 [labelType="html" label="MapPartitionsRDD [21970]<br>parquet at PersistJob.java:35"]; } subgraph cluster49799 { label="Scan csv "; 21971 [labelType="html" label="FileScanRDD [21971]<br>parquet at PersistJob.java:35"]; 21972 [labelType="html" label="MapPartitionsRDD [21972]<br>parquet at PersistJob.java:35"]; } subgraph cluster49795 { label="WholeStageCodegen (2)"; 21973 [labelType="html" label="MapPartitionsRDD [21973]<br>parquet at PersistJob.java:35"]; } subgraph cluster49788 { label="CartesianProduct"; 21974 [labelType="html" label="UnsafeCartesianRDD [21974]<br>parquet at PersistJob.java:35"]; 21975 [labelType="html" label="MapPartitionsRDD [21975]<br>parquet at PersistJob.java:35"]; } subgraph cluster49804 { label="Scan csv "; 21976 [labelType="html" label="FileScanRDD [21976]<br>parquet at PersistJob.java:35"]; 21977 [labelType="html" label="MapPartitionsRDD [21977]<br>parquet at PersistJob.java:35"]; } subgraph cluster49800 { label="WholeStageCodegen (3)"; 21978 [labelType="html" label="MapPartitionsRDD [21978]<br>parquet at PersistJob.java:35"]; } subgraph cluster49787 { label="CartesianProduct"; 21979 [labelType="html" label="UnsafeCartesianRDD [21979]<br>parquet at PersistJob.java:35"]; 21980 [labelType="html" label="MapPartitionsRDD [21980]<br>parquet at PersistJob.java:35"]; } subgraph cluster49784 { label="WholeStageCodegen (4)"; 21981 [labelType="html" label="MapPartitionsRDD [21981]<br>parquet at PersistJob.java:35"]; } subgraph cluster49783 { label="Exchange"; 21982 [labelType="html" label="MapPartitionsRDD [21982]<br>parquet at PersistJob.java:35"]; } } 21968->21969; 21969->21970; 21971->21972; 21972->21973; 21970->21974; 21973->21974; 21974->21975; 21976->21977; 21977->21978; 21975->21979; 21978->21979; 21979->21980; 21980->21981; 21981->21982; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time