3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9266 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
2.3 MiB / 133183
Associated Job Ids:
4732
DAG Visualization
digraph G { subgraph clusterstage_9266 { label="Stage 9266"; subgraph cluster61007 { label="Scan parquet "; 26725 [labelType="html" label="FileScanRDD [26725]<br>parquet at PersistJob.java:35"]; 26726 [labelType="html" label="MapPartitionsRDD [26726]<br>parquet at PersistJob.java:35"]; } subgraph cluster61002 { label="WholeStageCodegen (2)"; 26727 [labelType="html" label="MapPartitionsRDD [26727]<br>parquet at PersistJob.java:35"]; } subgraph cluster61012 { label="Scan csv "; 26728 [labelType="html" label="FileScanRDD [26728]<br>parquet at PersistJob.java:35"]; 26729 [labelType="html" label="MapPartitionsRDD [26729]<br>parquet at PersistJob.java:35"]; } subgraph cluster61008 { label="WholeStageCodegen (3)"; 26730 [labelType="html" label="MapPartitionsRDD [26730]<br>parquet at PersistJob.java:35"]; } subgraph cluster61001 { label="CartesianProduct"; 26731 [labelType="html" label="UnsafeCartesianRDD [26731]<br>parquet at PersistJob.java:35"]; 26732 [labelType="html" label="MapPartitionsRDD [26732]<br>parquet at PersistJob.java:35"]; } subgraph cluster60997 { label="WholeStageCodegen (4)"; 26733 [labelType="html" label="MapPartitionsRDD [26733]<br>parquet at PersistJob.java:35"]; } subgraph cluster60996 { label="ObjectHashAggregate"; 26734 [labelType="html" label="MapPartitionsRDD [26734]<br>parquet at PersistJob.java:35"]; } subgraph cluster60995 { label="Exchange"; 26735 [labelType="html" label="MapPartitionsRDD [26735]<br>parquet at PersistJob.java:35"]; } } 26725->26726; 26726->26727; 26728->26729; 26729->26730; 26727->26731; 26730->26731; 26731->26732; 26732->26733; 26733->26734; 26734->26735; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time