3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9280 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 10
Input Size / Records:
2.3 MiB / 133183
Shuffle Read Size / Records:
4.7 KiB / 10
Shuffle Write Size / Records:
190.0 B / 1
Associated Job Ids:
4745
DAG Visualization
digraph G { subgraph clusterstage_9280 { label="Stage 9280"; subgraph cluster61125 { label="Scan parquet "; 26805 [labelType="html" label="FileScanRDD [26805]<br>parquet at PersistJob.java:35"]; 26806 [labelType="html" label="MapPartitionsRDD [26806]<br>parquet at PersistJob.java:35"]; } subgraph cluster61120 { label="WholeStageCodegen (25)"; 26807 [labelType="html" label="MapPartitionsRDD [26807]<br>parquet at PersistJob.java:35"]; } subgraph cluster61128 { label="Exchange"; 26808 [labelType="html" label="ShuffledRowRDD [26808] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61126 { label="ObjectHashAggregate"; 26809 [labelType="html" label="MapPartitionsRDD [26809] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61119 { label="CartesianProduct"; 26810 [labelType="html" label="UnsafeCartesianRDD [26810] [Unordered]<br>parquet at PersistJob.java:35"]; 26811 [labelType="html" label="MapPartitionsRDD [26811] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61133 { label="Scan csv "; 26812 [labelType="html" label="FileScanRDD [26812]<br>parquet at PersistJob.java:35"]; 26813 [labelType="html" label="MapPartitionsRDD [26813]<br>parquet at PersistJob.java:35"]; } subgraph cluster61129 { label="WholeStageCodegen (26)"; 26814 [labelType="html" label="MapPartitionsRDD [26814]<br>parquet at PersistJob.java:35"]; } subgraph cluster61118 { label="CartesianProduct"; 26815 [labelType="html" label="UnsafeCartesianRDD [26815] [Unordered]<br>parquet at PersistJob.java:35"]; 26816 [labelType="html" label="MapPartitionsRDD [26816] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61114 { label="WholeStageCodegen (27)"; 26817 [labelType="html" label="MapPartitionsRDD [26817] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61113 { label="ObjectHashAggregate"; 26818 [labelType="html" label="MapPartitionsRDD [26818] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61112 { label="Exchange"; 26819 [labelType="html" label="MapPartitionsRDD [26819] [Unordered]<br>parquet at PersistJob.java:35"]; } } 26805->26806; 26806->26807; 26808->26809; 26807->26810; 26809->26810; 26810->26811; 26812->26813; 26813->26814; 26811->26815; 26814->26815; 26815->26816; 26816->26817; 26817->26818; 26818->26819; }
26724,26808
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time