3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5380 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
12 s
Locality Level Summary:
Any: 10
Input Size / Records:
19.6 MiB / 2199033
Shuffle Read Size / Records:
1840.0 B / 10
Shuffle Write Size / Records:
54.8 KiB / 1733
Associated Job Ids:
2844
DAG Visualization
digraph G { subgraph clusterstage_5380 { label="Stage 5380"; subgraph cluster33479 { label="Scan parquet "; 13789 [labelType="html" label="FileScanRDD [13789]<br>takeAsList at DataFrameCommonJob.java:143"]; 13790 [labelType="html" label="MapPartitionsRDD [13790]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster33474 { label="WholeStageCodegen (2)"; 13791 [labelType="html" label="MapPartitionsRDD [13791]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster33482 { label="Exchange"; 13792 [labelType="html" label="ShuffledRowRDD [13792] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster33480 { label="ObjectHashAggregate"; 13793 [labelType="html" label="MapPartitionsRDD [13793] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster33473 { label="CartesianProduct"; 13794 [labelType="html" label="UnsafeCartesianRDD [13794] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 13795 [labelType="html" label="MapPartitionsRDD [13795] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster33487 { label="Scan csv "; 13796 [labelType="html" label="FileScanRDD [13796]<br>takeAsList at DataFrameCommonJob.java:143"]; 13797 [labelType="html" label="MapPartitionsRDD [13797]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster33483 { label="WholeStageCodegen (3)"; 13798 [labelType="html" label="MapPartitionsRDD [13798]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster33472 { label="CartesianProduct"; 13799 [labelType="html" label="UnsafeCartesianRDD [13799] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 13800 [labelType="html" label="MapPartitionsRDD [13800] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster33468 { label="WholeStageCodegen (4)"; 13801 [labelType="html" label="MapPartitionsRDD [13801] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster33467 { label="ObjectHashAggregate"; 13802 [labelType="html" label="MapPartitionsRDD [13802] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster33466 { label="Exchange"; 13803 [labelType="html" label="MapPartitionsRDD [13803] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 13789->13790; 13790->13791; 13792->13793; 13791->13794; 13793->13794; 13794->13795; 13796->13797; 13797->13798; 13795->13799; 13798->13799; 13799->13800; 13800->13801; 13801->13802; 13802->13803; }
13788,13792
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time