3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15296 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
19.7 MiB / 259086
Shuffle Write Size / Records:
8.4 MiB / 175588
Associated Job Ids:
8058
DAG Visualization
digraph G { subgraph clusterstage_15296 { label="Stage 15296"; subgraph cluster98890 { label="Exchange"; 41782 [labelType="html" label="ShuffledRowRDD [41782] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98886 { label="WholeStageCodegen (12)"; 41783 [labelType="html" label="MapPartitionsRDD [41783] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98885 { label="Window"; 41784 [labelType="html" label="MapPartitionsRDD [41784] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98881 { label="WholeStageCodegen (13)"; 41785 [labelType="html" label="MapPartitionsRDD [41785] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98902 { label="AQEShuffleRead"; 41786 [labelType="html" label="ShuffledRowRDD [41786] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98899 { label="WholeStageCodegen (14)"; 41787 [labelType="html" label="MapPartitionsRDD [41787] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98909 { label="AQEShuffleRead"; 41788 [labelType="html" label="ShuffledRowRDD [41788] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98908 { label="ObjectHashAggregate"; 41789 [labelType="html" label="MapPartitionsRDD [41789] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98904 { label="WholeStageCodegen (15)"; 41790 [labelType="html" label="MapPartitionsRDD [41790] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98891 { label="WholeStageCodegen (16)"; 41791 [labelType="html" label="ZippedPartitionsRDD2 [41791] [Unordered]<br>rdd at PersistJob.java:21"]; 41792 [labelType="html" label="MapPartitionsRDD [41792] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98880 { label="Union"; 41793 [labelType="html" label="UnionRDD [41793] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98914 { label="Scan csv "; 41794 [labelType="html" label="FileScanRDD [41794]<br>rdd at PersistJob.java:21"]; 41795 [labelType="html" label="MapPartitionsRDD [41795]<br>rdd at PersistJob.java:21"]; } subgraph cluster98910 { label="WholeStageCodegen (17)"; 41796 [labelType="html" label="MapPartitionsRDD [41796]<br>rdd at PersistJob.java:21"]; } subgraph cluster98879 { label="CartesianProduct"; 41797 [labelType="html" label="UnsafeCartesianRDD [41797] [Unordered]<br>rdd at PersistJob.java:21"]; 41798 [labelType="html" label="MapPartitionsRDD [41798] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster98878 { label="Exchange"; 41799 [labelType="html" label="MapPartitionsRDD [41799] [Unordered]<br>rdd at PersistJob.java:21"]; } } 41782->41783; 41783->41784; 41784->41785; 41786->41787; 41788->41789; 41789->41790; 41787->41791; 41790->41791; 41791->41792; 41785->41793; 41792->41793; 41794->41795; 41795->41796; 41793->41797; 41796->41797; 41797->41798; 41798->41799; }
41781,41782
41764,41786
41774,41788
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time