3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17327 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
19.4 MiB / 254612
Shuffle Write Size / Records:
8.3 MiB / 171879
Associated Job Ids:
8693
DAG Visualization
digraph G { subgraph clusterstage_17327 { label="Stage 17327"; subgraph cluster113092 { label="Exchange"; 48584 [labelType="html" label="ShuffledRowRDD [48584] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113088 { label="WholeStageCodegen (12)"; 48585 [labelType="html" label="MapPartitionsRDD [48585] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113087 { label="Window"; 48586 [labelType="html" label="MapPartitionsRDD [48586] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113083 { label="WholeStageCodegen (13)"; 48587 [labelType="html" label="MapPartitionsRDD [48587] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113104 { label="AQEShuffleRead"; 48588 [labelType="html" label="ShuffledRowRDD [48588] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113101 { label="WholeStageCodegen (14)"; 48589 [labelType="html" label="MapPartitionsRDD [48589] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113111 { label="AQEShuffleRead"; 48590 [labelType="html" label="ShuffledRowRDD [48590] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113110 { label="ObjectHashAggregate"; 48591 [labelType="html" label="MapPartitionsRDD [48591] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113106 { label="WholeStageCodegen (15)"; 48592 [labelType="html" label="MapPartitionsRDD [48592] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113093 { label="WholeStageCodegen (16)"; 48593 [labelType="html" label="ZippedPartitionsRDD2 [48593] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 48594 [labelType="html" label="MapPartitionsRDD [48594] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113082 { label="Union"; 48595 [labelType="html" label="UnionRDD [48595] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113116 { label="Scan csv "; 48596 [labelType="html" label="FileScanRDD [48596]<br>takeAsList at DataFrameCommonJob.java:145"]; 48597 [labelType="html" label="MapPartitionsRDD [48597]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113112 { label="WholeStageCodegen (17)"; 48598 [labelType="html" label="MapPartitionsRDD [48598]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113081 { label="CartesianProduct"; 48599 [labelType="html" label="UnsafeCartesianRDD [48599] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 48600 [labelType="html" label="MapPartitionsRDD [48600] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113080 { label="Exchange"; 48601 [labelType="html" label="MapPartitionsRDD [48601] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 48584->48585; 48585->48586; 48586->48587; 48588->48589; 48590->48591; 48591->48592; 48589->48593; 48592->48593; 48593->48594; 48587->48595; 48594->48595; 48596->48597; 48597->48598; 48595->48599; 48598->48599; 48599->48600; 48600->48601; }
48571,48584
48548,48588
48558,48590
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time