3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18444 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
26.4 MiB / 358829
Shuffle Write Size / Records:
11.4 MiB / 262581
Associated Job Ids:
9233
DAG Visualization
digraph G { subgraph clusterstage_18444 { label="Stage 18444"; subgraph cluster120362 { label="Exchange"; 51665 [labelType="html" label="ShuffledRowRDD [51665] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120358 { label="WholeStageCodegen (12)"; 51666 [labelType="html" label="MapPartitionsRDD [51666] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120357 { label="Window"; 51667 [labelType="html" label="MapPartitionsRDD [51667] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120353 { label="WholeStageCodegen (13)"; 51668 [labelType="html" label="MapPartitionsRDD [51668] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120374 { label="AQEShuffleRead"; 51669 [labelType="html" label="ShuffledRowRDD [51669] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120371 { label="WholeStageCodegen (14)"; 51670 [labelType="html" label="MapPartitionsRDD [51670] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120381 { label="AQEShuffleRead"; 51671 [labelType="html" label="ShuffledRowRDD [51671] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120380 { label="ObjectHashAggregate"; 51672 [labelType="html" label="MapPartitionsRDD [51672] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120376 { label="WholeStageCodegen (15)"; 51673 [labelType="html" label="MapPartitionsRDD [51673] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120363 { label="WholeStageCodegen (16)"; 51674 [labelType="html" label="ZippedPartitionsRDD2 [51674] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 51675 [labelType="html" label="MapPartitionsRDD [51675] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120352 { label="Union"; 51676 [labelType="html" label="UnionRDD [51676] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120386 { label="Scan csv "; 51677 [labelType="html" label="FileScanRDD [51677]<br>takeAsList at DataFrameCommonJob.java:145"]; 51678 [labelType="html" label="MapPartitionsRDD [51678]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120382 { label="WholeStageCodegen (17)"; 51679 [labelType="html" label="MapPartitionsRDD [51679]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120351 { label="CartesianProduct"; 51680 [labelType="html" label="UnsafeCartesianRDD [51680] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 51681 [labelType="html" label="MapPartitionsRDD [51681] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120350 { label="Exchange"; 51682 [labelType="html" label="MapPartitionsRDD [51682] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 51665->51666; 51666->51667; 51667->51668; 51669->51670; 51671->51672; 51672->51673; 51670->51674; 51673->51674; 51674->51675; 51668->51676; 51675->51676; 51677->51678; 51678->51679; 51676->51680; 51679->51680; 51680->51681; 51681->51682; }
51650,51665
51623,51669
51639,51671
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time