3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5742 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
886.4 KiB / 29323
Associated Job Ids:
3089
DAG Visualization
digraph G { subgraph clusterstage_5742 { label="Stage 5742"; subgraph cluster36427 { label="AQEShuffleRead"; 15081 [labelType="html" label="ShuffledRowRDD [15081] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36424 { label="WholeStageCodegen (7)"; 15082 [labelType="html" label="MapPartitionsRDD [15082] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36423 { label="Window"; 15083 [labelType="html" label="MapPartitionsRDD [15083] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36420 { label="WholeStageCodegen (8)"; 15084 [labelType="html" label="MapPartitionsRDD [15084] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36419 { label="Window"; 15085 [labelType="html" label="MapPartitionsRDD [15085] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36416 { label="WholeStageCodegen (9)"; 15086 [labelType="html" label="MapPartitionsRDD [15086] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36432 { label="AQEShuffleRead"; 15087 [labelType="html" label="ShuffledRowRDD [15087] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36429 { label="WholeStageCodegen (10)"; 15088 [labelType="html" label="MapPartitionsRDD [15088] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36411 { label="WholeStageCodegen (11)"; 15089 [labelType="html" label="ZippedPartitionsRDD2 [15089] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 15090 [labelType="html" label="MapPartitionsRDD [15090] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36410 { label="Window"; 15091 [labelType="html" label="MapPartitionsRDD [15091] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36401 { label="WholeStageCodegen (12)"; 15092 [labelType="html" label="MapPartitionsRDD [15092] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36433 { label="mapPartitionsInternal"; 15093 [labelType="html" label="MapPartitionsRDD [15093] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 15081->15082; 15082->15083; 15083->15084; 15084->15085; 15085->15086; 15087->15088; 15086->15089; 15088->15089; 15089->15090; 15090->15091; 15091->15092; 15092->15093; }
15080,15081
15075,15087
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time