3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7551 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 3
Input Size / Records:
10.8 KiB / 3
Shuffle Read Size / Records:
4.1 MiB / 270457
Shuffle Write Size / Records:
1784.9 KiB / 76341
Associated Job Ids:
3690
DAG Visualization
digraph G { subgraph clusterstage_7551 { label="Stage 7551"; subgraph cluster48950 { label="AQEShuffleRead"; 21578 [labelType="html" label="ShuffledRowRDD [21578] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48947 { label="WholeStageCodegen (9)"; 21579 [labelType="html" label="MapPartitionsRDD [21579] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48946 { label="Window"; 21580 [labelType="html" label="MapPartitionsRDD [21580] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48943 { label="WholeStageCodegen (10)"; 21581 [labelType="html" label="MapPartitionsRDD [21581] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48942 { label="Window"; 21582 [labelType="html" label="MapPartitionsRDD [21582] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48938 { label="WholeStageCodegen (11)"; 21583 [labelType="html" label="MapPartitionsRDD [21583] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48955 { label="Scan parquet "; 21584 [labelType="html" label="FileScanRDD [21584]<br>rdd at PersistJob.java:28"]; 21585 [labelType="html" label="MapPartitionsRDD [21585]<br>rdd at PersistJob.java:28"]; } subgraph cluster48951 { label="WholeStageCodegen (12)"; 21586 [labelType="html" label="MapPartitionsRDD [21586]<br>rdd at PersistJob.java:28"]; } subgraph cluster48937 { label="CartesianProduct"; 21587 [labelType="html" label="UnsafeCartesianRDD [21587] [Unordered]<br>rdd at PersistJob.java:28"]; 21588 [labelType="html" label="MapPartitionsRDD [21588] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48934 { label="WholeStageCodegen (13)"; 21589 [labelType="html" label="MapPartitionsRDD [21589] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48933 { label="Exchange"; 21590 [labelType="html" label="MapPartitionsRDD [21590] [Unordered]<br>rdd at PersistJob.java:28"]; } } 21578->21579; 21579->21580; 21580->21581; 21581->21582; 21582->21583; 21584->21585; 21585->21586; 21583->21587; 21586->21587; 21587->21588; 21588->21589; 21589->21590; }
21577,21578
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time