3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 10318 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
14 s
Locality Level Summary:
Any: 7
Shuffle Read Size / Records:
20.2 MiB / 790666
Shuffle Write Size / Records:
20.2 MiB / 790389
Associated Job Ids:
4539
DAG Visualization
digraph G { subgraph clusterstage_10318 { label="Stage 10318"; subgraph cluster60574 { label="AQEShuffleRead"; 25650 [labelType="html" label="ShuffledRowRDD [25650] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60571 { label="WholeStageCodegen (24)"; 25651 [labelType="html" label="MapPartitionsRDD [25651] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60579 { label="AQEShuffleRead"; 25652 [labelType="html" label="ShuffledRowRDD [25652] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60576 { label="WholeStageCodegen (25)"; 25653 [labelType="html" label="MapPartitionsRDD [25653] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60567 { label="WholeStageCodegen (26)"; 25654 [labelType="html" label="ZippedPartitionsRDD2 [25654] [Unordered]<br>rdd at PersistJob.java:28"]; 25655 [labelType="html" label="MapPartitionsRDD [25655] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60584 { label="AQEShuffleRead"; 25656 [labelType="html" label="ShuffledRowRDD [25656] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60581 { label="WholeStageCodegen (27)"; 25657 [labelType="html" label="MapPartitionsRDD [25657] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60563 { label="WholeStageCodegen (28)"; 25658 [labelType="html" label="ZippedPartitionsRDD2 [25658] [Unordered]<br>rdd at PersistJob.java:28"]; 25659 [labelType="html" label="MapPartitionsRDD [25659] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60589 { label="AQEShuffleRead"; 25660 [labelType="html" label="ShuffledRowRDD [25660] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60586 { label="WholeStageCodegen (29)"; 25661 [labelType="html" label="MapPartitionsRDD [25661] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60559 { label="WholeStageCodegen (30)"; 25662 [labelType="html" label="ZippedPartitionsRDD2 [25662] [Unordered]<br>rdd at PersistJob.java:28"]; 25663 [labelType="html" label="MapPartitionsRDD [25663] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60558 { label="Exchange"; 25664 [labelType="html" label="MapPartitionsRDD [25664] [Unordered]<br>rdd at PersistJob.java:28"]; } } 25650->25651; 25652->25653; 25651->25654; 25653->25654; 25654->25655; 25656->25657; 25655->25658; 25657->25658; 25658->25659; 25660->25661; 25659->25662; 25661->25662; 25662->25663; 25663->25664; }
25649,25650
25600,25652
25604,25656
25608,25660
Event Timeline
Enable zooming
Tasks: 7. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time