3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17107 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
26.2 MiB / 357035
Shuffle Write Size / Records:
11.4 MiB / 261221
Associated Job Ids:
8331
DAG Visualization
digraph G { subgraph clusterstage_17107 { label="Stage 17107"; subgraph cluster109685 { label="Exchange"; 46884 [labelType="html" label="ShuffledRowRDD [46884] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109681 { label="WholeStageCodegen (12)"; 46885 [labelType="html" label="MapPartitionsRDD [46885] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109680 { label="Window"; 46886 [labelType="html" label="MapPartitionsRDD [46886] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109676 { label="WholeStageCodegen (13)"; 46887 [labelType="html" label="MapPartitionsRDD [46887] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109697 { label="AQEShuffleRead"; 46888 [labelType="html" label="ShuffledRowRDD [46888] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109694 { label="WholeStageCodegen (14)"; 46889 [labelType="html" label="MapPartitionsRDD [46889] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109704 { label="AQEShuffleRead"; 46890 [labelType="html" label="ShuffledRowRDD [46890] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109703 { label="ObjectHashAggregate"; 46891 [labelType="html" label="MapPartitionsRDD [46891] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109699 { label="WholeStageCodegen (15)"; 46892 [labelType="html" label="MapPartitionsRDD [46892] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109686 { label="WholeStageCodegen (16)"; 46893 [labelType="html" label="ZippedPartitionsRDD2 [46893] [Unordered]<br>rdd at PersistJob.java:28"]; 46894 [labelType="html" label="MapPartitionsRDD [46894] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109675 { label="Union"; 46895 [labelType="html" label="UnionRDD [46895] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109709 { label="Scan csv "; 46896 [labelType="html" label="FileScanRDD [46896]<br>rdd at PersistJob.java:28"]; 46897 [labelType="html" label="MapPartitionsRDD [46897]<br>rdd at PersistJob.java:28"]; } subgraph cluster109705 { label="WholeStageCodegen (17)"; 46898 [labelType="html" label="MapPartitionsRDD [46898]<br>rdd at PersistJob.java:28"]; } subgraph cluster109674 { label="CartesianProduct"; 46899 [labelType="html" label="UnsafeCartesianRDD [46899] [Unordered]<br>rdd at PersistJob.java:28"]; 46900 [labelType="html" label="MapPartitionsRDD [46900] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109673 { label="Exchange"; 46901 [labelType="html" label="MapPartitionsRDD [46901] [Unordered]<br>rdd at PersistJob.java:28"]; } } 46884->46885; 46885->46886; 46886->46887; 46888->46889; 46890->46891; 46891->46892; 46889->46893; 46892->46893; 46893->46894; 46887->46895; 46894->46895; 46896->46897; 46897->46898; 46895->46899; 46898->46899; 46899->46900; 46900->46901; }
46883,46884
46866,46888
46876,46890
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time