3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17123 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
24 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
97.9 MiB / 2124462
Shuffle Read Size / Records:
11.4 MiB / 261221
Shuffle Write Size / Records:
116.4 MiB / 2127386
Associated Job Ids:
8333
DAG Visualization
digraph G { subgraph clusterstage_17123 { label="Stage 17123"; subgraph cluster109732 { label="Exchange"; 46902 [labelType="html" label="ShuffledRowRDD [46902] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109728 { label="WholeStageCodegen (18)"; 46903 [labelType="html" label="MapPartitionsRDD [46903] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109727 { label="Window"; 46904 [labelType="html" label="MapPartitionsRDD [46904] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109725 { label="Filter"; 46905 [labelType="html" label="MapPartitionsRDD [46905] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109724 { label="Project"; 46906 [labelType="html" label="MapPartitionsRDD [46906] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109723 { label="Project"; 46907 [labelType="html" label="MapPartitionsRDD [46907] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109722 { label="Project"; 46908 [labelType="html" label="MapPartitionsRDD [46908] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109721 { label="Project"; 46909 [labelType="html" label="MapPartitionsRDD [46909] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109720 { label="Project"; 46910 [labelType="html" label="MapPartitionsRDD [46910] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109738 { label="Scan parquet "; 46911 [labelType="html" label="FileScanRDD [46911]<br>rdd at PersistJob.java:28"]; 46912 [labelType="html" label="MapPartitionsRDD [46912]<br>rdd at PersistJob.java:28"]; } subgraph cluster109733 { label="WholeStageCodegen (20)"; 46913 [labelType="html" label="MapPartitionsRDD [46913]<br>rdd at PersistJob.java:28"]; } subgraph cluster109711 { label="Union"; 46914 [labelType="html" label="UnionRDD [46914] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109710 { label="Exchange"; 46918 [labelType="html" label="MapPartitionsRDD [46918] [Unordered]<br>rdd at PersistJob.java:28"]; } } 46902->46903; 46903->46904; 46904->46905; 46905->46906; 46906->46907; 46907->46908; 46908->46909; 46909->46910; 46911->46912; 46912->46913; 46910->46914; 46913->46914; 46914->46918; }
46901,46902
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time