3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16698 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 3
Input Size / Records:
10.8 KiB / 3
Shuffle Read Size / Records:
4.1 MiB / 270457
Shuffle Write Size / Records:
1784.9 KiB / 76341
Associated Job Ids:
8131
DAG Visualization
digraph G { subgraph clusterstage_16698 { label="Stage 16698"; subgraph cluster106637 { label="AQEShuffleRead"; 45502 [labelType="html" label="ShuffledRowRDD [45502] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106634 { label="WholeStageCodegen (9)"; 45503 [labelType="html" label="MapPartitionsRDD [45503] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106633 { label="Window"; 45504 [labelType="html" label="MapPartitionsRDD [45504] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106630 { label="WholeStageCodegen (10)"; 45505 [labelType="html" label="MapPartitionsRDD [45505] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106629 { label="Window"; 45506 [labelType="html" label="MapPartitionsRDD [45506] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106625 { label="WholeStageCodegen (11)"; 45507 [labelType="html" label="MapPartitionsRDD [45507] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106642 { label="Scan parquet "; 45508 [labelType="html" label="FileScanRDD [45508]<br>rdd at PersistJob.java:28"]; 45509 [labelType="html" label="MapPartitionsRDD [45509]<br>rdd at PersistJob.java:28"]; } subgraph cluster106638 { label="WholeStageCodegen (12)"; 45510 [labelType="html" label="MapPartitionsRDD [45510]<br>rdd at PersistJob.java:28"]; } subgraph cluster106624 { label="CartesianProduct"; 45511 [labelType="html" label="UnsafeCartesianRDD [45511] [Unordered]<br>rdd at PersistJob.java:28"]; 45512 [labelType="html" label="MapPartitionsRDD [45512] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106621 { label="WholeStageCodegen (13)"; 45513 [labelType="html" label="MapPartitionsRDD [45513] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106620 { label="Exchange"; 45514 [labelType="html" label="MapPartitionsRDD [45514] [Unordered]<br>rdd at PersistJob.java:28"]; } } 45502->45503; 45503->45504; 45504->45505; 45505->45506; 45506->45507; 45508->45509; 45509->45510; 45507->45511; 45510->45511; 45511->45512; 45512->45513; 45513->45514; }
45501,45502
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time