3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16347 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
16 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
28.5 MiB / 598988
Shuffle Read Size / Records:
8.4 MiB / 175588
Shuffle Write Size / Records:
33.4 MiB / 605004
Associated Job Ids:
8521
DAG Visualization
digraph G { subgraph clusterstage_16347 { label="Stage 16347"; subgraph cluster105488 { label="AQEShuffleRead"; 44582 [labelType="html" label="ShuffledRowRDD [44582] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105485 { label="WholeStageCodegen (18)"; 44583 [labelType="html" label="MapPartitionsRDD [44583] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105484 { label="Window"; 44584 [labelType="html" label="MapPartitionsRDD [44584] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105482 { label="Filter"; 44585 [labelType="html" label="MapPartitionsRDD [44585] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105481 { label="Project"; 44586 [labelType="html" label="MapPartitionsRDD [44586] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105480 { label="Project"; 44587 [labelType="html" label="MapPartitionsRDD [44587] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105479 { label="Project"; 44588 [labelType="html" label="MapPartitionsRDD [44588] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105478 { label="Project"; 44589 [labelType="html" label="MapPartitionsRDD [44589] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105477 { label="Project"; 44590 [labelType="html" label="MapPartitionsRDD [44590] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105494 { label="Scan parquet "; 44591 [labelType="html" label="FileScanRDD [44591]<br>parquet at PersistJob.java:35"]; 44592 [labelType="html" label="MapPartitionsRDD [44592]<br>parquet at PersistJob.java:35"]; } subgraph cluster105489 { label="WholeStageCodegen (20)"; 44593 [labelType="html" label="MapPartitionsRDD [44593]<br>parquet at PersistJob.java:35"]; } subgraph cluster105468 { label="Union"; 44594 [labelType="html" label="UnionRDD [44594] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105467 { label="Exchange"; 44598 [labelType="html" label="MapPartitionsRDD [44598] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44582->44583; 44583->44584; 44584->44585; 44585->44586; 44586->44587; 44587->44588; 44588->44589; 44589->44590; 44591->44592; 44592->44593; 44590->44594; 44593->44594; 44594->44598; }
44581,44582
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time