3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13657 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
10 s
Locality Level Summary:
Any: 10
Input Size / Records:
15.5 MiB / 2231133
Shuffle Read Size / Records:
3.4 KiB / 10
Shuffle Write Size / Records:
4.9 KiB / 99
Associated Job Ids:
6832
DAG Visualization
digraph G { subgraph clusterstage_13657 { label="Stage 13657"; subgraph cluster88852 { label="Scan parquet "; 37879 [labelType="html" label="FileScanRDD [37879]<br>parquet at PersistJob.java:35"]; 37880 [labelType="html" label="MapPartitionsRDD [37880]<br>parquet at PersistJob.java:35"]; } subgraph cluster88847 { label="WholeStageCodegen (34)"; 37881 [labelType="html" label="MapPartitionsRDD [37881]<br>parquet at PersistJob.java:35"]; } subgraph cluster88855 { label="Exchange"; 37882 [labelType="html" label="ShuffledRowRDD [37882] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88853 { label="ObjectHashAggregate"; 37883 [labelType="html" label="MapPartitionsRDD [37883] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88846 { label="CartesianProduct"; 37884 [labelType="html" label="UnsafeCartesianRDD [37884] [Unordered]<br>parquet at PersistJob.java:35"]; 37885 [labelType="html" label="MapPartitionsRDD [37885] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88860 { label="Scan csv "; 37886 [labelType="html" label="FileScanRDD [37886]<br>parquet at PersistJob.java:35"]; 37887 [labelType="html" label="MapPartitionsRDD [37887]<br>parquet at PersistJob.java:35"]; } subgraph cluster88856 { label="WholeStageCodegen (35)"; 37888 [labelType="html" label="MapPartitionsRDD [37888]<br>parquet at PersistJob.java:35"]; } subgraph cluster88845 { label="CartesianProduct"; 37889 [labelType="html" label="UnsafeCartesianRDD [37889] [Unordered]<br>parquet at PersistJob.java:35"]; 37890 [labelType="html" label="MapPartitionsRDD [37890] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88841 { label="WholeStageCodegen (36)"; 37891 [labelType="html" label="MapPartitionsRDD [37891] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88840 { label="ObjectHashAggregate"; 37892 [labelType="html" label="MapPartitionsRDD [37892] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88839 { label="Exchange"; 37893 [labelType="html" label="MapPartitionsRDD [37893] [Unordered]<br>parquet at PersistJob.java:35"]; } } 37879->37880; 37880->37881; 37882->37883; 37881->37884; 37883->37884; 37884->37885; 37886->37887; 37887->37888; 37885->37889; 37888->37889; 37889->37890; 37890->37891; 37891->37892; 37892->37893; }
37779,37882
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time