3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17348 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Input Size / Records:
174.0 B / 1
Shuffle Read Size / Records:
4.9 KiB / 500
Shuffle Write Size / Records:
2.8 KiB / 177
Associated Job Ids:
9189
DAG Visualization
digraph G { subgraph clusterstage_17348 { label="Stage 17348"; subgraph cluster112853 { label="AQEShuffleRead"; 47975 [labelType="html" label="ShuffledRowRDD [47975] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112840 { label="WholeStageCodegen (17)"; 47976 [labelType="html" label="MapPartitionsRDD [47976] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112858 { label="AQEShuffleRead"; 47977 [labelType="html" label="ShuffledRowRDD [47977] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112855 { label="WholeStageCodegen (18)"; 47978 [labelType="html" label="MapPartitionsRDD [47978] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112835 { label="WholeStageCodegen (19)"; 47979 [labelType="html" label="ZippedPartitionsRDD2 [47979] [Unordered]<br>count at ColumnStatJob.java:47"]; 47980 [labelType="html" label="MapPartitionsRDD [47980] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112863 { label="Scan csv "; 47981 [labelType="html" label="FileScanRDD [47981]<br>count at ColumnStatJob.java:47"]; 47982 [labelType="html" label="MapPartitionsRDD [47982]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112859 { label="WholeStageCodegen (20)"; 47983 [labelType="html" label="MapPartitionsRDD [47983]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112834 { label="CartesianProduct"; 47984 [labelType="html" label="UnsafeCartesianRDD [47984] [Unordered]<br>count at ColumnStatJob.java:47"]; 47985 [labelType="html" label="MapPartitionsRDD [47985] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112831 { label="WholeStageCodegen (21)"; 47986 [labelType="html" label="MapPartitionsRDD [47986] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112830 { label="Exchange"; 47987 [labelType="html" label="MapPartitionsRDD [47987] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 47975->47976; 47977->47978; 47976->47979; 47978->47979; 47979->47980; 47981->47982; 47982->47983; 47980->47984; 47983->47984; 47984->47985; 47985->47986; 47986->47987; }
47970,47975
47974,47977
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time