3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5415 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.2 min
Locality Level Summary:
Process local: 10
Input Size / Records:
141.1 MiB / 2199033
Shuffle Write Size / Records:
563.0 B / 10
Associated Job Ids:
2863
DAG Visualization
digraph G { subgraph clusterstage_5415 { label="Stage 5415"; subgraph cluster33772 { label="Scan parquet "; 13920 [labelType="html" label="FileScanRDD [13920]<br>count at ColumnStatJob.java:47"]; 13921 [labelType="html" label="MapPartitionsRDD [13921]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33768 { label="WholeStageCodegen (1)"; 13922 [labelType="html" label="MapPartitionsRDD [13922]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33777 { label="Scan csv "; 13923 [labelType="html" label="FileScanRDD [13923]<br>count at ColumnStatJob.java:47"]; 13924 [labelType="html" label="MapPartitionsRDD [13924]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33773 { label="WholeStageCodegen (2)"; 13925 [labelType="html" label="MapPartitionsRDD [13925]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33767 { label="CartesianProduct"; 13926 [labelType="html" label="UnsafeCartesianRDD [13926]<br>count at ColumnStatJob.java:47"]; 13927 [labelType="html" label="MapPartitionsRDD [13927]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33763 { label="WholeStageCodegen (3)"; 13928 [labelType="html" label="MapPartitionsRDD [13928]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33762 { label="Exchange"; 13929 [labelType="html" label="MapPartitionsRDD [13929]<br>count at ColumnStatJob.java:47"]; } } 13920->13921; 13921->13922; 13923->13924; 13924->13925; 13922->13926; 13925->13926; 13926->13927; 13927->13928; 13928->13929; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time