SP1 - Details for Job 4196

Status: SUCCEEDED
Submitted: 2026/09/21 10:47:37
Duration: 0.1 s
Associated SQL Query: 2857
Job Group: 7a6b9d22-e167-4266-b9e5-56aedf0509b7
Completed Stages: 1

Event Timeline

Enable zooming

DAG Visualization

Completed Stages (1)

Page:

Stage Id ▾	Pool Name	Description	Submitted	Duration	Tasks: Succeeded/Total	Input	Output	Shuffle Read	Shuffle Write
8449	default	DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:326 +details org.apache.spark.sql.DataFrameReader.csv(DataFrameReader.scala:538) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvFile(DataFrameCommonJob.java:326) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvAndGetDataSet(DataFrameCommonJob.java:195) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadCsv(DataFrameStructuredLoaderJob.java:272) com.adb.hdh.spark.job.impl.DataFrameCommonJob.createEmptyDataFrame(DataFrameCommonJob.java:432) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadUet(DataFrameStructuredLoaderJob.java:117) com.adb.hdh.spark.job.impl.CommonJob.getDataFrame(CommonJob.java:27) com.adb.hdh.spark.job.impl.LoadJob.exec(LoadJob.java:19) com.adb.hdh.spark.jobs.SparkJobRunnerService.createFrames(SparkJobRunnerService.java:338) com.adb.hdh.spark.jobs.SparkJobRunnerService.runJob(SparkJobRunnerService.java:140) com.adb.hdh.spark.jobs.AbstractJobThread.run(AbstractJobThread.java:47) java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) java.base/java.util.concurrent.FutureTask.run(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) java.base/java.lang.Thread.run(Unknown Source)	2026/09/21 10:47:37	48 ms	1/1	18.0 B

Stage Id ▾

Pool Name

Description

Submitted

Duration

Tasks: Succeeded/Total

Input

Output

Shuffle Read

Shuffle Write

8449

default

DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:326 +details

org.apache.spark.sql.DataFrameReader.csv(DataFrameReader.scala:538)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvFile(DataFrameCommonJob.java:326)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvAndGetDataSet(DataFrameCommonJob.java:195)
com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadCsv(DataFrameStructuredLoaderJob.java:272)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.createEmptyDataFrame(DataFrameCommonJob.java:432)
com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadUet(DataFrameStructuredLoaderJob.java:117)
com.adb.hdh.spark.job.impl.CommonJob.getDataFrame(CommonJob.java:27)
com.adb.hdh.spark.job.impl.LoadJob.exec(LoadJob.java:19)
com.adb.hdh.spark.jobs.SparkJobRunnerService.createFrames(SparkJobRunnerService.java:338)
com.adb.hdh.spark.jobs.SparkJobRunnerService.runJob(SparkJobRunnerService.java:140)
com.adb.hdh.spark.jobs.AbstractJobThread.run(AbstractJobThread.java:47)
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
java.base/java.util.concurrent.FutureTask.run(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base/java.lang.Thread.run(Unknown Source)

2026/09/21 10:47:37

48 ms

1/1

18.0 B

Page: