| Stage Id ▾ | Pool Name | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|---|
| 32070 | default | PersistFrame csv at DataFrameCommonJob.java:326 org.apache.spark.sql.DataFrameReader.csv(DataFrameReader.scala:538) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvFile(DataFrameCommonJob.java:326) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvAndGetDataSet(DataFrameCommonJob.java:195) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadCsv(DataFrameStructuredLoaderJob.java:268) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadUet(DataFrameStructuredLoaderJob.java:69) com.adb.hdh.spark.job.impl.CommonJob.getDataFrame(CommonJob.java:27) com.adb.hdh.spark.job.impl.LoadJob.exec(LoadJob.java:19) com.adb.hdh.spark.jobs.SparkJobRunnerService.createFrames(SparkJobRunnerService.java:338) com.adb.hdh.spark.jobs.SparkJobRunnerService.runJob(SparkJobRunnerService.java:76) com.adb.hdh.spark.jobs.AbstractJobThread.run(AbstractJobThread.java:47) java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) java.base/java.util.concurrent.FutureTask.run(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) java.base/java.lang.Thread.run(Unknown Source) | 2026/01/24 21:02:30 | 33 ms |
1/1
| 64.0 KiB |