hdh-spark-job - Details for Job 431

Status: SUCCEEDED
Submitted: 2026/09/04 09:05:54
Duration: 10 ms
Associated SQL Query: 116
Job Group: 7aef4493-60de-41d6-bd95-06c098681e92
Completed Stages: 1

Event Timeline

Enable zooming

DAG Visualization

Completed Stages (1)

Page:

Stage Id ▾	Description	Submitted	Duration	Tasks: Succeeded/Total	Input	Output	Shuffle Read	Shuffle Write
458	DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:324 +details org.apache.spark.sql.DataFrameReader.csv(DataFrameReader.scala:538) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvFile(DataFrameCommonJob.java:324) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvAndGetDataSet(DataFrameCommonJob.java:193) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadCsv(DataFrameStructuredLoaderJob.java:315) com.adb.hdh.spark.job.impl.DataFrameCommonJob.createEmptyDataFrame(DataFrameCommonJob.java:430) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadUet(DataFrameStructuredLoaderJob.java:130) com.adb.hdh.spark.job.impl.CommonJob.getDataFrame(CommonJob.java:27) com.adb.hdh.spark.job.impl.LoadJob.exec(LoadJob.java:19) com.adb.hdh.spark.job.server.JobDispatcher.createFrames(JobDispatcher.java:339) com.adb.hdh.spark.job.server.JobDispatcher.dispatch(JobDispatcher.java:152) com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.runJob(JobSubmitHandler.java:76) com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.lambda$handle$0(JobSubmitHandler.java:59) java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) java.base/java.util.concurrent.FutureTask.run(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) java.base/java.lang.Thread.run(Unknown Source)	2026/09/04 09:05:54	7 ms	1/1	18.0 B

Stage Id ▾

Description

Submitted

Duration

Tasks: Succeeded/Total

Input

Output

Shuffle Read

Shuffle Write

458

DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:324 +details

org.apache.spark.sql.DataFrameReader.csv(DataFrameReader.scala:538)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvFile(DataFrameCommonJob.java:324)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvAndGetDataSet(DataFrameCommonJob.java:193)
com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadCsv(DataFrameStructuredLoaderJob.java:315)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.createEmptyDataFrame(DataFrameCommonJob.java:430)
com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadUet(DataFrameStructuredLoaderJob.java:130)
com.adb.hdh.spark.job.impl.CommonJob.getDataFrame(CommonJob.java:27)
com.adb.hdh.spark.job.impl.LoadJob.exec(LoadJob.java:19)
com.adb.hdh.spark.job.server.JobDispatcher.createFrames(JobDispatcher.java:339)
com.adb.hdh.spark.job.server.JobDispatcher.dispatch(JobDispatcher.java:152)
com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.runJob(JobSubmitHandler.java:76)
com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.lambda$handle$0(JobSubmitHandler.java:59)
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
java.base/java.util.concurrent.FutureTask.run(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base/java.lang.Thread.run(Unknown Source)

2026/09/04 09:05:54

7 ms

1/1

18.0 B

Page: