hdh-spark-job - Details for Job 68

Status: SUCCEEDED
Submitted: 2026/10/26 19:37:09
Duration: 0.1 s
Associated SQL Query: 62
Job Group: 58cf7f0a-9153-4b67-9d98-8be1165d3f57
Completed Stages: 1

Event Timeline

Enable zooming

DAG Visualization

Completed Stages (1)

Page:

Stage Id ▾	Description	Submitted	Duration	Tasks: Succeeded/Total	Input	Output	Shuffle Read	Shuffle Write
77	DataFrameCommonJob_checkCSVSourceOncreation takeAsList at DataFrameCommonJob.java:143 +details org.apache.spark.sql.Dataset.takeAsList(Dataset.scala:3562) com.adb.hdh.spark.job.impl.DataFrameCommonJob.take(DataFrameCommonJob.java:143) com.adb.hdh.spark.job.impl.DataFrameCommonJob.checkFileTake(DataFrameCommonJob.java:1492) com.adb.hdh.spark.job.impl.DataFrameCommonJob.checkCsvFile(DataFrameCommonJob.java:241) com.adb.hdh.spark.job.server.JobDispatcher.dispatch(JobDispatcher.java:216) com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.runJob(JobSubmitHandler.java:76) com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.lambda$handle$0(JobSubmitHandler.java:59) java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) java.base/java.util.concurrent.FutureTask.run(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) java.base/java.lang.Thread.run(Unknown Source)	2026/10/26 19:37:09	0.1 s	1/1	256.0 KiB

Stage Id ▾

Description

Submitted

Duration

Tasks: Succeeded/Total

Input

Output

Shuffle Read

Shuffle Write

DataFrameCommonJob_checkCSVSourceOncreation takeAsList at DataFrameCommonJob.java:143 +details

org.apache.spark.sql.Dataset.takeAsList(Dataset.scala:3562)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.take(DataFrameCommonJob.java:143)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.checkFileTake(DataFrameCommonJob.java:1492)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.checkCsvFile(DataFrameCommonJob.java:241)
com.adb.hdh.spark.job.server.JobDispatcher.dispatch(JobDispatcher.java:216)
com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.runJob(JobSubmitHandler.java:76)
com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.lambda$handle$0(JobSubmitHandler.java:59)
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
java.base/java.util.concurrent.FutureTask.run(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base/java.lang.Thread.run(Unknown Source)

2026/10/26 19:37:09

0.1 s

1/1

256.0 KiB

Page: