hdh-spark-job - Details for Job 0

Status: SUCCEEDED
Submitted: 2026/10/26 10:22:11
Duration: 0.7 s
Associated SQL Query: 0
Job Group: 87b74c4c-a336-430c-afea-980690b7cd60
Completed Stages: 1

Event Timeline

Enable zooming

DAG Visualization

Completed Stages (1)

Page:

Stage Id ▾	Description	Submitted	Duration	Tasks: Succeeded/Total	Input	Output	Shuffle Read	Shuffle Write
0	PersistFrame first at DataFrameCommonJob.java:1681 +details org.apache.spark.sql.Dataset.first(Dataset.scala:3330) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readJsonUsingPath(DataFrameCommonJob.java:1681) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readJson(DataFrameCommonJob.java:621) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readJsonAndGetDataSet(DataFrameCommonJob.java:597) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadJson(DataFrameStructuredLoaderJob.java:540) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadUet(DataFrameStructuredLoaderJob.java:114) com.adb.hdh.spark.job.impl.CommonJob.getDataFrame(CommonJob.java:27) com.adb.hdh.spark.job.impl.PersistJob.exec(PersistJob.java:19) com.adb.hdh.spark.job.server.JobDispatcher.dispatch(JobDispatcher.java:94) com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.runJob(JobSubmitHandler.java:76) com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.lambda$handle$0(JobSubmitHandler.java:59) java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) java.base/java.util.concurrent.FutureTask.run(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) java.base/java.lang.Thread.run(Unknown Source)	2026/10/26 10:22:11	0.4 s	1/1	17.7 KiB

Stage Id ▾

Description

Submitted

Duration

Tasks: Succeeded/Total

Input

Output

Shuffle Read

Shuffle Write

PersistFrame first at DataFrameCommonJob.java:1681 +details

org.apache.spark.sql.Dataset.first(Dataset.scala:3330)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.readJsonUsingPath(DataFrameCommonJob.java:1681)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.readJson(DataFrameCommonJob.java:621)
com.adb.hdh.spark.job.impl.DataFrameCommonJob.readJsonAndGetDataSet(DataFrameCommonJob.java:597)
com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadJson(DataFrameStructuredLoaderJob.java:540)
com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadUet(DataFrameStructuredLoaderJob.java:114)
com.adb.hdh.spark.job.impl.CommonJob.getDataFrame(CommonJob.java:27)
com.adb.hdh.spark.job.impl.PersistJob.exec(PersistJob.java:19)
com.adb.hdh.spark.job.server.JobDispatcher.dispatch(JobDispatcher.java:94)
com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.runJob(JobSubmitHandler.java:76)
com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.lambda$handle$0(JobSubmitHandler.java:59)
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
java.base/java.util.concurrent.FutureTask.run(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base/java.lang.Thread.run(Unknown Source)

2026/10/26 10:22:11

0.4 s

1/1

17.7 KiB

Page: