| Stage Id ▾ | Pool Name | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|---|
| 50 | default | PersistFrame parquet at DataFrameCommonJob.java:487 org.apache.spark.sql.DataFrameReader.parquet(DataFrameReader.scala:548) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readParquetFiles(DataFrameCommonJob.java:487) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readParquetAndGetDataSet(DataFrameCommonJob.java:686) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadParquetOrBinary(DataFrameStructuredLoaderJob.java:318) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadUet(DataFrameStructuredLoaderJob.java:87) com.adb.hdh.spark.job.impl.CommonJob.getDataFrame(CommonJob.java:27) com.adb.hdh.spark.job.impl.LoadJob.exec(LoadJob.java:19) com.adb.hdh.spark.jobs.SparkJobRunnerService.createFrames(SparkJobRunnerService.java:338) com.adb.hdh.spark.jobs.SparkJobRunnerService.runJob(SparkJobRunnerService.java:76) com.adb.hdh.spark.jobs.AbstractJobThread.run(AbstractJobThread.java:47) java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) java.base/java.util.concurrent.FutureTask.run(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) java.base/java.lang.Thread.run(Unknown Source) | 2026/06/24 08:04:48 | 71 ms |
1/1
|