| Stage Id ▾ | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|
| 2700 | Listing leaf files and directories for 3691 paths: file:/data/input/depot/json/tmp/154/HTTP_FILE_0.json, ... json at DataReader.java:121 org.apache.spark.sql.DataFrameReader.json(DataFrameReader.scala:360) com.adb.hdh.spark.job.impl.DataReader.readJson(DataReader.java:121) com.adb.hdh.spark.job.impl.DataReader.read(DataReader.java:102) com.adb.hdh.spark.job.service.depot.SchemaAnalysisService.readFromDcRepoFiles(SchemaAnalysisService.java:94) com.adb.hdh.spark.job.service.depot.SchemaAnalysisService.executeTyped(SchemaAnalysisService.java:63) com.adb.hdh.spark.job.service.depot.SchemaAnalysisService.execute(SchemaAnalysisService.java:51) com.adb.hdh.spark.job.server.JobDispatcher.dispatch(JobDispatcher.java:78) com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.runJob(JobSubmitHandler.java:76) com.adb.hdh.spark.job.server.servlet.JobSubmitHandler.lambda$handle$0(JobSubmitHandler.java:59) java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) java.base/java.util.concurrent.FutureTask.run(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) java.base/java.lang.Thread.run(Unknown Source) | 2026/08/31 15:00:50 | 24 s |
3691/3691
|