Spark Jobs (?)

Event Timeline

Active Jobs (1)

Page:
Job Id (Job Group) ▾ Description Submitted Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
316 (1a9bc782-1ff1-47be-aff9-8ebcd2cc1d79) Listing leaf files and directories for 3677 paths:
file:/data/input/depot/json/tmp/154/HTTP_FILE_0.json, ...
json at DataReader.java:121
2026/08/31 12:39:19 9 s 0/1
1397/3677 (3 running)
Page:

Completed Jobs (316)

Page:
Job Id (Job Group) ▾ Description Submitted Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
315 (deef041e-94e1-4b17-a059-652f118be849) DataFrameCommonJob_checkExtraction takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:31:46 22 ms 1/1
1/1
314 (deef041e-94e1-4b17-a059-652f118be849) DataFrameCommonJob_checkExtraction parquet at DataFrameCommonJob.java:466 2026/08/31 12:31:46 32 ms 1/1
1/1
313 (a934ab94-a551-4594-b197-437e6498687b) DepotPersistJob_persistJson parquet at DepotPersistJob.java:111 2026/08/31 12:31:36 0.2 s 1/1
1/1
312 (a934ab94-a551-4594-b197-437e6498687b) DepotPersistJob_persistJson first at DataFrameCommonJob.java:1691 2026/08/31 12:31:36 11 ms 1/1
1/1
311 (a934ab94-a551-4594-b197-437e6498687b) DepotPersistJob_persistJson first at DataFrameCommonJob.java:1683 2026/08/31 12:31:36 30 ms 1/1
1/1
310 (b8605dd2-3868-481d-a099-55aa7fe4a995) DataFrameCommonJob_checkJson first at DataFrameCommonJob.java:1691 2026/08/31 12:31:21 13 ms 1/1
1/1
309 (b8605dd2-3868-481d-a099-55aa7fe4a995) DataFrameCommonJob_checkJson first at DataFrameCommonJob.java:1683 2026/08/31 12:31:21 30 ms 1/1
1/1
308 (b9416033-53a8-4b2c-a884-b6e2f4902604) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:30:48 27 ms 1/1
1/1
307 (328c8d45-ca86-46f8-90af-f467f582adca) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 12:30:48 15 ms 1/1 (1 skipped)
1/1 (1 skipped)
306 (328c8d45-ca86-46f8-90af-f467f582adca) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 12:30:48 13 ms 1/1
1/1
305 (b9416033-53a8-4b2c-a884-b6e2f4902604) DataFrameCommonJob_dataExec parquet at CommonJob.java:47 2026/08/31 12:30:48 31 ms 1/1
1/1
304 (328c8d45-ca86-46f8-90af-f467f582adca) DataFrameCommonJob_dataExecSummary parquet at CommonJob.java:47 2026/08/31 12:30:48 48 ms 1/1
1/1
303 (555c1725-d877-4265-a0b1-4acce86a4d88) DepotPersistJob_persistJson parquet at DepotPersistJob.java:111 2026/08/31 12:29:37 0.6 s 1/1
9/9
302 (555c1725-d877-4265-a0b1-4acce86a4d88) DepotPersistJob_persistJson first at DataFrameCommonJob.java:1691 2026/08/31 12:29:37 14 ms 1/1
1/1
301 (555c1725-d877-4265-a0b1-4acce86a4d88) DepotPersistJob_persistJson first at DataFrameCommonJob.java:1683 2026/08/31 12:29:37 27 ms 1/1
1/1
300 (39021512-de7b-443e-a39c-7580adff3f29) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:23 13 ms 1/1
1/1
299 (39021512-de7b-443e-a39c-7580adff3f29) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:22 29 ms 1/1
1/1
298 (c0673962-ecf9-41bf-a7f9-7ea7b5e0dd5c) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:22 26 ms 1/1
1/1
297 (2eca2f92-1f41-4a96-b6de-ddc87031b9a5) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:22 28 ms 1/1
1/1
296 (98dcf39f-0554-487d-b31b-11c29b421f57) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:22 19 ms 1/1
1/1
295 (c0673962-ecf9-41bf-a7f9-7ea7b5e0dd5c) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:22 39 ms 1/1
1/1
294 (98dcf39f-0554-487d-b31b-11c29b421f57) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:22 40 ms 1/1
1/1
293 (2eca2f92-1f41-4a96-b6de-ddc87031b9a5) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:22 47 ms 1/1
1/1
292 (a0365bf6-745d-491f-a72d-e8c9e52e2f79) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:17 17 ms 1/1
1/1
291 (a0365bf6-745d-491f-a72d-e8c9e52e2f79) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:17 51 ms 1/1
1/1
290 (dbadfa9e-952e-4150-b3f8-e2e70e22ed0e) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:16 23 ms 1/1
1/1
289 (dbadfa9e-952e-4150-b3f8-e2e70e22ed0e) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:16 41 ms 1/1
1/1
288 (99635aaa-b2cd-4e96-b5cc-74273277f0a1) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:11 53 ms 1/1 (1 skipped)
1/1 (1 skipped)
287 (99635aaa-b2cd-4e96-b5cc-74273277f0a1) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:11 21 ms 1/1
1/1
286 (99635aaa-b2cd-4e96-b5cc-74273277f0a1) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:11 28 ms 1/1
1/1
285 (353383f1-4f80-4ec1-94bd-ae1aefec682c) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:11 17 ms 1/1
1/1
284 (353383f1-4f80-4ec1-94bd-ae1aefec682c) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:11 30 ms 1/1
1/1
283 (3d3d91ae-a2e1-4d3a-b21b-22057d7eb179) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:05 36 ms 1/1
1/1
282 (350d4a5a-fd81-406a-abfb-aa00d1ac6796) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:05 44 ms 1/1
1/1
281 (7ccbbc3a-df6c-4525-ab47-b77dcd2375c9) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:05 32 ms 1/1
1/1
280 (1de891c7-a994-4970-b610-c4cd781983ad) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:05 21 ms 1/1
1/1
279 (3d3d91ae-a2e1-4d3a-b21b-22057d7eb179) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:05 30 ms 1/1
1/1
278 (7ccbbc3a-df6c-4525-ab47-b77dcd2375c9) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:05 33 ms 1/1
1/1
277 (15d49e57-86ca-4997-9322-9f86b49dc47b) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:05 39 ms 1/1
1/1
276 (350d4a5a-fd81-406a-abfb-aa00d1ac6796) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:05 85 ms 1/1
1/1
275 (93d2d444-5414-4b0c-afe9-516a6d16c949) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:05 20 ms 1/1
1/1
274 (1de891c7-a994-4970-b610-c4cd781983ad) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:05 51 ms 1/1
1/1
273 (a48d2303-2c7e-43cb-bce3-931829b49c16) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:28:05 74 ms 1/1
1/1
272 (93d2d444-5414-4b0c-afe9-516a6d16c949) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:05 36 ms 1/1
1/1
271 (15d49e57-86ca-4997-9322-9f86b49dc47b) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:05 59 ms 1/1
1/1
270 (a48d2303-2c7e-43cb-bce3-931829b49c16) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:28:05 64 ms 1/1
1/1
269 (6490d5df-a449-47f9-865a-f8c8c8990f51) DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:27:35 24 ms 1/1 (1 skipped)
1/1 (1 skipped)
268 (6490d5df-a449-47f9-865a-f8c8c8990f51) DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:27:34 64 ms 1/1
1/1
267 (6490d5df-a449-47f9-865a-f8c8c8990f51) DataFrameCommonJob_dataExecValueAnalysis parquet at CommonJob.java:47 2026/08/31 12:27:34 37 ms 1/1
1/1
266 (2621e63a-f32e-4139-b4cf-ed40b6d0bc40) DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:27:30 54 ms 1/1 (1 skipped)
1/1 (1 skipped)
265 (2621e63a-f32e-4139-b4cf-ed40b6d0bc40) DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:27:30 0.1 s 1/1
1/1
264 (2621e63a-f32e-4139-b4cf-ed40b6d0bc40) DataFrameCommonJob_dataExecValueAnalysis parquet at CommonJob.java:47 2026/08/31 12:27:30 33 ms 1/1
1/1
263 (630234a8-1b55-45e7-bd49-ff63f2eaaaed) DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:27:05 27 ms 1/1 (1 skipped)
1/1 (1 skipped)
262 (630234a8-1b55-45e7-bd49-ff63f2eaaaed) DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:27:05 43 ms 1/1
1/1
261 (630234a8-1b55-45e7-bd49-ff63f2eaaaed) DataFrameCommonJob_dataExecValueAnalysis parquet at CommonJob.java:47 2026/08/31 12:27:05 30 ms 1/1
1/1
260 (e19d1139-e5fb-479d-b615-8ff8c11f2fdf) DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:27:03 25 ms 1/1 (1 skipped)
1/1 (1 skipped)
259 (e19d1139-e5fb-479d-b615-8ff8c11f2fdf) DataFrameCommonJob_dataExecValueAnalysis takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:27:03 57 ms 1/1
1/1
258 (e19d1139-e5fb-479d-b615-8ff8c11f2fdf) DataFrameCommonJob_dataExecValueAnalysis parquet at CommonJob.java:47 2026/08/31 12:27:03 31 ms 1/1
1/1
257 (1d680972-2660-4b6c-b29d-ea6668789448) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:26:55 64 ms 1/1
1/1
256 (3bbdab42-c0e3-4553-bc30-eeef6257e362) DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 2026/08/31 12:26:55 18 ms 1/1 (1 skipped)
1/1 (1 skipped)
255 (3bbdab42-c0e3-4553-bc30-eeef6257e362) DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 2026/08/31 12:26:55 23 ms 1/1
1/1
254 (1d680972-2660-4b6c-b29d-ea6668789448) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 12:26:55 34 ms 1/1
1/1
253 (3bbdab42-c0e3-4553-bc30-eeef6257e362) DataFrameCommonJob_dataExecSummaryOnCreation parquet at CommonJob.java:47 2026/08/31 12:26:55 34 ms 1/1
1/1
252 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame parquet at PersistJob.java:35 2026/08/31 12:26:47 0.3 s 1/1 (5 skipped)
1/1 (6 skipped)
251 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame parquet at PersistJob.java:35 2026/08/31 12:26:47 46 ms 1/1 (3 skipped)
1/1 (4 skipped)
250 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame parquet at PersistJob.java:35 2026/08/31 12:26:47 41 ms 1/1 (2 skipped)
1/1 (3 skipped)
249 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame parquet at PersistJob.java:35 2026/08/31 12:26:47 61 ms 1/1 (1 skipped)
2/2 (1 skipped)
248 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame parquet at PersistJob.java:35 2026/08/31 12:26:47 60 ms 1/1 (1 skipped)
2/2 (1 skipped)
247 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame parquet at PersistJob.java:35 2026/08/31 12:26:46 71 ms 1/1
1/1
246 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame parquet at PersistJob.java:35 2026/08/31 12:26:46 0.8 s 1/1
1/1
245 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame rdd at PersistJob.java:28 2026/08/31 12:26:46 66 ms 1/1 (3 skipped)
1/1 (4 skipped)
244 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame rdd at PersistJob.java:28 2026/08/31 12:26:46 45 ms 1/1 (2 skipped)
1/1 (3 skipped)
243 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame rdd at PersistJob.java:28 2026/08/31 12:26:46 69 ms 1/1 (1 skipped)
2/2 (1 skipped)
242 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame rdd at PersistJob.java:28 2026/08/31 12:26:46 78 ms 1/1 (1 skipped)
2/2 (1 skipped)
241 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame rdd at PersistJob.java:28 2026/08/31 12:26:45 89 ms 1/1
1/1
240 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame rdd at PersistJob.java:28 2026/08/31 12:26:45 0.8 s 1/1
1/1
239 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame csv at DataFrameCommonJob.java:324 2026/08/31 12:26:44 34 ms 1/1
1/1
238 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame csv at DataFrameCommonJob.java:324 2026/08/31 12:26:44 12 ms 1/1
1/1
237 (ad52529c-b10e-4b6b-ad4b-dcd1d20ffb0d) PersistFrame parquet at DataFrameCommonJob.java:485 2026/08/31 12:26:44 33 ms 1/1
1/1
236 (91a1af4f-817a-4c53-ad3e-ce491844a884) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:26:31 0.1 s 1/1 (5 skipped)
1/1 (6 skipped)
235 (91a1af4f-817a-4c53-ad3e-ce491844a884) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:26:30 0.1 s 1/1 (3 skipped)
1/1 (4 skipped)
234 (91a1af4f-817a-4c53-ad3e-ce491844a884) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:26:30 77 ms 1/1 (2 skipped)
1/1 (3 skipped)
233 (91a1af4f-817a-4c53-ad3e-ce491844a884) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:26:30 0.1 s 1/1 (1 skipped)
2/2 (1 skipped)
232 (91a1af4f-817a-4c53-ad3e-ce491844a884) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:26:30 0.1 s 1/1 (1 skipped)
2/2 (1 skipped)
231 (be5985ca-cf92-4ca8-9361-3bfd21fce6b1) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 12:26:29 16 ms 1/1 (4 skipped)
1/1 (4 skipped)
230 (be5985ca-cf92-4ca8-9361-3bfd21fce6b1) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 12:26:29 0.2 s 1/1 (3 skipped)
1/1 (3 skipped)
229 (91a1af4f-817a-4c53-ad3e-ce491844a884) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:26:29 84 ms 1/1
1/1
228 (91a1af4f-817a-4c53-ad3e-ce491844a884) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:26:29 1 s 1/1
1/1
227 (be5985ca-cf92-4ca8-9361-3bfd21fce6b1) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 12:26:29 99 ms 1/1 (1 skipped)
1/1 (1 skipped)
226 (be5985ca-cf92-4ca8-9361-3bfd21fce6b1) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 12:26:28 58 ms 1/1
1/1
225 (be5985ca-cf92-4ca8-9361-3bfd21fce6b1) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 12:26:28 0.2 s 1/1
1/1
224 (91a1af4f-817a-4c53-ad3e-ce491844a884) DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:324 2026/08/31 12:26:28 43 ms 1/1
1/1
223 (91a1af4f-817a-4c53-ad3e-ce491844a884) DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:324 2026/08/31 12:26:28 10 ms 1/1
1/1
222 (91a1af4f-817a-4c53-ad3e-ce491844a884) DataFrameCommonJob_dataExec parquet at DataFrameCommonJob.java:485 2026/08/31 12:26:28 28 ms 1/1
1/1
221 (be5985ca-cf92-4ca8-9361-3bfd21fce6b1) DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:324 2026/08/31 12:26:27 34 ms 1/1
1/1
220 (be5985ca-cf92-4ca8-9361-3bfd21fce6b1) DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:324 2026/08/31 12:26:27 16 ms 1/1
1/1
219 (be5985ca-cf92-4ca8-9361-3bfd21fce6b1) DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:485 2026/08/31 12:26:27 29 ms 1/1
1/1
218 (26822bb1-ae96-432d-9e7b-348e9b568c3b) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:26:23 0.3 s 1/1 (1 skipped)
2/2 (1 skipped)
217 (26822bb1-ae96-432d-9e7b-348e9b568c3b) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 12:26:22 0.9 s 1/1
1/1
216 (837f37dc-5b1d-45c8-9d3b-564eb23c595e) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 12:26:22 17 ms 1/1 (2 skipped)
1/1 (2 skipped)
Page: