Spark Jobs (?)

Event Timeline

Completed Jobs (1834, only showing 935)

Job Id (Job Group) ▾ Description Submitted Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
1835 (c08cba73-670a-47e2-9d83-8571f93dacc5) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:25 95 ms 1/1 (2 skipped)
1/1 (2 skipped)
1834 (80740e05-34e0-4f3f-aa9d-b5d1e5ca05ac) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:25 17 ms 1/1 (3 skipped)
1/1 (3 skipped)
1833 (6a7498e4-0f3b-4c92-9b04-7a4559534406) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:25 0.2 s 1/1 (2 skipped)
1/1 (2 skipped)
1832 (80740e05-34e0-4f3f-aa9d-b5d1e5ca05ac) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:25 0.2 s 1/1 (2 skipped)
1/1 (2 skipped)
1831 (c08cba73-670a-47e2-9d83-8571f93dacc5) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:25 50 ms 1/1
1/1
1830 (c08cba73-670a-47e2-9d83-8571f93dacc5) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:25 0.3 s 1/1
1/1
1829 (80740e05-34e0-4f3f-aa9d-b5d1e5ca05ac) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:24 0.4 s 1/1
1/1
1828 (6a7498e4-0f3b-4c92-9b04-7a4559534406) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:24 0.4 s 1/1
1/1
1827 (80740e05-34e0-4f3f-aa9d-b5d1e5ca05ac) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:24 0.3 s 1/1
1/1
1826 (6a7498e4-0f3b-4c92-9b04-7a4559534406) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:24 0.5 s 1/1
1/1
1825 (c08cba73-670a-47e2-9d83-8571f93dacc5) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 15:22:24 29 ms 1/1
1/1
1824 (6a7498e4-0f3b-4c92-9b04-7a4559534406) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 15:22:24 32 ms 1/1
1/1
1823 (80740e05-34e0-4f3f-aa9d-b5d1e5ca05ac) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 15:22:24 46 ms 1/1
1/1
1822 (3044c1ce-30af-47d5-8865-1791e32d37ba) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:22:09 0.1 s 1/1
1/1
1821 (84c05a0a-55a6-4334-9c89-05ef5165731e) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 15:22:09 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
1820 (84c05a0a-55a6-4334-9c89-05ef5165731e) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 15:22:09 77 ms 1/1
1/1
1819 (d0586374-338d-421f-a618-65325cf3b484) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:21:05 18 ms 1/1
1/1
1818 (d0586374-338d-421f-a618-65325cf3b484) DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:324 2026/08/31 15:21:05 8 ms 1/1
1/1
1817 (0d34c3f4-6ac6-4f76-a912-4da6d6aa6f1c) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 15:21:05 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
1816 (0d34c3f4-6ac6-4f76-a912-4da6d6aa6f1c) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 15:21:05 13 ms 1/1
1/1
1815 (0d34c3f4-6ac6-4f76-a912-4da6d6aa6f1c) DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:324 2026/08/31 15:21:04 11 ms 1/1
1/1
1814 (1557896a-3a91-4718-9b58-ca5734045a18) AnalyseSchema json at DataReader.java:121 2026/08/31 15:18:41 45 ms 1/1
1/1
1813 (2d0c7a02-2e08-4548-b6dc-1c05cd86f55a) VisualizeData takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:17:17 86 ms 1/1
1/1
1812 (ec2d5aed-2d93-4ad7-bbef-16c4b3ba87a7) AnalyseSchema json at DataReader.java:121 2026/08/31 15:15:41 42 ms 1/1
1/1
1811 (2199414e-28d9-41d5-b89e-eb53ecfc00b7) DataFrameCommonJob_checkCSVSourceOncreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:12:10 17 ms 1/1
1/1
1810 (2199414e-28d9-41d5-b89e-eb53ecfc00b7) DataFrameCommonJob_checkCSVSourceOncreation csv at DataFrameCommonJob.java:312 2026/08/31 15:12:10 23 ms 1/1
1/1
1809 (2199414e-28d9-41d5-b89e-eb53ecfc00b7) DataFrameCommonJob_checkCSVSourceOncreation csv at DataFrameCommonJob.java:312 2026/08/31 15:12:10 10 ms 1/1
1/1
1808 (76d14672-83a4-4894-b588-d6afba68c9a4) Listing leaf files and directories for 3751 paths:
file:/data/input/depot/json/tmp/154/HTTP_FILE_0.json, ...
json at DataReader.java:121
2026/08/31 15:09:14 23 s 1/1
3751/3751
1807 (510654fa-6bf6-4a61-916d-ad2af61fc647) DataFrameCommonJob_checkExtraction takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:02:56 10 ms 1/1
1/1
1806 (510654fa-6bf6-4a61-916d-ad2af61fc647) DataFrameCommonJob_checkExtraction takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:02:56 16 ms 1/1
1/1
1805 (510654fa-6bf6-4a61-916d-ad2af61fc647) DataFrameCommonJob_checkExtraction parquet at DataFrameCommonJob.java:466 2026/08/31 15:02:55 27 ms 1/1
1/1
1804 (18c4caaf-fbbb-47e6-9dda-e7360a82c9b2) DepotPersistJob_persistJson parquet at DepotPersistJob.java:111 2026/08/31 15:02:49 0.3 s 1/1
9/9
1803 (18c4caaf-fbbb-47e6-9dda-e7360a82c9b2) DepotPersistJob_persistJson first at DataFrameCommonJob.java:1691 2026/08/31 15:02:49 8 ms 1/1
1/1
1802 (18c4caaf-fbbb-47e6-9dda-e7360a82c9b2) DepotPersistJob_persistJson first at DataFrameCommonJob.java:1683 2026/08/31 15:02:49 10 ms 1/1
1/1
1801 (fa17dfbe-9f65-4098-a99d-c3f63d01473a) DepotPersistJob_persistJson parquet at DepotPersistJob.java:111 2026/08/31 15:02:37 0.4 s 1/1
9/9
1800 (fa17dfbe-9f65-4098-a99d-c3f63d01473a) DepotPersistJob_persistJson first at DataFrameCommonJob.java:1691 2026/08/31 15:02:37 12 ms 1/1
1/1
1799 (fa17dfbe-9f65-4098-a99d-c3f63d01473a) DepotPersistJob_persistJson first at DataFrameCommonJob.java:1683 2026/08/31 15:02:37 18 ms 1/1
1/1
1798 (6c813b7a-f10d-4bfe-8c9f-1c444c422575) Listing leaf files and directories for 3691 paths:
file:/data/input/depot/json/tmp/154/HTTP_FILE_0.json, ...
json at DataReader.java:121
2026/08/31 15:00:50 24 s 1/1
3691/3691
1797 (558a6d8f-eac9-4aaa-952b-a7eb7b21caa1) DataFrameCommonJob_checkCSVSourceOncreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 15:00:14 25 ms 1/1
1/1
1796 (558a6d8f-eac9-4aaa-952b-a7eb7b21caa1) DataFrameCommonJob_checkCSVSourceOncreation csv at DataFrameCommonJob.java:312 2026/08/31 15:00:14 28 ms 1/1
1/1
1795 (558a6d8f-eac9-4aaa-952b-a7eb7b21caa1) DataFrameCommonJob_checkCSVSourceOncreation csv at DataFrameCommonJob.java:312 2026/08/31 15:00:14 21 ms 1/1
1/1
1793 (90c8a49c-862a-4d10-b878-2fb6587ab5ad) Listing leaf files and directories for 3687 paths:
file:/data/input/depot/json/tmp/154/HTTP_FILE_0.json, ...
json at DataReader.java:121
2026/08/31 14:56:50 23 s 1/1
3687/3687
1792 (747eb93a-af7b-42d2-867d-7b4ae974b2d5) Listing leaf files and directories for 3687 paths:
file:/data/input/depot/json/tmp/154/HTTP_FILE_0.json, ...
json at DataReader.java:121
2026/08/31 14:56:04 24 s 1/1
3687/3687
1791 (149ce15b-0eaf-4458-b8aa-19fc22db1c52) AnalyseSchema json at DataReader.java:121 2026/08/31 14:54:44 41 ms 1/1
1/1
1790 (5d1f8ff9-64f4-483b-b870-7cd57713073e) AnalyseSchema json at DataReader.java:121 2026/08/31 14:53:41 55 ms 1/1
1/1
1789 (8d350472-c833-4e75-b158-d1776a638601) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:50:17 19 ms 1/1
1/1
1788 (923fdc92-ddd8-4351-a544-e710be57c556) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 14:50:17 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
1787 (8d350472-c833-4e75-b158-d1776a638601) DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:312 2026/08/31 14:50:17 9 ms 1/1
1/1
1786 (923fdc92-ddd8-4351-a544-e710be57c556) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 14:50:17 22 ms 1/1
1/1
1785 (923fdc92-ddd8-4351-a544-e710be57c556) DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:312 2026/08/31 14:50:17 11 ms 1/1
1/1
1784 (93d8170e-f14e-4eb7-899f-11bbbc877486) DataFrameCommonJob_dataExecColumnAnalysis takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:48:34 12 ms 1/1 (1 skipped)
1/1 (1 skipped)
1783 (93d8170e-f14e-4eb7-899f-11bbbc877486) DataFrameCommonJob_dataExecColumnAnalysis takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:48:34 33 ms 1/1
1/1
1782 (93d8170e-f14e-4eb7-899f-11bbbc877486) DataFrameCommonJob_dataExecColumnAnalysis csv at DataFrameCommonJob.java:312 2026/08/31 14:48:34 9 ms 1/1
1/1
1781 (9b422167-21d9-4539-93d1-c4e3e603a211) DataFrameCommonJob_dataExecCountALL takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:48:30 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
1780 (9b422167-21d9-4539-93d1-c4e3e603a211) DataFrameCommonJob_dataExecCountALL takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:48:30 16 ms 1/1
1/1
1779 (9b422167-21d9-4539-93d1-c4e3e603a211) DataFrameCommonJob_dataExecCountALL csv at DataFrameCommonJob.java:312 2026/08/31 14:48:30 32 ms 1/1
1/1
1778 (a070929f-836b-48ec-9a1e-8a424f487ce0) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:34:46 19 ms 1/1
1/1
1777 (a070929f-836b-48ec-9a1e-8a424f487ce0) DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:312 2026/08/31 14:34:46 8 ms 1/1
1/1
1776 (7d818492-26a5-4b77-a651-47a9a87b0a21) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 14:34:46 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
1775 (7d818492-26a5-4b77-a651-47a9a87b0a21) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 14:34:46 30 ms 1/1
1/1
1774 (7d818492-26a5-4b77-a651-47a9a87b0a21) DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:312 2026/08/31 14:34:45 11 ms 1/1
1/1
1773 (5fc9fc94-9318-445b-b46b-fdea19d0bd57) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:27:23 22 ms 1/1
1/1
1772 (5fc9fc94-9318-445b-b46b-fdea19d0bd57) DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:312 2026/08/31 14:27:23 9 ms 1/1
1/1
1771 (06698797-59f0-4896-8da5-062e50c3bd44) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 14:27:23 9 ms 1/1 (1 skipped)
1/1 (1 skipped)
1770 (06698797-59f0-4896-8da5-062e50c3bd44) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 14:27:23 22 ms 1/1
1/1
1769 (06698797-59f0-4896-8da5-062e50c3bd44) DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:312 2026/08/31 14:27:23 10 ms 1/1
1/1
1768 (8db9776a-5234-4f66-9560-6c73146979a7) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:23:57 21 ms 1/1
1/1
1767 (8db9776a-5234-4f66-9560-6c73146979a7) DataFrameCommonJob_dataExecOnCreation csv at DataFrameCommonJob.java:312 2026/08/31 14:23:57 10 ms 1/1
1/1
1766 (2f9c1fed-75ee-43a6-9e73-76c2e5fa8c47) DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 2026/08/31 14:23:57 8 ms 1/1 (1 skipped)
1/1 (1 skipped)
1765 (2f9c1fed-75ee-43a6-9e73-76c2e5fa8c47) DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 2026/08/31 14:23:57 19 ms 1/1
1/1
1764 (2f9c1fed-75ee-43a6-9e73-76c2e5fa8c47) DataFrameCommonJob_dataExecSummaryOnCreation csv at DataFrameCommonJob.java:312 2026/08/31 14:23:57 9 ms 1/1
1/1
1763 (c23265cf-bd80-401a-b9b9-73af98654b8e) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:22:46 31 ms 1/1
1/1
1762 (3a29c9c9-4dc7-46d3-9a8c-54a8ca8831d8) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 14:22:46 7 ms 1/1 (1 skipped)
1/1 (1 skipped)
1761 (c23265cf-bd80-401a-b9b9-73af98654b8e) DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:312 2026/08/31 14:22:46 11 ms 1/1
1/1
1760 (3a29c9c9-4dc7-46d3-9a8c-54a8ca8831d8) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 14:22:46 26 ms 1/1
1/1
1759 (3a29c9c9-4dc7-46d3-9a8c-54a8ca8831d8) DataFrameCommonJob_dataExecSummary csv at DataFrameCommonJob.java:312 2026/08/31 14:22:45 17 ms 1/1
1/1
1758 (677f0215-c264-4e01-a796-f1b34f9f3963) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:21:24 0.1 s 1/1
4/4
1757 (677f0215-c264-4e01-a796-f1b34f9f3963) DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:21:24 28 ms 1/1
1/1
1756 (ef871a37-6ee7-42ad-84b5-ce3d44b7bf87) DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 2026/08/31 14:21:24 14 ms 1/1 (1 skipped)
1/1 (8 skipped)
1755 (ef871a37-6ee7-42ad-84b5-ce3d44b7bf87) DataFrameCommonJob_dataExecSummaryOnCreation count at ColumnStatJob.java:47 2026/08/31 14:21:23 59 ms 1/1
8/8
1754 (677f0215-c264-4e01-a796-f1b34f9f3963) DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 2026/08/31 14:21:23 32 ms 1/1
1/1
1753 (ef871a37-6ee7-42ad-84b5-ce3d44b7bf87) DataFrameCommonJob_dataExecSummaryOnCreation parquet at CommonJob.java:47 2026/08/31 14:21:23 33 ms 1/1
1/1
1752 (00aad225-56fa-49d3-8590-e175b57fb619) DataFrameExposeJob_exec_db jdbc at SqlDbWriter.java:111 2026/08/31 14:13:44 7 s 1/1
8/8
1751 (00aad225-56fa-49d3-8590-e175b57fb619) DataFrameExposeJob_exec_db parquet at CommonJob.java:47 2026/08/31 14:13:44 30 ms 1/1
1/1
1750 (27d4bac4-0078-4c59-8c28-bbe3e5b450c8) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:00:11 0.8 s 1/1 (5 skipped)
1/1 (24 skipped)
1749 (7d508277-5f71-40b6-a949-6ba84dd94509) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 14:00:02 8 s 1/1 (5 skipped)
1/1 (23 skipped)
1748 (27d4bac4-0078-4c59-8c28-bbe3e5b450c8) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:00:01 10 s 1/1 (4 skipped)
3/3 (21 skipped)
1747 (7d508277-5f71-40b6-a949-6ba84dd94509) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 14:00:01 1 s 1/1 (4 skipped)
2/2 (21 skipped)
1746 (27d4bac4-0078-4c59-8c28-bbe3e5b450c8) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 14:00:00 0.7 s 1/1 (1 skipped)
3/3 (4 skipped)
1745 (7d508277-5f71-40b6-a949-6ba84dd94509) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 13:59:58 2 s 1/1 (1 skipped)
3/3 (4 skipped)
1744 (27d4bac4-0078-4c59-8c28-bbe3e5b450c8) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 13:59:47 13 s 1/1
3/3
1743 (7d508277-5f71-40b6-a949-6ba84dd94509) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 13:59:47 13 s 1/1
3/3
1742 (27d4bac4-0078-4c59-8c28-bbe3e5b450c8) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 13:59:47 13 s 1/1
4/4
1741 (7d508277-5f71-40b6-a949-6ba84dd94509) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 13:59:47 11 s 1/1
4/4
1740 (7d508277-5f71-40b6-a949-6ba84dd94509) DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 2026/08/31 13:59:47 9 s 1/1
11/11
1739 (27d4bac4-0078-4c59-8c28-bbe3e5b450c8) DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:143 2026/08/31 13:59:47 8 s 1/1
11/11
1738 (27d4bac4-0078-4c59-8c28-bbe3e5b450c8) DataFrameCommonJob_dataExec parquet at CommonJob.java:47 2026/08/31 13:59:46 26 ms 1/1
1/1
1737 (7d508277-5f71-40b6-a949-6ba84dd94509) DataFrameCommonJob_dataExecSummary parquet at CommonJob.java:47 2026/08/31 13:59:46 44 ms 1/1
1/1
1736 (27d4bac4-0078-4c59-8c28-bbe3e5b450c8) DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:324 2026/08/31 13:59:46 0.1 s 1/1
2/2
1735 (27d4bac4-0078-4c59-8c28-bbe3e5b450c8) DataFrameCommonJob_dataExec csv at DataFrameCommonJob.java:324 2026/08/31 13:59:46 8 ms 1/1
1/1

Failed Jobs (1)

Page:
Job Id (Job Group) ▾ Description Submitted Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
1794 (90c8a49c-862a-4d10-b878-2fb6587ab5ad) AnalyseSchema json at DataReader.java:121 2026/08/31 14:57:14 2 s 0/1 (1 failed)
1/3 (1 failed) (1 killed: Stage cancelled: Job aborted due to stage failure: Task 2 in stage 2696.0 failed 1 times, most recent failure: Lost task 2.0 in stage 2696.0 (TID 17828) (100d7a05236f executor driver): org.apache.spark.SparkException: Malformed records are detected in schema inference. Parse Mode: FAILFAST. at org.apache.spark.sql.errors.QueryExecutionErrors$.malformedRecordsDetectedInSchemaInferenceError(QueryExecutionErrors.scala:1521) at org.apache.spark.sql.catalyst.json.JsonInferSchema.handleJsonErrorsByParseMode(JsonInferSchema.scala:68) at org.apache.spark.sql.catalyst.json.JsonInferSchema.$anonfun$infer$2(JsonInferSchema.scala:97) at scala.collection.Iterator$$anon$11.nextCur(Iterator.scala:486) at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:492) at scala.collection.Iterator.foreach(Iterator.scala:943) at scala.collection.Iterator.foreach$(Iterator.scala:943) at scala.collection.AbstractIterator.foreach(Iterator.scala:1431) at scala.collection.TraversableOnce.reduceLeft(TraversableOnce.scala:237) at scala.collection.TraversableOnce.reduceLeft$(TraversableOnce.scala:220) at scala.collection.AbstractIterator.reduceLeft(Iterator.scala:1431) at scala.collection.TraversableOnce.reduceLeftOption(TraversableOnce.scala:249) at scala.collection.TraversableOnce.reduceLeftOption$(TraversableOnce.scala:248) at scala.collection.AbstractIterator.reduceLeftOption(Iterator.scala:1431) at scala.collection.TraversableOnce.reduceOption(TraversableOnce.scala:256) at scala.collection.TraversableOnce.reduceOption$(TraversableOnce.scala:256) at scala.collection.AbstractIterator.reduceOption(Iterator.scala:1431) at org.apache.spark.sql.catalyst.json.JsonInferSchema.$anonfun$infer$1(JsonInferSchema.scala:107) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2(RDD.scala:858) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2$adapted(RDD.scala:858) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:367) at org.apache.spark.rdd.RDD.iterator(RDD.scala:331) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:93) at org.apache.spark.TaskContext.runTaskWithListeners(TaskContext.scala:166) at org.apache.spark.scheduler.Task.run(Task.scala:141) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$4(Executor.scala:621) at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally(SparkErrorUtils.scala:64) at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally$(SparkErrorUtils.scala:61) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:94) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:624) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('<' (code 60)): expected a valid value (JSON String, Number (or 'NaN'/'INF'/'+INF'), Array, Object or token 'null', 'true' or 'false') at [Source: (InputStreamReader); line: 1, column: 2] at com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:2477) at com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:750) at com.fasterxml.jackson.core.base.ParserMinimalBase._reportUnexpectedChar(ParserMinimalBase.java:674) at com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleOddValue(ReaderBasedJsonParser.java:2085) at com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:808) at org.apache.spark.sql.catalyst.json.JsonInferSchema.$anonfun$infer$4(JsonInferSchema.scala:91) at org.apache.spark.util.SparkErrorUtils.tryWithResource(SparkErrorUtils.scala:48) at org.apache.spark.util.SparkErrorUtils.tryWithResource$(SparkErrorUtils.scala:46) at org.apache.spark.util.Utils$.tryWithResource(Utils.scala:94) at org.apache.spark.sql.catalyst.json.JsonInferSchema.$anonfun$infer$2(JsonInferSchema.scala:90) ... 31 more Driver stacktrace:)
Page: