Stages for All Jobs

Fair Scheduler Pools (1)

Pool Name Minimum Share Pool Weight Active Stages Running Tasks SchedulingMode
default 1 1 0 0 FAIR

Completed Stages (3986, only showing 939)

Stage Id ▾ Pool Name Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write
5961 default
PersistFrame parquet at PersistJob.java:35 +details
2026/08/26 10:44:44 1.0 h
1/1
1212.3 KiB24.6 MiB
5960 default
PersistFrame parquet at CommonJob.java:47 +details
2026/08/26 10:44:44 9 ms
1/1
5959 default
PersistFrame parquet at PersistJob.java:35 +details
2026/08/26 10:44:35 73 ms
1/1
5.5 KiB6.5 KiB
5958 default
PersistFrame csv at DataFrameCommonJob.java:326 +details
2026/08/26 10:44:35 20 ms
1/1
5.5 KiB
5957 default
PersistFrame parquet at PersistJob.java:35 +details
2026/08/26 10:44:30 64 ms
1/1
952.0 B2035.0 B
5956 default
PersistFrame csv at DataFrameCommonJob.java:326 +details
2026/08/26 10:44:30 13 ms
1/1
952.0 B
5955 default
PersistFrame parquet at PersistJob.java:35 +details
2026/08/26 10:44:19 0.6 s
1/1
609.7 KiB3.6 MiB
5951 default
PersistFrame parquet at PersistJob.java:35 +details
2026/08/26 10:44:18 0.2 s
10/10
25.9 MiB3.6 MiB
5948 default
PersistFrame parquet at PersistJob.java:35 +details
2026/08/26 10:44:15 3 s
1/1
3.1 MiB25.9 MiB
5946 default
PersistFrame parquet at PersistJob.java:35 +details
2026/08/26 10:44:15 0.2 s
2/2
694.2 KiB3.1 MiB
5945 default
PersistFrame rdd at PersistJob.java:28 +details
2026/08/26 10:44:14 0.4 s
10/10
25.9 MiB3.6 MiB
5942 default
PersistFrame rdd at PersistJob.java:28 +details
2026/08/26 10:44:11 3 s
1/1
3.1 MiB25.9 MiB
5940 default
PersistFrame rdd at PersistJob.java:28 +details
2026/08/26 10:44:11 0.2 s
2/2
694.2 KiB3.1 MiB
5939 default
PersistFrame parquet at CommonJob.java:47 +details
2026/08/26 10:44:10 17 ms
1/1
5937 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:33:35 0.4 s
1/1
560.3 KiB
5936 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:33:35 12 ms
1/1
5935 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:33:04 76 ms
5/5
2.0 MiB
5934 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:33:04 0.3 s
10/10
5.1 MiB
5933 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:33:03 0.2 s
4/4
3.0 MiB
5932 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:33:03 16 ms
1/1
1309.0 B
5931 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:33:03 89 ms
1/1
419.2 KiB
5930 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:33:03 65 ms
1/1
5929 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:33:03 15 ms
1/1
5928 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:33:03 28 ms
1/1
5927 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:33:03 52 ms
1/1
535.6 KiB
5926 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:33:03 12 ms
1/1
5925 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 45 ms
1/1
458.0 B
5923 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 20 ms
1/1
424.0 B
5921 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 20 ms
1/1
391.0 B
5919 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 25 ms
1/1
63.0 B
5917 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 16 ms
1/1
110.0 B
5916 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 23 ms
1/1
59.0 B
5914 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 29 ms
1/1
68.0 B
5912 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 87 ms
1/1
40.2 KiB424.0 B
5911 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 0.1 s
1/1
135.9 KiB458.0 B
5910 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 49 ms
1/1
312.0 KiB63.0 B
5909 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 31 ms
1/1
40.3 KiB68.0 B
5908 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 0.1 s
1/1
120.6 KiB391.0 B
5907 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:32:34 64 ms
1/1
299.6 KiB59.0 B
5906 default
DataFrameCommonJob_dataExecOnCreation csv at DataFrameCommonJob.java:314 +details
2026/08/26 10:32:34 24 ms
1/1
110.0 B
5905 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:32:33 14 ms
1/1
5904 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:32:33 16 ms
1/1
5903 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:32:33 40 ms
1/1
5902 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:32:33 42 ms
1/1
5901 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:32:33 71 ms
1/1
5900 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:32:33 79 ms
1/1
5899 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:18 77 ms
1/1
20.9 KiB
5894 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:18 92 ms
1/1
19.3 KiB20.9 KiB
5890 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:17 86 ms
1/1
9.3 KiB19.3 KiB
5887 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:17 28 ms
1/1
14.4 KiB9.3 KiB
5885 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:17 37 ms
1/1
14.4 KiB
5883 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:17 97 ms
4/4
1249.2 KiB14.4 KiB
5882 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:17 69 ms
1/1
10.2 KiB
5880 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:17 72 ms
1/1
13.3 KiB
5878 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:17 88 ms
4/4
1249.2 KiB10.2 KiB
5877 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:17 0.1 s
4/4
664.1 KiB13.3 KiB
5876 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:16 11 ms
1/1
5875 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:16 13 ms
1/1
5874 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:16 25 ms
1/1
5873 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 59 ms
1/1
888.0 B
5869 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 69 ms
1/1
12.7 KiB888.0 B
5866 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 22 ms
1/1
24.8 KiB12.7 KiB
5864 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 27 ms
1/1
24.8 KiB
5862 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 71 ms
4/4
1249.2 KiB24.8 KiB
5861 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 10 ms
1/1
866.0 B
5859 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 20 ms
1/1
224.0 B
5857 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 27 ms
1/1
236.0 B
5855 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 27 ms
4/4
1236.8 KiB866.0 B
5854 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 19 ms
4/4
1235.7 KiB236.0 B
5853 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:13 38 ms
4/4
1232.5 KiB224.0 B
5852 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 21 ms
1/1
690.0 B
5849 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 89 ms
1/1
11.7 KiB690.0 B
5847 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:12 19 ms
1/1
5846 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:12 86 ms
1/1
5845 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:12 18 ms
1/1
5844 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:12 40 ms
1/1
5843 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 23 ms
1/1
582.0 B
5841 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 88 ms
1/1
8.4 KiB
5839 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 36 ms
1/1
236.0 B
5837 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 28 ms
1/1
236.0 B
5835 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 17 ms
1/1
1804.0 B
5833 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 0.2 s
4/4
1249.2 KiB11.7 KiB
5832 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 84 ms
4/4
993.4 KiB582.0 B
5831 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 45 ms
4/4
1233.6 KiB236.0 B
5830 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 22 ms
1/1
1178.0 B
5828 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 35 ms
4/4
1249.2 KiB1804.0 B
5827 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 54 ms
4/4
993.2 KiB236.0 B
5826 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 0.1 s
4/4
993.5 KiB8.4 KiB
5825 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:12 93 ms
4/4
1238.1 KiB1178.0 B
5824 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:12 26 ms
1/1
5823 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:12 16 ms
1/1
5822 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:12 31 ms
1/1
5821 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:12 45 ms
1/1
5820 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:11 0.2 s
1/1
5819 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:11 29 ms
1/1
5818 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:11 24 ms
1/1
5817 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:09 14 ms
3/3
39.7 KiB
5816 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:09 19 ms
4/4
42.6 KiB
5815 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:09 22 ms
1/1
17.7 KiB
5814 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2026/08/26 10:30:09 11 ms
1/1

Skipped Stages (15)

Page:
Stage Id ▾ Pool Name Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write
5954 default
parquet at PersistJob.java:35 +details
Unknown Unknown
0/10
5953 default
parquet at PersistJob.java:35 +details
Unknown Unknown
0/1
5952 default
parquet at PersistJob.java:35 +details
Unknown Unknown
0/2
5950 default
parquet at PersistJob.java:35 +details
Unknown Unknown
0/1
5949 default
parquet at PersistJob.java:35 +details
Unknown Unknown
0/2
5947 default
parquet at PersistJob.java:35 +details
Unknown Unknown
0/2
5944 default
rdd at PersistJob.java:28 +details
Unknown Unknown
0/1
5943 default
rdd at PersistJob.java:28 +details
Unknown Unknown
0/2
5941 default
rdd at PersistJob.java:28 +details
Unknown Unknown
0/2
5924 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/1
5922 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/1
5920 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/1
5918 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/1
5915 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/1
5913 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/1
Page:

Failed Stages (8)

Page:
Stage Id ▾ Pool Name Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write Failure Reason
5938 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:38:29 Unknown
0/1
Job 3983 cancelled
5813 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:09 Unknown
0/1
Job 3896 cancelled
5812 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:08 Unknown
0/1
Job 3895 cancelled
5811 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:06 Unknown
0/1
Job 3894 cancelled
5810 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:06 Unknown
0/1
Job 3893 cancelled
5809 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 10:30:05 Unknown
0/1
Job 3892 cancelled
4342 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 07:04:14 23 ms
0/1 (1 failed)
FAILED_EXECUTE_UDF +details
4334 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2026/08/26 07:03:20 89 ms
0/1 (1 failed)
FAILED_EXECUTE_UDF +details
Page: