Spark 3.3: Don't cache or reuse manifest entries while rewriting metadata by default #15971
Job | Run time |
---|---|
58m 3s | |
48m 58s | |
41m 32s | |
58m 16s | |
59m 26s | |
1h 9m 25s | |
51m 32s | |
58m 38s | |
1h 4m 4s | |
52m 51s | |
54m 44s | |
1h 12m 45s | |
59m 15s | |
1h 3m 25s | |
44m 49s | |
55m 8s | |
1h 5m 26s | |
54m 2s | |
59m 16s | |
1h 9m 44s | |
1h 14m 34s | |
1h 4m 45s | |
21h 40m 38s |