[BUG] Bump up max_header_size

[raunakab]

Overview

Bump up the MAX_HEADER_SIZE constant that's being used to compare against the page sizes.

(Naming seems weird. We're using the max "header" size to guard against "page" sizes.)

[codspeed-hq]

CodSpeed Performance Report

Merging #3068 will not alter performance

_{Comparing bug/parquet-large-files-reader (d39da8e) with main (d1b06fb)}

Summary

✅ 17 untouched benchmarks

[codecov]

Codecov Report

Attention: Patch coverage is 66.66667% with 1 line in your changes missing coverage. Please review.

Project coverage is 77.20%. Comparing base (d1b06fb) to head (d39da8e).
Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
src/daft-parquet/src/file.rs	66.66%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3068      +/-   ##
==========================================
- Coverage   78.65%   77.20%   -1.45%     
==========================================
  Files         618      618              
  Lines       73192    75100    +1908     
==========================================
+ Hits        57569    57983     +414     
- Misses      15623    17117    +1494     

Files with missing lines	Coverage Δ
src/daft-parquet/src/file.rs	74.01% <66.66%> (ø)

... and 11 files with indirect coverage changes

[desmondcheongzx]

Could we update the comment above this to explain our rationale for using 2GiB?

[raunakab]

Yessir! 🚀🚀🚀

[desmondcheongzx]

Looks good! Send it

[jaychia]

Hey what's happening with this PR? Is this good to merge?

[raunakab]

Hey what's happening with this PR? Is this good to merge?

@jaychia Ingress works, but currently debugging egress with PyArrow.