[Spark] Auto Compaction was incorrectly including large files towards minNumFiles #4045#4178

Open

mwc360 wants to merge 12 commits intodelta-io:masterfrom mwc360:auto-compaction-bugfix-021925

+46-47

Commits on Feb 19, 2025

- fix auto compaction to calculate the correct default minFileSize if the session config is unset. this resulted in large files counting torwards minNumFiles
mwc360
committed

Commits on Feb 23, 2025

fix test case df comparison
mwc360
authored

Commits on Feb 24, 2025