I noticed a big difference between my pdx size and the size reported on the playdate under settings > games.
Deleting the game fully from my device then sideloading again fixed the issue.
I suspect the file size is not updated when sending an updated version, so it was still reporting the size of a much earlier and smaller build.