This seems to have been a side effect of my input being set to Bluetooth mic.
I could also get the change to mono to happen by doing a screen recording with mic input audio, so not involving any Playdate SDK software at all.
I guess when the Simulator launches it somehow triggers mic input permissions?
Workaround
- set input to computer built-in mic