When you rotate your sprite, this rotation shifts the collideRect (the red square) to a position that is overlapping your walls:
Then you do moveWithCollisions which resolves the overlap in an unexpected (to you) way.
Adjusting the collideRect during rotation so it is centred on the sprite rather than at 0,0 fixes this.