It appears that the card rotation being locked in is part of the puzzle of the game. It'd probably break it in some fashion if you were able to rotate the tiles. I noticed that when you rotate the board, the tiles also rotate, in the stack to the right. I'm assuming this locking-in is intentional.