If its not on, arrow key control can be turned on in game settings. Moving forward (0.6.1) it will be enabled by default.
