I think that there should be a pause function in osu! since you could also pause in EBA. When you pause, there should be an option to continue, one to quit, and one to restart the song.
Hitting escape should also bring up the pause menu, similar to start on ouendan. It will blank out the current gameplay screen to make sure people don't take advantage of starting/stopping lots