You can't use more than 2 (even keyboard and mouse buttons are the same for the game). I think you are just slow.
Adding as if this is a feature request, game was design for mouse and so use 2 buttons. 2 is enough to reach 300bpm streams, at which rare songs goes beyond, I see no reasons to add more