Well, usually osu! doesn't move like the arrow keys or whatever without you pressing them correct? Well at random times I used to catch osu! using them without even being pressed. I did have my mouse/mousepad on the keys for a little bit and then the arrows got pressed thus spazzing out. I took pressure off the keys but it would keep moving. Sometimes this happened without adding pressure to them too.
Sorry if I spelled something wrong I'm using my phone right now... Also sorry for not adding this in the first post ^^'