I have the same "problem" but there's no easy fix that I've found. At the end of the day it doesn't make my aim that much more unstable and there are plenty of good hover players who I'm pretty sure this happens to as well. I find I can fix it by adding a lot of height to my hand (like towel underneath or something) but it ends up being worse overall if I do that. For now I just ignore it but I do agree it is slightly annoying.