I do not know the reason why this is but recently I have been hitting dramatic frame drops when using a mouse to play. I'm a tablet user but play mouse occasionally for fun.
Death wrote:
You should be able to use raw input while using a mouse.
If you have a program that allows you to control mouse functions, try lowering your mouse's report/polling rate.