I do enjoy racking in dozens if not hundreds of millions of points on a single play, but it's not that big of a deal I guess.
You go to any rhythm game and it'll have a different mechanic involved. Like aim, it'll have something like tracking, memory, dancing, or some other shit in play, but we still call them rhythm games for being built around music. I can see why people stress to call osu! an aim game when the meta has pushed it to play that way for most people, but one can't disassociate the rhythm involved either way, even if the player is off a tenth of a second off 30% of the time.