I am assuming this would not even be rankable, and personally I would not allow it to be ranked either.
Basically, doing this would essentially be a map with no hitsounds. "What are you talking about? It's only hitsounds!" Well if you played with no hitsounds or music at all, you would just click notes with no indication of whether you were hitting it late or early. In this case, it's the same thing. There are sounds playing, but you have no indication of how late or early you are. Sure having parts of a map have something like this is okay, but I wouldn't really allow having a whole map like that.