I wouldn't mind this, but I think it will be denied. Keeping #spectator open requires an extra connection with bancho. It takes extra resources to keep #spectator open, because it's essentially creating a server side room in which people can join. It would be wasteful if people could just leave #spectator open when it's not being used.
Edit: ignorant post
Edit: ignorant post