I think the Agents are imaginary. Like, even within the universe of the game, they're either imaginary or... spiritual, in some way. They don't seem to have a physical presence, until the beginning of "Without a Fight," where they're called into true existence by the combined cries for help of everyone in the world.