The depths of the fortress tried to hide themselves from outside presence in any way they could, whether it was a gate hidden behind a cave wall or a test that most could not pass.
Neither Adam, Silvana, nor even Lone Blaze knew what crimson mist was capable of. Nothing had ever tried to attack Adam's inner space before, but it was no problem for him.
For other Phantoms, their Evolution Trees weren't strong enough to kick out crimson mist, but in Adam's case, his Evolution Tree didn't even have to do anything.
It was the First Wall that did all the work.
The dark vortex grew faster and faster, distorting the space around it. The First Wall wasn't able to display even one-thousandth of its power in the real world, but in the inner space, it had complete freedom of action.
To be more precise, it was unique to Adam. Most Phantoms, their desires, and future opponent were not strong enough for their First Walls to have a will of their own.