As the demons struck at the walls, Sam was busy making their way towards the upper city.
Most of the people had fled in the direction of the docks, so they were relatively unimpeded until they got to the gate itself.
They could only "tsk" as they watched the small riot playing out, panicked city-folk against the guards that would have been better serving elsewhere.
These were the folk who either had no place to shelter, or who thought that they would be safer higher up in the city, as opposed to simply having fewer options to escape that didn't involve jumping off a literal cliff into the lake.