The Milky Way had just ended the crisis, but the reconstruction process after the crisis was still a part that the young civilizations had to go through.
Time returned to the time not long after the Civilization Annihilator was dealt with.
The Galaxy Community, an interstellar galactic organization, had lost its headquarters, the giant space station built in the Three Union Planet. This was due to the attack of the Civilization Annihilator.
It wasn't quite accurate to say that it was lost, because the space station was actually shielded by the planetary obliteration weapon Angel of Peace carried by the Colossus, isolating it from all internal and external detection.
When the Civilization Annihilator was still the Observer, it had used such a weapon to lock a group of mysophobia on a planet. It was only after an unknown period of time, when the barrier weakened, that they were released by an unlucky person.