The gamers on Earth were naturally much weaker. Up until the time that Sui Xiong had left Earth, this was the case. Legend has it that one had used the PS2 game system to create a supercomputer, and they used it to control drones to attack enemies. Yet they were not considered gamers as they were not really playing games.
On earth, the idea of strength in numbers was based on a united group with a similar goal in mind. If they were disunited and messy, they would not have much power. Furthermore, the gamers would be very far from one another physically because they didn't all live in the same location. However, in this world, there was no need for any tangible organization, as those with the same attitudes and passions could already create a force. Here, "will" was an actual power, and the combined will of thousands of people would scare even gods. Thus, the fleeing of the overpowered scholar was not surprising at all.