Larry genuinely thought he got over the trauma of meeting that old, mature man back on earth. The very one he and Marlo had gone after to capture… the one who set up the entire Dershaw family's demise. The one who kidnapped those who remained. There were days where Larry genuinely felt like he got over the memory of that man telling him that he had left earth while kidnapping all of Larry's family.
Jeffrey, that old sick bastard, had set up countless wars on earth just for his amusement, and as he left the planet was the one responsible for inciting the A.I. invasion that ultimately led to the present circumstances on that planet.
A majority of its original residents were gone or dead, and the remaining ones were devout followers of a few deities who used them to farm divine energy to fuel their own war against the A.I.
For those who do not remember, Larry confronted Jeffrey in chapter 548.