Well, in the 'Servant of Evil' back story, it could be that the servant has been raised in a world full of power struggles. Maybe they were orphaned and taken in by an 'evil' figure. This figure then uses their influence to shape the servant into someone who will do their bidding. The servant may not fully understand the implications of their actions and is just following orders in a world where they have no other options.