When the villagers first met Di Fuyi, they wanted to shake hands with him to greet him, but he refused to, pretending like he never saw the approaching hands. He was very arrogant toward them. When someone touched him, he would flick his robes to clear away the dust. It was a sign of him thinking that these people were dirty.
Also, he had the habit of insulting people and being very sarcastic to them. Most of the time, he would go to the extreme and shut them up once and for all. Thus, they no longer dared to approach him, avoiding every chance of a conversation. He also often kept himself away from the villagers.