It was not only that he couldn't, but it also demanded his sacrifice. Don't think he didn't know; his mother had meddled in his previous relationships too. Claiming that those ex-girlfriends weren't suitable for him, in reality, she wanted him to marry someone who matched their social status, someone who could benefit the Yu Family.
It wasn't entirely unacceptable for him to date someone of equal social standing, but constantly interfering with his feelings and then pushing Qin Zhimei on him? He had never felt more than a normal friendship toward Qin Zhimei, ever since they were young. How unsightly it all was.
Indeed, he hadn't loved his past girlfriends that much, so when they were humiliated by his mother, he consoled them but never fought with his family over it. But everyone has their limits. Xue Feifei was right—without her, there would be another woman, but at the moment, it happened to be her by his side.
Luckily, it was her.