Li Xianyu couldn't remove his glove from the start to touch her. That intention would be too obvious. Aoki Yui is a master, as long as she was alerted, it would be very difficult to touch her.
Even if he had the Hua Yang's mental power, and was always immune to the other party's charm, but as long as the other party has been alerted to his left hand, Li Xianyu's trick would fail.
Aoki Yui was a master swordsman. If she was prepared, then he didn't stand a chance at all. Thus, accepting that he was charmed and being suppressed in all aspects, would let the opponent let down her guard.
Not good, his left hand is strong, Aoki Yui thought.
Of course Aoki Yui paid attention to Li Xianyu's left hand. After all, it was an ace move in the battle against Miyamoto Hideki.