Seven Fields and the others didn't have it easy either. This situation was like if you knew a beautiful girl, but had a vulgar, wolf-like friend that wouldn't stop bothering you to introduce him. No matter what you did, you couldn't block him or dissuade him and in the end, your only option was to ask the beautiful girl if you could bring your friend along.
It obviously wouldn't be good to just let him go and do whatever he wanted, but Seven Fields and the others weren't worried about this. The "beautiful girl" in front of them definitely wouldn't be bullied around by the wolf. They were only worried that after the beautiful girl beat the wolf to death, they would also get beaten down.... After all, the person they were talking about wasn't a beautiful little girl, but rather brother expert, a person who had already shocked the world by the time he reached Level 30.