Their group consist of men as they don't accept woman members not because they look down on them but because they don't know how to interact with them.
Most of their members are considered ugly, scary or both.
They would even scare children just by their appearance so they bonded with each other becoming quite close.
Each member protects the family members of their own members as their reputation grow so does their public image.
They were no longer feared nor shunned by their looks but was admired by their strength they are quite a respected group.
The Gentlemen group on the other hand consist of strong and handsome young men as their reputation isn't quite great as the Rough Bullies.
They were also known for toying with the female in the Thousand Race Kingdom and was hated by most female Adventure Group.
The beautiful woman behind the Rough Bullies was one of the top ten most gorgeous female in the Thousand Race Kingdom.