A gentleman is not. So you had nothing to worry about from the young master nor any you would have encountered at the time. However...

[ He's definitely teasing her here. He can't help himself, because this is what happens when he doesn't have Ciel to relentlessly bully all the time. ]

Who knows of the men here? With all sorts of different people and worlds, I cannot be so confident in my assessment.