“I think our society is less ready to hear that situation is going on with men than they are with women,” the actor told his “Brotherly Love” co-hosts.