At a recent show, the musician said he stood with Dave Chappelle and stated “a woman is a woman and a man is a man”