Conservative party Leader Pierre Poilievre defended his decision Friday to speak to a think tank that has come under fire for comments on residential schools and discrimination.