A housing group "failed to respect" the family of a two-year-old boy who died after exposure to mould.