Prince Harry left out revelations about his family in his memoir, saying he did not want "the world to know because I don't think they would ever forgive me".