Attacks on the Royal Family by the Harry 'took its toll' on the late Queen (pictured) and impacted her wellbeing before her death in September last year, her friends reportedly said.