Insiders have challenged the exiled Californians’ claim that the queen was the one senior royal they remained on warm terms with.