The Conservative Party is planning a "normal Christmas gathering of staff in London", a Cabinet minister has said, despite colleagues cancelling their festive parties.