James Argent and Lydia Bright have been meeting up in secret and spending time at each other's houses, MailOnline can reveal.