The sweet Gogglebox couple have been part of the hit series for the last five years and have decided to leave