The series six finale became the fifth-most watched show after an audience of 12.8 million tuned in, but most viewers were left disappointed