The average 30-year fixed-rate mortgage was 6.62% for the week ending Jan. 4, according to Freddie Mac's latest Primary Mortgage Market Survey. However, many perspective homebuyers said they need rates to fall before buying a house.