Low interest rates over the last few years have kept houses affordable, even with the rising home prices.