The lousy housing market continues to be a "key impediment" to a faster economic recovery, Federal chairman Ben Bernanke told home builders Friday in Orlando, Fla.