Housing downturn starts to weigh on business