The restaurant industry says it is facing a double whammy - rising costs and customers with less money.