Bankers Threaten Fed with Layoffs