For a long time, our standard of living has been going down and the middle class has been shrinking. But in recent years, those two trends have accelerated.