"What people don't realize," Penn Wharton Budget Model director Kent Smetters told Fortune, is there's "just not as much ...