A new paper by the NY Fed:
The Failure to Forecast The Great Recession
Experience shows that what happens is always the thing against
which one has not made provision in advance.
– John Maynard Keynes1
Our best plan is to plan for constant change and the potential for instability, and to recognize that the threats will constantly be changing in ways we cannot predict or fully understand.
– Timothy Geithner2
…
How Bad Were the Forecasts for Real Activity?
Economic forecasters never expect to predict precisely. One way of measuring the accuracy of their forecasts is against previous forecast errors. When judged by forecast error performance metrics from the macroeconomic quiescent period that many economists have labeled the Great Moderation, the New York Fed research staff forecasts, as well as most private sector forecasts for real activity before the Great Recession, look unusually far off the mark.
One source for such metrics is a paper by Reifschneider and Tulip (2007). They analyzed the forecast error performance of a range of public and private forecasters over 1986 to 2006 (that is, roughly the period that most economists associate with the Great Moderation in the United States).
On the basis of their analysis, one could have expected that an October 2007 forecast of real GDP growth for 2008 would be within 1.3 percentage points of the actual outcome 70 percent of the time. The New York Fed staff forecast at that time was for growth of 2.6 percent in 2008. Based on the forecast of 2.6 percent and the size of forecast errors over the Great Moderation period, one would have expected that 70 percent of the time, actual growth would be within the 1.3 to 3.9 percent range. The current estimate of actual growth in 2008 is indicating that our forecast was off by 5.9 percentage points.
Using a similar approach to Reifschneider and Tulip but including forecast errors for 2007, one would have expected that 70 percent of the time the unemployment rate in the fourth quarter of 2009 should have been within 0.7 percentage point of a forecast made in April 2008. The actual forecast error was 4.4 percentage points, equivalent to an unexpected increase of over 6 million in the number of unemployed workers. Under the erroneous assumption that the 70 percent projection error band was based on a normal distribution, this would have been a 6 standard deviation error, a very unlikely occurrence indeed.
…
Three main failures in our real-time forecasting stand out:
-
Misunderstanding of the housing boom. Staff analysis of the increase in house prices did not find convincing evidence of overvaluation (see, for example, McCarthy and Peach [2004] and Himmelberg, Mayer, and Sinai [2005]). Thus, we downplayed the risk of a substantial fall in house prices. A robust approach would have put the bar much lower than convincing evidence.
-
A lack of analysis of the rapid growth of new forms of mortgage finance. Here the reliance on the assumption of efficient markets appears to have dulled our awareness of many of the risks building in financial markets in 2005-07. However, a March 2008 New York Fed staff report by Ashcraft and Schuermann provided a detailed analysis of how incentives were misaligned throughout the securitization process of subprime mortgages—meaning that the market was not functioning efficiently.
-
Insufficient weight given to the powerful adverse feedback loops between the financial system and the real economy. Despite a good understanding of the risk of a financial crisis from mid-2007 onward, we were unable to fully connect the dots to real activity until 2008. Eventually, by building on the insights of Adrian and Shin (2008), we gained a better grasp of the power of these feedback loops.
However, the biggest failure was the complacency resulting from the apparent ease of maintaining financial and economic stability during the Great Moderation. Perhaps most important, as noted by some analysts as early as the 1990s, these adverse consequences of the Great Moderation were most likely to arise from the actions, judgments, and decisions of financial market participants:
Longer stretches of economic growth imply greater leverage and complacency and thus, greater financial problems when recessions do occur.
–William Dudley and Edward McKelvey3
…
But, no need to be alarmed, now they’ve learned their lessons and these errors will never be repeated again.
In any other field (pretending to call itself scientific) these activities would amount to blatant curve-fitting, i.e. “explaining” reality with models that only “work” looking back, having no predictive powers whatsoever. Real scientists would laugh bozos like these straight out of the conference room.
EDIT: Just saw that Wheylous (and ZeroHedge) had beat me to this in the Low Content thread. Nevermind, this is good enough for its own thread.