Skip to content

Big Data and FRED-MD

Monday, December 12, 2016
big data and fred md

Each issue of The Regional Economist, published by the Federal Reserve Bank of St. Louis, features the section “Ask an Economist,” in which one of the Bank’s economists answers a question. The answer below was provided by Assistant Vice President and Economist Michael McCracken.

What is “big data,” and how does FRED-MD contribute to it?

Statistical analysis has evolved. In the past, it was focused on one variable measured across people or one variable measured across time. But with the advent of superfast computers, researchers and analysts can jointly model a large number of variables, each with a large number of observations across time. That is “big data.”

Although being able to use big data has benefits, such as improving the accuracy of forecasts, collecting the data can be extremely time-consuming. To that end, my co-author, Serena Ng of Columbia University, and I (along with tremendous assistance from staff at the St. Louis Fed’s data desk) created FRED-MD, a monthly database of over 130 macroeconomic time series that cover categories such as output and income, the labor market and prices. The data series are similar to the ones used by James Stock of Harvard and Mark Watson of Princeton, who created a macroeconomic data set that has become the benchmark for a lot of what people do in economics when they are working with big data. With Stock and Watson’s choice of data as a guide, we used series that are available in FRED (Federal Reserve Economic Data), the St. Louis Fed’s main economic database. Now, rather than having thousands of economists separately put together their own data set, they can simply download a spreadsheet from our website.1

FRED-MD has several advantages. For one, using series from FRED allows us to update our data set relatively quickly each month. In addition, anyone can access the latest file as well as previous vintages, which allows for easier replication of empirical work and for easier comparison between methods used in different lines of research. In other words, results won’t differ simply because the researchers used two different data sets. Another advantage of FRED-MD is that it saves users from having to incorporate revisions and changes to the data themselves. Those are handled by the experts at the data desk.

Our main goal in providing this core data set was to make it easier for those who do empirical analysis of big data. Instead of spending time collecting the data, they can focus on the bigger questions that they are trying to answer.

Notes and References

1 For more information on FRED-MD and FRED-QD, which is a database of quarterly observations, see

Additional Resources

Posted In Federal Reserve  |  Tagged michael mccrackenfred mdfredbig dataask an economist
Commenting Policy: We encourage comments and discussions on our posts, even those that disagree with conclusions, if they are done in a respectful and courteous manner. All comments posted to our blog go through a moderator, so they won't appear immediately after being submitted. We reserve the right to remove or not publish inappropriate comments. This includes, but is not limited to, comments that are:
  • Vulgar, obscene, profane or otherwise disrespectful or discourteous
  • For commercial use, including spam
  • Threatening, harassing or constituting personal attacks
  • Violating copyright or otherwise infringing on third-party rights
  • Off-topic or significantly political
The St. Louis Fed will only respond to comments if we are clarifying a point. Comments are limited to 1,500 characters, so please edit your thinking before posting. While you will retain all of your ownership rights in any comment you submit, posting comments means you grant the St. Louis Fed the royalty-free right, in perpetuity, to use, reproduce, distribute, alter and/or display them, and the St. Louis Fed will be free to use any ideas, concepts, artwork, inventions, developments, suggestions or techniques embodied in your comments for any purpose whatsoever, with or without attribution, and without compensation to you. You will also waive all moral rights you may have in any comment you submit.
comments powered by Disqus

The St. Louis Fed uses Disqus software for the comment functionality on this blog. You can read the Disqus privacy policy. Disqus uses cookies and third party cookies. To learn more about these cookies and how to disable them, please see this article.