ByWilliam Bosshardt, Paul Grimes, Mary Suiter
Numerous studies reveal that most Americans do not have a strong understanding of basic economic concepts and financial principles. The results of a 2010 survey indicate that fewer than 44 percent of adults can identify the Federal Reserve System as the institution responsible for the nation's monetary policy.1
The potential costs of economic illiteracy in a market economy are great. For example, the recent financial crisis and ensuing recession are replete with stories of household and business decision-makers who did not fully understand how changing market forces would impact the agreements and contracts that they signed. A poor understanding of the marketplace results in poor choices, which, in turn, lead to poor outcomes not only for individuals but for society in general.
Members of the Federal Reserve's Board of Governors recognize the importance of an economic and financially literate citizenry, and each of the 12 regional Federal Reserve banks provides public outreach programs in economics and personal finance. The president of the Federal Reserve Bank of St. Louis, James Bullard, has pointed out, "Many people think economics is too complicated. But everyone lives with the consequences of supply and demand every day. We live in a market system, and people need to understand how the system works." 2
Although each regional Federal Reserve bank offers economic education programming, the programs are different. The Federal Reserve banks of St. Louis and Atlanta have a similar focus, one in which teacher workshops are an important strategy. The two banks found that the resources they invest in these workshops yield results many times over.
Teachers who participate in professional development workshops reach students not only during the year in which the teachers attend a workshop, but they continue to reach additional students each subsequent year of their teaching career. The benefits, obviously, roll down to the students. Many research studies provide evidence that professional development for K-12 teachers increases student knowledge of economics and personal finance.3 For example, results from a 2006 study show that high school students whose teachers participated in economic education training programs and workshops scored better on required state assessments in economics.4
Because of the emphasis on these workshops by the St. Louis and Atlanta Feds, it made sense for the two banks to partner in an assessment of their programs.
In a 2009 survey, the Council for Economic Education reported that 49 states (all but Rhode Island) and the District of Columbia include economics as part of their public schools' curriculum but that only 40 states require local school districts to implement specific standards.5 In the Eighth District, Missouri and Illinois have a high school personal finance requirement, but no economics requirement. Tennessee has both a high school personal finance requirement and an economics requirement. Mississippi and Indiana have a high school requirement for economics but not personal finance. Arkansas recently instituted a high school requirement for a semester of economics and personal finance combined. Kentucky does not have an economics or a personal finance requirement. Although these seven states have standards for infusion of economics content in the lower grades, this effort is part of social studies, and social studies is no longer tested by the states. Furthermore, most states, including those in the Eighth District, lack strong teacher training requirements for economics and personal finance. A typical high school teacher in the St. Louis and Atlanta districts completed only two courses in economics while in college. Thus, there is a need for teacher training and professional development that is not being fully met.
Given the importance of teacher workshops, the St. Louis and Atlanta banks recently undertook a comprehensive assessment of these outreach programs. This project examined 65 workshops across the two districts. Participating teachers completed a pre-workshop survey, a post-workshop evaluation form and a web-based follow-up survey, which was sent several weeks after their training. For some workshops, teachers were pre- and post-tested, using assessment instruments specifically developed for this project.
First, the two banks identified the content that was considered essential for meeting the Board of Governors' charge of delivering educational outreach programs in economics and personal finance. A work group composed of research economists, economic educators, other Fed staff and a consulting team that was hired to oversee the assessment project identified three basic areas into which most of the banks' workshops could be categorized: 1) the Federal Reserve System, 2) personal finance and 3) general economics. Content standards were developed in two of these areas—the Federal Reserve System and personal finance. (These standards can be viewed at www.frbatlanta.org/edresources/assessment/) For general economics, the decision was made to use the National Voluntary Standards in Economics, as published by the Council for Economic Education. Two assessment instruments were then developed based on these standards: the Federal Reserve Education Test (FRET) and the Personal Finance Test (PFT). These were used to test teacher knowledge gains as a result of participation in the Fed workshops.
The pre-workshop survey included questions about the teachers' professional experiences and prior interactions with the Fed. The post-workshop survey contained a variety of evaluation items about the teachers' workshop experience; it also collected information about current teaching schedules and plans to use the information presented during the workshop. Finally, the follow-up survey, sent approximately four to six weeks after the workshop, was used to determine if teachers used the knowledge and materials received at the workshop in their classrooms.
Participants from eight one-day teacher workshops on the Federal Reserve System were pre- and post-tested using the 20-question FRET. Each of these workshops was taught by Federal Reserve education outreach specialists and followed roughly the same outline. Figure 2 reports the results for the 216 teachers who took both the pre-test and post-test and provided background information on their prior workshop experience. The teachers were asked if they had participated in workshops on economics or personal finance during the previous three years. In addition, they were asked about prior attendance at workshops, on any topic, produced by the Fed.
The table clearly reveals that all teacher groups increased their knowledge of the Fed as a result of workshop participation. For teachers with no prior workshop experience, the increase was 2.70 points, which was close to the increase of 2.83 points for teachers who had not participated in a previous Federal Reserve workshop but who had been to other professional development workshops. For those teachers who had attended a previous Federal Reserve workshop, the increase was 1.58 points or nearly 13 percent over their pre-test mean. All of these gains are statistically significant.
Figure 2 also indicates that teachers benefit from attending multiple workshops over time. Teachers with no prior workshop experience scored 9.24 points on the pre-test and left their first workshop with a post-score of 11.94 points. A teacher returning after a prior workshop given by the Federal Reserve comes in with a pre-score of 12.43, which increases further to 14.01. Since a score of 15 points on the FRET is considered to be the level required for mastery of the material, two workshops seem to go a long way toward meeting that goal.
Of course, the data inherently reflect a self-selection process. Economics teachers,
who possess relatively more knowledge about the Fed, are more likely to attend a Fed workshop. Teachers who voluntarily choose to attend a workshop are also more likely to make that choice again. It should be noted that while teachers with no prior workshop experience of any kind were generally not economics teachers, the two subgroups (prior non-Fed workshop versus a prior Fed workshop) of the teachers who had been to a prior workshop contained approximately the same (high) proportion of economics teachers. When comparing teachers with previous Fed workshop experience to those who had been to prior non-Fed workshops, the experienced group scored significantly higher on the FRET. Taken together, the results imply that the Fed workshops increase teacher learning about the Fed and that this learning compounds over time through participation in additional workshops.
Although the testing revealed that teachers learn as a result of workshop participation, the extent to which they actually use that learning—and the curriculum material received at the workshops—in their classes is another question. The evaluation conducted after all Fed workshops asked teachers if they thought they would use their learning in the classroom. Overall, 83 percent indicated a specific course in which they planned to use the information learned. On average, teachers reported reaching about 80 students in the courses in which they planned to use the materials. With an average teacher attendance of about 25, each Fed workshop had an immediate impact on roughly 2,000 students. The follow-up survey sent to teachers asked them if they had indeed used their new knowledge in their classes. Overall, 73 percent of the respondents to the follow-up said they had.
Teacher workshops are only one part of the Fed's educational outreach portfolio of activities. The St. Louis and Atlanta Feds also produce and distribute lesson plans and curriculum materials for K-12 teachers, conduct presentations and seminars at professional education conferences, publish newsletters for educators and produce various programs for specially targeted groups, such as college professors. The St. Louis Fed has recently expanded its educational outreach through online lessons that can be directly accessed by high school students, as well as the general public. (See www.stlouisfed.org/education)
Allgood, Sam; and Walstad, William B. "The Longitudinal Effects of Economic Education on Teachers and Their Students." Journal of Economic Education, Spring 1999, Vol. 30,
No. 2, pp. 99-111.
Buckles, Steven; Strom, Robert J.; and Walstad, William B. "An Evaluation of a State Consumer and Economic Education Program: Implications for Effective Program Delivery." Journal of Economic Education, Spring 1984, Vol. 5, No. 2, pp. 101-10.
Bullard, James. "New President Bullard Bullish on Economics," Federal Reserve Bank of
St. Louis' Central Banker, Summer 2008, p. 1. See www.stlouisfed.org/publications/central-banker/summer-2008/new-president-bullard-bullish-on-economics
Council for Economic Education. Survey of the States. New York: Council for Economic Education, 2009.
Council for Economic Education. National Content Standards in Economics. New York: Council for Economic Education. 2010.
Grimes, Paul W.; Rogers, Kevin E.; and Bosshardt, William D. "Economic Education and Consumer Experience During the Financial Crisis." Working paper, College of Business, Mississippi State University, 2010.
Sosin, Kim; Dick, James; and Reiser, Mary Lynn. "Determinants of Achievement of Economics Concepts by Elementary Students." Journal of Economic Education, Spring 1997, Vol. 28, No. 2, pp. 100-21.
Swinton, John R.; De Berry, Thomas; Scafidi, Ben; and Woodard, Howard C. "Does Professional Learning for High School Economics Teachers Improve Student Achievement?"
Paper presented at the 2007 American Economic Association Meetings, Chicago.
Watts, Michael. "What Works: A Review of Research on Outcomes and Effective Program Delivery in Precollege Economic Education." National Council on Economic Education. 2005. See www.councilforeconed.org/eee/research/WhatWorks.pdf