Project Description
Abstract: Reference Publication:
Review of KIPP Middle Schools: Impacts on Achievement and Other Outcomes
Contact:
William J. Mathis, (802) 383-0058, wmathis@sover.net
Gregory Camilli, (303) 492 8391, gregory.camilli@colorado.edu
URL for this press release: http://tinyurl.com/cpna3fn
BOULDER, CO (April 30, 2013) – Do middle schools operated by the Knowledge Is Power Program (KIPP) excel in promoting student achievement? A new review gives a second look at a recent study that answered that question “yes.”
In a study released in February, Mathematica Policy Research concluded that, based on achievement test scores, KIPP middle school students had substantially higher test scores than comparison non-KIPP students. A review published today of the Mathematica study finds that while the original evaluation was carefully planned and executed and a positive impact is supported by the evidence, the authors may have overstated the benefits attributable to KIPP.
The study, KIPP Middle Schools: Impacts on Achievement and Other Outcomes, was reviewed for the Think Twice think tank review project by Professor Gregory Camilli of the University of Colorado Boulder. The review is published by the National Education Policy Center, housed at the CU Boulder School of Education.
Using two different approaches, the Mathematica researchers concluded that the KIPP students scored, after three years, higher than comparison students not attending KIPP schools at the equivalent of 11 months of additional learning in math and eight months in reading. Camilli observes that the results are similar in size to those found from some previous educational experiments, including a small experiment with KIPP schools.
Camilli explains that while the KIPP outcomes could be substantial if they were found to persist into later grades, the benefits appear to be overstated in the report.
For one thing, Camilli points out, “translating educational outcomes into ‘months’ of additional learning is an inexact science and can lead to absurd results if taken literally.” Relative to one month of learning from grade 11-12, for example, information supplied by test publishers could be used (in this case misused) to demonstrate that children learn the equivalent of 10 years from kindergarten to first grade. Additionally, reported measures of effectiveness that attempt to take attrition into account are smaller than the estimates used to draw conclusions about the effectiveness of KIPP.
He also finds that the certainty with which the report attributes the effect of KIPP on higher-order reasoning skills is not borne out by evidence – and that that topic “requires additional empirical work to provide greater clarity.”
The Mathematica researchers also found that the impact of KIPP was unevenly distributed across KIPP schools. For example, most, but not all, KIPP schools had a positive impact. Though a few clues emerged from the data, the factors leading to this variation could not be identified. For this reason, Camilli writes that information provided in the report is not complete enough to guide education policy. Finally, Camilli advises that “Future work evaluating the persistence of KIPP impact will be key to drawing a conclusive judgment of the educational significance of KIPP schooling.”
Find Gregory Camilli’s review on the NEPC website at: http://nepc.colorado.edu/thinktank/review-KIPP-middle-schools/.
Find KIPP Middle Schools: Impacts on Achievement and Other Outcomes, by Christina Clark Tuttle, Brian Gill, Philip Gleason, Virginia Knechtel, Ira Nichols-Barrer, and Alexandra Resch, on the web at: http://www.mathematica-mpr.com/publications/pdfs/education/KIPP_middle.pdf/.
The Think Twice think tank review project (http://thinktankreview.org) of the National Education Policy Center (NEPC) provides the public, policy makers, and the press with timely, academically sound reviews of selected publications. NEPC is housed at the University of Colorado Boulder School of Education. The Think Twice think tank review project is made possible in part by support provided by the Great Lakes Center for Education Research and Practice.
The mission of the National Education Policy Center is to produce and disseminate high-quality, peer-reviewed research to inform education policy discussions. We are guided by the belief that the democratic governance of public education is strengthened when policies are based on sound evidence. For more information on the NEPC, please visit http://nepc.colorado.edu/.
This review is also found on the GLC website at http://www.greatlakescenter.org/
