Meta-Analysis of Extant Data Makes Evaluations More Rigorous and Affordable

Tom Munk

Trying to make your evaluation more rigorous while limiting costs? Struggling with small sample sizes? Westat Senior Study Directors Tom Munk, Ph.D., and Elaine Carlson, Ph.D., are among the authors of a new article: “Using state data sets and meta-analysis of low-powered studies to evaluate a school-based dropout prevention program for students with disabilities.” The article research demonstrates the use of extant state data and meta-analysis for the evaluation of a dropout prevention program for students with disabilities.

The article notes that extant state data provides

  • A good source for evaluation of school-based interventions
  • Valid pre- and post-intervention outcomes
  • Good matches for treatment school

Also, meta-analytic methods can overcome differences in data availability across states.

Elaine Carlson

“State agencies collect all sorts of administrative data that are suitable outcome measures in program evaluations. Administrative data can also be useful for selecting matched comparison groups in quasi-experimental designs,” says Dr. Munk. “In an evaluation of dropout prevention programs, we combined administrative data from several states using meta-analysis. This approach offered more power than a study in a single state.”

The research was completed for the U.S. Department of Education's Office of Special Education Programs (OSEP) Center to Improve Program & Project Performance Site (CIPP).

Want to work with us?
You’ll be in great company.

About Us Careers

Westat Employees.
Westat Employee.
Centers for Disease Control and Prevention
Leadership Montgomery
Centers for Medicare & Medicaid Services
Substance Abuse and Mental Health Services Administration
The National Institutes of Health
AAA Foundation for Traffic Safety
The Johns Hopkins University
University of Maryland Baltimore Campus
University of Denver
U.S. Department of Veterans Affairs
U.S. Department of Transportation
U.S. Department of Justice
U.S. Department of Health and Human Services
U.S. Department of Education
U.S. Department of Agriculture
Toyota
The Verizon Foundation
Texas Education Agency
Baltimore Metropolitan Council
Teach for America
Social Security Administration
SiriusXM
Robert Wood Johnson Foundation
Organization for Economic Cooperation and Development
NYC Mayor’s Office for Economic Opportunity
National Science Foundation
Michigan Department of Health and Human Services
Maryland Cancer Registry
Internal Revenue Service
Georgia Department of Transportation
DC Public Schools
ClearWay Minnesota
Chicago Metropolitan Agency for Planning
University of Michigan
Explore Our Clients

Please wait...

Forbes 2020 The Best Employers for Diversity Powered by Statista Copyright 2019 Forbes Media LLC. Used with permissionForbes 2019: The Best Employers for Women Powered by Statista Copyright 2019 Forbes Media LLC. Used with permission

Westat is an Equal Opportunity Employer and does not discriminate on the basis of race, creed, color, religion, sex, national origin, age, veteran status, disability, marital status, sexual orientation, citizenship status, genetic information, gender identity or expression, or any other protected status under applicable law. Notices to Employees & Applicants.