Federal-Led Evaluation

OAH Federal-Led Evaluation studies are large, multi-state, rigorous evaluations conducted under contract to OAH, focusing on programs designed to prevent teen pregnancy and programs to support expectant and parenting youth and their families. There are currently four federal evaluations.

Studies Started in 2016

Secondary Data Analysis Grant

The Office of Adolescent Health (OAH), through a competitive process, awarded a two-year cooperative agreement to ETR Associates. The grantee will explore new questions in the area of teen pregnancy prevention through analyses of existing data from the OAH Teen Pregnancy Prevention Program. ETR will focus on programs implemented with middle school youth. The purpose of this project is to enhance understanding of interventions designed to reduce teen pregnancy and existing disparities and to continue to increase available evidence. The final report is expected in June 2018.

Making Proud Choices! Evaluation Contract

Through a competitive process, OAH awarded a contract to Mathematica Policy Research (MPR) to conduct an implementation and impact evaluation of the commonly implemented Making Proud Choices! (MPC!) teen pregnancy prevention program. This implementation study will examine whether using classroom teachers to implement the program, rather than outside health educators, is an effective mode of delivery. The impact study will answer two primary research questions: 1. What is the impact of MPC!, implemented by health educators, on sexual behavioral outcomes? and 2. What is the impact of MPC!, implemented by health educators on sexual behavioral outcomes, relative to MPC! implemented by other types of facilitators? The goal of this evaluation is to answer questions about the effectiveness of this widely implemented but understudied teen pregnancy prevention program. Final reports are expected in February 2020.

Studies Started in 2015

Expanding our Use and Understanding of Evidence-based TPP Programs

The Office of Adolescent Health (OAH) awarded this contract to design a new large-scale, multisite evaluation of evidence-based teen pregnancy prevention programs. The evaluation will build on the growing portfolio of research activities OAH has sponsored since the office was established in 2010. Much of OAH’s existing evaluation work focuses on documenting and evaluating the first cohort of grantees funded under the OAH Teen Pregnancy Prevention (TPP) program. With this new evaluation, OAH is launching a “second generation” of evaluation activities, one that addresses a more targeted set of research questions of significant practical relevance to OAH and the broader field. In particular, the new evaluation will seek to substantially advance the existing evidence base by identifying and testing (1) replications of commonly used but understudied evidence-based teen pregnancy prevention programs, (2) significant or meaningful adaptations to existing evidence-based approaches, and (3) selected core components, key activities, and implementation strategies of common programs.

Evaluation of the TPP Tier 1B Grant Program

This OAH contract will elucidate the feasibility and impact of scaling up evidence-based programs and the mechanisms through which OAH grantees aim to achieve their outcome goals. The work of this project includes a descriptive assessment and documentation of how the 50 projects awarded funding under the 2015 Tier 1B grant program are scaling their programs (i.e., the strategies that have been adopted to expand the reach of evidence-based programs and mobilize communities). An intensive qualitative study will provide important information about the implementation and scaling-up experiences of programs that are trying to reach the highest risk populations. This project will go beyond descriptive analyses of the strategies and experiences of grantees by identifying a smaller number of projects that have the capacity and expertise to implement rigorous evaluations of their community effect, as well as designing a rigorous, cross-grantee study to assess the effectiveness of the larger Tier 1B program.

Quantitative Synthesis of Federally Funded TPP Programs

Extracting the maximum value from the evaluation efforts funded by OAH and other federal partners, this study represents a remarkable opportunity to use the findings from the multiple studies funded through the Teen Pregnancy Prevention (TPP) Program by OAH and the Personal Responsibility Program (PREP) program by the Administration for Children and Families (ACF) in new and creative ways.  This contract will synthesize the evidence from across these evaluations to learn about the program approaches, characteristics, components, implementation factors, and participant characteristics associated with program impact. Specifically, it will address the research and policy question of what program or contextual elements make a difference to youth outcomes.  This contract will support formulation of research questions that are of great policy and research interest, and analyses using state-of-the-art meta-analytic techniques. Results in formats and on platforms that are accessible to a wide range of audiences will ensure the widest possible dissemination.

Last updated: September 02, 2016