3 Review(s)

A new book from the National Research Council recommends changes in how the federal government evaluates the efficiency of research at EPA and other agencies. Assessing efficiency should be considered only one part of gauging a program's quality, relevance, and effectiveness. The efficiency of research processes and that of investments should be evaluated using different approaches. Investment efficiency should examine whether an agency's R&D portfolio, including the budget, is relevant, of high quality, matches the agency's strategic plan. These evaluations require panels of experts. In contrast, process efficiency should focus on "inputs" (the people, funds, and facilities dedicated to research) and "outputs" (the services, grants, publications, monitoring, and new techniques produced by research), as well as their timelines and should be evaluated using quantitative measures. The committee recommends that the efficiency of EPA's research programs be evaluated according to the same standards used at other agencies. To ensure this, OMB should train and oversee its budget examiners so that the PART questionnaire is implemented consistently and equitably across agencies.Table of Contents Front Matter Evaluating Research Efficiency in the U.S. Environmental ProtectionAgency Summary 1 Introduction: The Government Performance and Results Act, theProgram Assessment Rating Tool, and the Environmental ProtectionAgency 2 Efficiency Metrics Used by the Environmental Protection Agencyand Other Federal Research and Development Programs 3 Are the Efficiency Metrics Used by Federal Research andDevelopment Programs Sufficient and Outcome-Based? 4 A Model for Evaluating Research and Development Programs 5 Findings, Principles, and Recommendations Appendix A: Biographic Information on the Committee on Evaluatingthe Efficiency of Research and Development Programs at the U.S.Environmental Protection Agency Appendix B: Evaluating the Efficiency of Research and DevelopmentPrograms at the Environmental Protection Agency: Workshop Summary Appendix C: Program Assessment Rating Tool (PART) Questions Appendix D: The Environmental Protection Agency's Strategic andMulti-year Planning Process Appendix E: Agency and Industry Efficiency Measures Appendix F: Draft Board of Scientific Counselors Handbook forSubcommittee Chairs: Draft Proposed Charge Questions for BOSCReviews Appendix G: OMB's Research and Development Program InvestmentCriteria Appendix H: Charge to the BOSC Subcommittee on Safe Pesticides/SafeProducts Research Appendix I: PART Guidance on Efficiency Measures