This document describes and explains the relationships among common types of systematic program assessments. The best performance measures start conversations about organizational priorities, the allocation. Performance measurement systems can be thought of as both evaluation tools and management systems that are designed to provide useful feedback on performance in order to strengthen decision making and improve program and organizational performance. Performance measurement tells what a program did and how well it did it. Request pdf on mar 1, 2016, maud mediell and others published mcdavid, j. Outputs are the result of the activities inputs that go into a program, while outcomes. Hawthorn free pdf d0wnl0ad, audio books, books to read, good books to read, cheap books, good books, online books, books online, book. The framework for evaluation in public health 1 guides public health professionals in their use of program evaluation. The continuum encompasses all approaches discussed in this brief and lays out an ideal sequence of performance measurement and evaluation activities. Welcome to todays coffee break, presented by the evaluation.
The following list, while not exhaustive, offers information and practices supporting program evaluation and performance measurement in the arts. Sep 29, 2005 program evaluation and performance measurement by james c. Guidance on appeals process for 2008 parts may 23, 2008 11 pages, 78 kb. When programs conduct strong, practical evaluations on a routine basis, the findings are better positioned to inform their management and improve program effectiveness. Selecting key performance measures to be reported to external customers, stakeholders, and policy makers. Evaluation tells the programs effect on the people, families, or communities it is serving, that is, whether a program is producing results or having an impact box 2. Although our main focus in this textbook is on understanding how to evaluate the effectiveness of programs, we introduce 10 general questions.
Evaluation questions the relevance and effectiveness of the results measured by the indicators with respect to the goals of the initiative or project. The data collected measure specific outputs and outcomes a program is designed to achieve. Using the assessments in this guide, districts can incorporate performance measurement and monitoring for business processes that support academic achievement. Evaluations of rba have found it easy to understand and follow, highly. However, you will be able to understand the processes of evaluation, measurement and testing in a better a manner, and you will be able to plan and conduct evaluation and. Performance measurement purposes 317 metaphors that support and sustain performance measurement 318 organizations as machines 319 government as a business 319 organizations as open systems 320 a note on complexity 321 comparing program evaluation and performance measurement 322 summary 331 discussion questions 332 references 333 9. Fall update preparing program performance information for publication in january 2009 october 3, 2008 9 pages, 81 kb. Program evaluation and performance measurement sage. Rent program evaluation and performance measurement an introduction to practice 2nd edition 9781412978316 and save up to 80% on textbook rentals and 90% on used textbooks.
The authors cover the performance management cycle in organizations, which includes. But it also very often pulls qualitative information into the pot. Assessment the quality of students outcomes measured against the learning objectives. There are almost infinite possibilities for indicators, therefore careful. Later, performance measurement is done after the product is available in order to understand the performance of the actual system to various real world workloads and to identify modifications to incorporate in future designs. Eda performance measurement and program evaluation u. But the approach encourages accumulation of longitudinal data. A tool to guide program design and performance measurement. An introduction to practice, second edition offers an accessible, practical introduction to program evaluation and performance measurement f. Plans set out objectives and criteria for success, while performance reports assess what has been. Evaluation certainly can use quantitative measures to decide if change has happened or not.
Oct 25, 2012 program evaluation and performance measurement. Chapters 1, 2 logic modelling, 3 research designs, 4 measurement, and 5 qualitative methods serve as foundations for both program evaluation and performance measurement. Today there is greater emphasis on nonfinancial and multidimensional performance measures to understand and manage the performance of the organisation to achieve its goals. Identify the organizational champions of change sustained leadership. Hawthorn discuss topics in a detailed fashion, making it a useful guide for practitioners who are constructing and implementing performance measurement systems.
Program evaluation and performance measurement 3rd ed. The program cycle design, implementation and evaluation fits into the broader cycle of the governments expenditure management system. Performance measurement is mainly deals with targets of specific indicators and schedule. A typical program evaluation is illustrated with a case study, and its strengths and limita tions are summarized. An introduction to practice, authorjames mcdaid and laura r. We all play multiple roles and have multiple interests in the performance of organizations and individuals. Guide to performance measurement and program evaluation. Performance indicators include all the inputs, outputs, outcomes, or ratios shown as arrows in figure 2 and many more. Introduction to performance measurement ohio school districts regularly measure academic performance and track other educationoriented indicators or performance measures. Chapter 2 describes some of the unique attributes of public health that influence the design and implementation of a performance measurement. Part non measures appeal and recommendation form 4 pages, 111 kb. And you can use performance measures as tools within an evaluation. Is the measure compatible with other performance measures. Pdf program evaluation and performance measurement.
An introduction to practice an introduction to practice 3rd edition by james c. Drivers for program planning, performance measurement, and evaluation government performance results act gpra requires strategic plan, annual plan, and annual performance report ombs program assessment rating tool part tool designed to assess and evaluate programs across the government dd act requirements in sections 104 and 154. This guide arose, in part, out of an interest in creating a howto manual that would provide. The policy of the doe is to maximize contractor performance and to align costs with. Develop a program performance evaluation plan to collect and report on evaluation data. An introduction to practice welcome to the companion site. Program evaluation, performance measurement, and data collection.
Program evaluations typically examine a broader range of information on program performance and its context than is feasible to monitor on an ongoing basis. Performance measurement performance measurement is the identification and measurement of indicators to provide periodic feedback on performance. Developing performance measures developing performance measures 1104 page 4 g. Program evaluation and performance monitoring family health. Program evaluation and performance measurement james c. Measurement, evaluation, performance, performance indicators. Evaluation, performance management, and quality improvement. Best practices in performance measurement in government part 1. For this evaluation question then, a grantee might conduct periodic surveys, interviews, or focus groups with a small number of clinics participatingin screening for. Guidebook for performance measurement public health. When integrated, the combination of performance measurement and program evaluation, or performance information pi, can provide guidance on four critical areas of decisionmaking. To help nonprofits, and their funders, think about the roles of different performance measurement and evaluation approaches a performance measurement evaluation continuum is illustrated in figure 1. Introduction information acquired by measuring and evaluation are a necessary condition for good. Hawthorn discuss topics in a detailed fashion, making it a useful guide for practitioners who are constructing and.
At cdc, program evaluation supports our agency priorities. Performance measurement to evaluation sponsored by the world bank group community outreach program. Grantee guide to project performance measurement guide is designed to help projects funded. Performance measurement has evolved from purely financial performance measures such as profit, cash flow or the return on capital employed roce. It is a practical, nonprescriptive tool, designed to. Program evaluation and performance measurement offers a conceptual and practical introduction to program evaluation and performance measurement for public and nonprofit organizations. Performance evaluation and measurement plans for cost. Participatory approaches, in particular, can help to build capacity. The stakes are high, so performance measures should be meaningful and help tell the story of how well an effort e. Program evaluation is a process of collecting information that will help identify how. Part measures appeal and recommendation form 4 pages, 204 kb. Ideally, multiple methods will be used in a complementary fashion to provide a more complete understanding of the program.
Eda collects and reports on performance measures in compliance with government performance and results act of 1993 that, as amended by the gpra modernization act of 2010, establishes requirements for all agencies to collect, analyze and report on their performance edas performance goals and specific performance metrics are tied to the u. Using examples, it covers topics in a detailed fashion. Program evaluation, however, uses measurement and analysis to answer specific questions about how well a program is achieving its outcomes and why. Our expertise in performance measurement also allows us to respond to the growing demand for the evaluation of performance based incentive systems related to the delivery of public services by nongovernmental and private organizations. Performance measurement provides the data you will use to measure your program s results. Performance measurement and program evaluation share similarities but serve different purposes. It is right however to say evaluation is more comprehensive than performance measurement.
We introduce the performance management cycle and show how program evaluation and performance measurement fit resultsbased management systems. Consistently competent performance exceeding normal standards in all critical factors within position and category. This guide is one of four guides originally developed for ovc and the grantees who received funding to serve victims of human trafficking. As mentioned, evaluation in contrast to performance measurementoccurs with less regularity, covers fewer programs, and seeks explanations for high or poor performance. You can use evaluation to see if a specific initiative has had an impact on a particular performance measure. Performance measurement provides the data you will use to measure your programs results. Performance measurement is an ongoing process that monitors and reports on a program s progress and accomplishments by using preselected performance measures. Performance measurement guide for information security. Performance evaluation and measurement plans for costreimbursement, nonmanagement and operating contracts reference. Mcdavid, 9781412906685, available at book depository with free delivery worldwide. What are the benefits performance measurement and evaluation are powerful tools to improve management and decision making at all levels. It is aimed at exercise science professionals, students and lecturers concerned with measurement and evaluation techniques. Zivan risti performance evaluation and measurement of the.
Effective program evaluation is a systematic way to improve and account for public health actions by involving procedures that are useful, feasible, ethical, and accurate. Are used for continuous programquality improvement. Evaluations are organized along the strategic outcomes of the program. Performance and results act gpra, the government paperwork eli.
Program evaluation and performance measurementoffers a conceptual and practical introduction to program evaluation and performance measurement for public and nonprofit organizations. Description of the book measurement and evaluation in human performance. Key steps 12 steps for designing and implementing a performance measurement system 1. Performance measurement, as shown below, is a routine requirement for programs to assess progress towards goals. Program evaluation 101 american evaluation association. This is introduction course, and therefore, you will not be expected to become an expert in educational evaluation and testing. Performance measurement is the ongoing monitoring and reporting of program accomplishments and progress toward.
Jun 23, 2015 evaluation performance measurement and assessment 1. The program management process is the overall, generic process that helps to guide the. In the previous chapter we described how to develop outcome and process objectives, performance measures, an action plan and a timeline, and how to. Performance measurement handbook of practical program. This title provides indepth measurement and evaluation techniques. What is the main difference between performance measurement. Resources on program evaluation and performance measurement nea. What are performance measurement and program evaluation.
Programs need to show effectiveness to justify funding. Program evaluation and performance measurement samhsahrsa. Outstanding ratings should only be awarded on rare occasions. Shipping may be from multiple locations in the us or from the uk, depending on stock availability. Please note that all the materials on this site are especially geared toward maximizing your understanding of the material. Integrating performance measurement and program evaluation. The course team of b889 performance measurement and evaluation has devel oped this course with a wide range of people in mind from external users of performance related information to producers of it. Shipping may be from multiple locations in the us or. Save up to 80% by choosing the etextbook option for isbn. Evaluation is the systematic assessment of the worth or merit of some object evaluation is the systematic acquisition and assessment of information to provide useful feedback about some object evaluation vs.
Program evaluations, in contrast, are specially planned research projects intended to provide findings and conclusions about the program as a whole that augment performance measurement information. Key evaluation questions to be answered, potential available data sources, and feasibility of collecting available data required performance measures how evaluation and performance measurement will track subpopulations how evaluation findings and performance measures. Performance measurement to evaluation urban institute. Consequently, much of the information presented in the first five steps of this eight step process applies when supervisors and employees want to measure results. In essence, public officials need information that is accurate, complete and timely hatry 20. Evaluation tells the program s effect on the people, families, or communities it is serving, that is, whether a program is producing results or having an impact box 2. Program evaluation and performance measurement does not assume a thorough understanding of research methods and design, instead guides the reader through a systematic introduction to these topics. An introduction to practice, second edition offers an accessible, practical introduction to program evaluation and performance measurement for public and nonprofit organizations, and has been extensively updated since the first edition. Performance measurement and program evaluation different focus performance measurement focuses on whether a program has achieved its objectives, expressed as measurable performance standards.
Sometimes, as with the most significant change technique, the data is only qualitative. A typical scenario is to be asked to evaluate a program that has already been implemented, with no real ways to create control groups and usually no baseline preprogram data to construct beforeafter comparisons. Second edition program evaluation and performance measurement. Whats the difference between evaluation and performance. They explain acceptable performance, and the data provides timely information on performance. Nor does the book assume a knowledge of statistics, although there are some sections that do outline the role that statistics play in evaluations.
An outcome is not what the program actually produced itself the output, but the consequences of those products, services, or assistance. When linked together, a set of performance measures can tell a powerful story too. Develop an evaluation plan for collecting data on performance measures. This site is intended to enhance your use of program evaluation and performance management, 3 rd edition, by james c. Using examples, it covers topics in a detailed fashion, making it a useful guide for students as well as. Evaluating program performance is a key part of the federal governments strategy to manage for results. As ora intends to update this list periodically, we welcome suggestions of other resourcese. A number of existing laws, rules, and regulat performance measurement in general, and information security performance measurem particular, as a requirement. Traditional performance measurement activities apply clearly defined measures to evaluate performance outcomes. Understanding the role they play to improve public health craig thomas, phd liza corso, mpa harald pietz division of public health performance improvement office for state, tribal, local and territorial support centers for disease control and prevention august 6, 20. Program evaluation and performance measurement at the epa.
Develop logic models for the program for which performance measures are needed. Program evaluation is an essential organizational practice in public health. Performance measures provide a snapshot of current performance capabilities and track whether actual performance is getting better, staying the same, or getting worse over time. Program evaluation and performance measurement 3rd edition. Values repeated measurement of outcomes at appropriate intervals. Performance evaluation can be classified into performance modeling and performance measurement, as illustrated in table 1. Is performance measurement different from program evaluation. Price performance ratios quality performance mebsuree deliv0ly prforrnance measures purchasing flowcharts and reports the purchaeing aud some concluding observations 78 79 84 86 86 89 91 95 97 99 102 chagter six. Performance measurement is generally defined as regular measurement of outcomes and results, which generates reliable data on the effectiveness and efficiency of programs. Performance measurement assesses a program s progress toward its stated goals. The essential purpose of both program evaluation and performance measurement in the public sector is to provide information for public officials to help them improve the effectiveness, efficiency, equity and or other evaluative criteria of public services.