Program Evaluation
Our primary focus is on formative and summative evaluation. Formative evaluation assesses how programs are being implemented, helps identify program strengths and areas for improvement, and informs program improvements. Summative evaluation examines results or the effects of program activities.
All three founding members have extensive education and experience in designing, managing, and implementing both formative and summative evaluations. These evaluations have ranged in scope from small to large and been conducted at the local, state, or national level. We tailor our evaluations to meet each organization’s unique needs, which might include one or more of the evaluation services described below.
Strategizing and creating a working document that describes how the program will be monitored and evaluated. We work with you to develop a logic model that clearly links your program goals, objectives, and activities to measurable short, medium, and long-term outcomes. The rest of the plan spells out the nuts and bolts (e.g., data collection, roles and responsibilities, timeline) for evaluating what is contained in the logic model. Ultimately, the plan serves as a roadmap clarifying the steps needed to assess the processes and intended outcomes of your program.
Determining the extent to which your program adheres to contracted requirements or pre-defined processes. In the era of evidence-based programming, we often are asked to not only capture program outcomes but also the degree to which programs were implemented according to evidence-based or -informed protocols. This can be a critical step in understanding a program’s success (or opportunities for improvement). A program audit examines many if not all aspects of a program’s operations—including service implementation, staff time management, program expenditures, and overall performance.
Developing and implementing a process for gathering information that will help you answer the questions you have about your program. This includes creating or identifying instruments, developing sampling plans, as well as collecting qualitative and/or quantitative data through observations, interviews, focus groups, surveys, etc. We help you decide what data collection methods make the most sense based on evaluation questions and program resources.
Managing information from one or more sources. We support you in identifying critical data, becoming proficient in data management techniques, and organizing and processing data to meet your reporting and management needs.
Understanding and applying protective privacy measures to prevent unauthorized access to data. We assist you with reviewing the current standards for information privacy and secure data systems; conducting an assessment of your data security protocols; establishing policies and procedures for the secure handling, transfer, and storage of data; and facilitating trainings for your staff or stakeholders on data security.
Employing statistical and/or qualitative techniques to describe, illustrate, and/or look for patterns or themes in the data. This could mean creating simple descriptive displays or conducting complex statistical tests. Either way, our goal is to ensure you understand what the data do and do not tell you about your program so you can effectively use the data and tell your story.
Developing written reports or presentations to communicate evaluation results and tell your story. We create reports and/or presentations that suit your needs as well as those of your stakeholders. From briefs to technical reports, grantee performance reports, and presentation slides, we help ensure that the right information is relayed to the right audience in the right way.