Evaluation Approach

EEC employs a systematic approach to evaluation that incorporates “best practice” strategies in the field of evaluation. These are evident in all EEC projects and have been found to yield the data and information necessary for clients to make informed, data based decisions for programming purposes and to provide summative reports.

While EEC believes that tracking of progress towards goal attainment and objectives is an important part of evaluation, EEC employs the strategy of ongoing, formative evaluation as a key element in making data based decisions and mid-course corrections, if warranted.

In order to benefit from a learning orientation approach to program evaluation, it is essential to have high quality data that are available in a timely manner. EEC ensures that only data that is necessary to inform the client’s evaluation is collected.

EEC evaluators value the development of a clear, sequential logic model in order to assist the client in clarifying program goals, objectives and intended outcomes. Our staff create draft logic models for clients to review and provide feedback. When this review occurs at the beginning of a program, clients and evaluators start the work “on the same page.”

Once the client and evaluators agree on the logic model or models if there are multiple initiatives, EEC evaluators develop the evaluation plan. Typically, evaluation plans include overarching questions, critical outputs, short-term, intermediate and long-term outcomes. Evaluation plans also outline data sources, methods and timelines for collection, analysis and reporting. Plans are developed by our staff for client review and revision. The plan serves as the roadmap for the evaluation and is reviewed at least annually and revised as needed.

EEC uses a mixed-methodology approach to most evaluation projects, incorporating both quantitative and qualitative approaches to collect, analyze and report data. Typical evaluations include development of surveys, interview and observation protocols, and focus group items to gather quantitative and qualitative data specific to the initiative in order to gauge project effectiveness.

All instruments and procedures are developed, tested, and implemented in accordance with standard evaluation protocols. Instruments are developed in a collaborative manner so that EEC evaluators utilize the content expertise of project staff. A range of surveys and instruments are designed based on the scope of the project.

EEC’s philosophy is to conduct all program evaluations in a non-intrusive manner. EEC evaluators will request access to student level data if warranted by the evaluation plan.

Once the clients and evaluators agree that the evaluation plan is in final form, EEC staff develop a task/timeline chart to manage the evaluation. Typical task/timeline charts include scheduling of ongoing meetings with clients, instrument development, data collection, data analysis, interim reports to clients and summative reporting. This process serves to keep the projects on time and on target in accordance with the client’s expectations.

EEC is committed to an ongoing dialogue with clients. During project start-up, we expect several face-to-face meetings with the client in order to develop a solid working relationship. After the initial meetings, EEC has the capacity for participation in key management team meetings via video conferencing or phone. Interim and summative reports are tailored to address the stakeholder audience(s) and are delivered on the agreed upon project timelines.