Terms of reference (TOR) for conducting terminal evaluation of Debre Tabor and Gondar Educare 4 projects.

Description of Programme Location and Context

SOSCVE Bahir Dar program location was established in the year 2000 G.C and is mainly working on an alternative care program supporting children to grow up in alternative families in established villages by providing comprehensive care and essential services for their holistic development. Furthermore, SOSCVE Bahir Dar Program manages and implements various facilities and programs, including Alternative Care (AC), the Family and Community Strengthening Program (FCSP), a kindergarten, and the HGS (Hermann Gmeiner School (which includes both primary and secondary schools). The AC and FCSP programs are the organization’s core interventions, providing comprehensive care and support to children who are without adequate parental care. Likewise, the Family and Community Strengthening Program is one of the core programs that focuses and has been implemented projects in Bahir Dar, Debre tabor, Gondar, Lalibela, Woldia and Debremarkos. Currently, it has been actively operating in Gondar, Debre Tabor, and Lalibela towns.

Rationale and overall objective of terminal evaluation:

Education and care project /Educare Project/ was implemented, aimed to reduce school dropout rate through holistic support of children, caregivers and the community. The project was focused on four components, which include enabling children at risk of school dropout and those who have dropped out to continue education through addressing educational barriers such as scholastic materials, stipend food support, health services support and home-to-home care and support. The second component was empowering families for better care and support of children sustainably through business skills training, financial access, vocational trainings and material supports. Moreover, building the capacity of children’s school was one of the focuses of the project through gap-based training for teachers, material supports and establishing parent-teacher support associations to improve the quality of education. The final focus of the project was strengthening community-based partners to sustainably respond to the situations of children and families through different capacity-building interventions. In general, Educare project implemented in five areas of Amhara region, which includes Bahirdar, Gondar, Debretabor, Woldia and Debremarkos.

Educare has been implemented in four phases, starting from September 15/ 2014 and will end of August 2025. The first phase of educare project was implemented in Bahirdar city from September 15, 2014 to Nov. 14, 2017. The second phase of Educare was implemented in Debretabor city from November 01/ 2017, to October 31/2020 including a no cost extension period. The third phase of Educare was implemented in Debre Markos and Woldia towns from November 01/2018 to October 31/2022 including no cost extension period. The final which is the 4th phase of the project (Educare 4.0) has been implemented in Debretabor and Gondar cities starting from September 01/2020 and will be completed on August 31, 2025. The terminal evaluation will focus on 4th phase, which is in Debre Tabor and Gondar project sites.

All phases of the projects, including the Educare 4.0 project in Debretabor and Gondar aimed at reducing school dropout rates by providing holistic support to children, caregivers, and communities in the Debretabor and Gondar project sites. To achieve this goal, the Bahir Dar program location and the project sites collaborated closely with key implementing partners and stakeholders, including the Bureau of Finance (BoF), the Bureau of Women, Children’s & Social Affairs (BWCSA), and the Bureau of Education (BoE), as well as at all levels of government structure. Likewise, partnerships were formed with Community Care and Support Coalitions (CCSCs), Savings and Credit Cooperatives (SACCOs), and local project schools.

The terminal evaluation will focus on assessing the overall outcomes, impact, achievements, and lessons learned from the project. It will examine whether the project has met its intended objectives and will evaluate its overall effectiveness, sustainability, relevance, and potential for replication or scaling up. The findings and recommendations from the final project evaluation are expected to inform the design of higher-quality projects in the future. Therefore, this Terms of Reference (ToR) has been developed as a request for proposals (technical and financial) from consultancy firms interested in conducting a terminal evaluation of the Educare 4 or education empowerment project. This project specifically targets the education empowerment initiatives in Debre Tabor and Gondar project sites that benefit participants, including their children, caregivers, Community Care & support Coalition (CCSCs), Savings and Credit Cooperatives (SACCOs), and project schools that are part of Bahir Dar program location, Debre Tabor and Gondar project sites.

Objectives of the terminal evaluation:

Overall objective:

The overall objective of terminal evaluation is to assess the results of the SOS Children’s Village Bahir Dar program, specifically in the Debre Tabor and Gondar focusing on Educare 4 Or educational empowerment projects. This evaluation will measure the achievement of the project’s outcomes, outputs, relevance, effectiveness, efficiency, impact and sustainability. It also measures results against established targets, planned outputs, and activities. Additionally, it will draw lessons learned that can enhance the project’s sustainability and provide insights for improving initiatives related to Educare project. The evaluation will also identify good practices and forward recommendations with effective strategies for other similar project implementation in the future.

Specific objectives:

The specific objectives of the terminal evaluation are:

• To assess the relevance, efficiency, effectiveness, impact, and sustainability of SOS Children’s Village Debre Tabor and Gondar Educare 4 project interventions.
• To determine the extent to which the project interventions addressed the gaps /challenges identified during the baseline thus meeting the target participants’ and stakeholder’s expectations.
• Study the organizational, functional, and financial capacity of SOS-supported CCSCs, SACCOs and Schools.
• To draw key lessons learned and good practices including CCSCs, SACCOs and Schools, practices and contribute to organizational learning and recommend improvements for the future project interventions.

Project outcomes and outputs:

Project Goal: is to reduce school dropout rates from 10% to 4% through holistic support of children, caregivers, and communities in Debretabor and Gondar cities of Ethiopia.

Project Outcomes & Outputs:

Outcome #1: Children regularly attend school and continued their education.

Output #1.1: Number of children received material support – school fees, supplies, and uniforms.

Output #1.2: Number of children received basic health services/medical treatment support

Output #1.3: Number of children received monthly food stipends.

Output #1.4: Number of children received shelter support.

Output #1.8: Number of disabled children received appliance support.

Output #1.9: Percentage of children who have dropped out of school.

Output #1.10: Percentage of children retained or repeating the same grade.

Output #1.11: Percentage of children promoted to the next grade.

Outcome #2: Schools’ educational capacity improved.

Output #2.1: Number of teachers trained.

Output #2.3: Percentage of supplies, materials, and equipment in use by teachers and/or students

Outcome #3: Caregivers’ capacity to protect and provide for their children increased.

Output #3.1: Percentage of caregivers who have begun saving for the future.

Output #3.2: Percentage of caregivers engaged in income generating activities.

Output #3.3: Percentage of caregivers with knowledge of effective parenting skills.

Output #3.4: Percentage of caregivers with health education and health service access

Output #3.5: Number of caregivers who have become self-reliant.

Outcome #4: Partnerships established with CCSC key implementing partners.

Output #4.1: Percentage increase in CCSC member supporters.

Output #4.2: Number of partnership and networking MoUs in effect among social support providers in Gondar.

Output #4.3: Number of non-Educare children and youth newly supported by the partner network (CCSC).

Major evaluation /research questions:

The commissioned consultant should list relevant and possible evaluation questions by referring to the project document and the project result framework and show the terminal evaluation questions during the inception report presentation.

Scope and project targets:

Geographically, the terminal evaluation is limited to the project participants women, girls, boys and families, the communities and key implementation partners (CBOs) in Bahir Dar programme location in Amhara regional state, Debre Tabor and Gonder Educare 4 project sites/areas. Debre Tabor is 100 kms away from Bahir Dar, whereas Gondar is 180 km away from Bahir Dar the town.

The Educare 4 project at the SOS Children’s Village in Debre Tabor has been implemented across three sub-cities: Taitu Sub-city one, covering kebeles 01 and 03; Fitawrari Gebreye Sub-city two, covering kebeles 02, 05, and 06; and Atse Tewodros Sub-city three, covering kebele 04. Overall, the project has been executed in three sub-cities and a total of six kebeles in Debre Tabor city.

The Educare 4 project has been implemented in the SOS Children’s Village Gondar project site across four sub-cities: Arada sub-city one, specifically in Kidame Gebeya Kebele; Maraki sub-city two, located in Ayer Tena Kebele; Zobel sub-city three, found in Lideta Kebele and Azezo Tseda sub-city four, situated in Dimaza Kebele

Overall, SOS Bahir Dar program location also has been implementing the Educare 4 project in Debre Tabor and Gondar project sites in collaboration with Community Care and support coalition (CCSCs), Savings and Credit Cooperatives (SACCOs), project schools, and government structures. These structures mainly include the Women, Children’s and Social Affairs Office (WCSA), Finance Office, Education Office, and other relevant organizations. Besides, the terminal evaluation will cover and was implemented in Debretabor city from November 01/ 2017, to October 31/2020 including a no cost extension period. Likewise, the project (Educare 4.0) has been implemented in Debretabor and Gondar cities starting from September 01/2020 and will be completed on August 31, 2025. Due to the COVID-19 pandemic and ongoing conflicts in the region, the Educare 4 Project is now under a no-cost extension in both Debre Tabor and Gondar project sites. So that the no-cost extension has been covered the period from September 1, 2023, to August 31, 2025. In summary, the terminal evaluation will focus from September 01, 2020 to August 31, 2025 and has been implemented from Debre Tabor and Gondar project sites.

Debre Tabor and Gondar Educare 4 Or Education empowerment project has the following direct project participants

	2025 Educare 4 Project Terminal Evaluation Direct Participants
Project Sites		Participants	Year	Male	Female	Total
Debre Tabor Project Site		Children Targets	2017-2025	375	463	838
		Caregivers		120	569	689
		Sub total		495	1032	1527
Gondar Project Site		Children Targets	2020-2025	536	616	1152
		Caregivers		182	780	962
		Sub total		718	1,396	1,114
		Overall total number of direct project participants		1213	2428	3641

 

Terminal evaluation methodology:

The consultant(s) must develop a strong data collection methodology for this terminal evaluation, ensuring the data’s reliability and validity. A mixed-methods approach, combining quantitative and qualitative research methods, is recommended to produce the highest quality and most credible evidence. This study will collect data, disaggregated by sex, age, and disability, for the indicators listed in the result framework (the RF will be annexed for the winner consultant). The chosen methodology must be sensitive to the local context and ensure that all respondents, regardless of their background, have an equal opportunity to participate in the baseline study. The terminal evaluation environment should be designed to provide safe and inclusive spaces that encourage all participants to respond freely, irrespective of gender, age, disability, origin, or religious beliefs. As far as possible, the consultant should disaggregate data by sex, age, and disability while collecting and analysing data. Furthermore, the consultant should also clearly explain which questions will be answered using which methods. The Consultant should also ensure that the survey and qualitative methods (such as focus group discussion (FGD), key informant interview (KII) and group discussion) with participants are representative of the project’s target groups and key stakeholders (Community members, women, girls, boys and children), CCSCs, CBOs.)

Sampling

The consultant is required to propose statistically sound sampling strategies to ensure representativeness. He/she is required to clearly state the sample size and the acceptable margin of error. The consultant will develop a detailed data analysis plan, outlining the statistical methods to be used for the quantitative data and the thematic analysis approach for the qualitative data. All data collection activities should be conducted following the highest ethical standards, ensuring informed consent, confidentiality, and the safety of all participants.

Work plan and expected deliverables

Work plan/timetable

The terminal evaluation task is expected to be finalized within 45 days after the contractual agreement is signed. The consultant is expected to develop her/his detailed work plan based on the following table.

Activities	Dates	Time frame	Location

Deliverables:

The commissioned external consultant must deliver the terminal evaluation findings within 45 days of the contract signed. Based on the work plan, SOS Children’s Villages of project intervention programme locations (Bahir Dar) and the national office MEAL and FS teams expect the following deliverables:

• An inception report of 8 pages on the evaluation design, methodology, sampling frame, sampling technique, sample size, assessment tools and work plan
• Draft evaluation report.
• The consultant is expected to analyse the data and present findings (for both draft and final findings) by intervention areas separately (for Debre Tabor and Gonder projects.)
• Final report – The findings of evaluation report including an executive summary and data collection tools in both electronic and hardcopy formats should be submitted.
• Raw data, which has been cleaned (both qualitative and quantitative, including original field notes for in-depth interviews and focus group discussions, and recorded audio material), should be submitted with the report. SOS CVE will have sole ownership of all final data, and any findings shall only be shared or reproduced with the permission of SOS Children’s Village Ethiopia.

Report criteria:

The reporting criteria for the project terminal evaluation shall be in line with the SOS Children’s Villages Ethiopia result-based management (RBM) toolkit and should be shared with the winner consultant along with the data review process and/or for the preparation of the inception report.

Child safeguarding and ethical issues.

SOS Children’s Villages is committed to ensuring that all research, evaluation and data collection processes (i.e. evidence-generating activities) undertaken by SOS Children’s Villages and its partners are ethical and respect child safeguarding policy and procedure.

The consultant must respect the rights, dignity and protection of children and other vulnerable population groups and should ensure special protection for children and other vulnerable groups during any data-generating activities to minimize any potential risks. Any research, evaluation and data collection SOS Children’s Villages is directly carrying out or is involved in as a partner.

Ethical practices need to be ensured in the following circumstances:

• Any research, baseline, midterm or final evaluations and data collection SOS Children’s Villages has commissioned for ethical oversight of these processes.
• Any research, evaluation and data collection carried out by researchers/consultants on SOS Children’s Villages programmes and participants.
• Hence, relevant Coordinator in SOS Children’s Village FCSP programme Educare 4. Project will ensure that any researchers, evaluators and data collectors should receive awareness training on, sign and adhere to SOS Children’s Villages core policies:
• Obtaining consent from research participants is central to the research relationship and signals respect for the research participant’s dignity, their capability to express their views and their right to have these heard in matters that affect them. Informed consent is an explicit agreement which requires participants to be informed about and understand the research/assessment. This must be given voluntarily and be renegotiable, so that participants may withdraw at any stage of the research process.

Logistical arrangements:

The awarded consultant shall show feasible logistical arrangements for the assignment as part of the technical proposal. National or location-level staff (SOS CVE) will be available to help organize the interviews including contacting SOS CVE, announcing and local preparation of evaluation, and linking to community duty bearers and national authorities if required.

Duration of the contract and terms of payment

Payment will be made only upon SOS Children’s Villages’ acceptance of the work performed in accordance with the above-described deliverables. Payment will be effected by bank transfer in the currency of birr.

Funding and Payment: The consultancy firm will be paid by SOS Children’s Villages as follows:

• 30% on the submission and approval of the inception report/Technical Proposal.
• 30% on completion of the draft report.
• 40% on completion of the final report.

Duration of contract: the contract is effective from the moment it was signed until the acceptance of work by the SOS Children’s Villages in Ethiopia management team.

Notice of delay

Shall the successful bidder encounter a delay in the performance of the contract which may be excusable under unavoidable circumstances; the contractor shall notify SOS Children’s Villages in writing about the causes of any such delays within one (1) week from the beginning of the delay.

After receipt of the Contractor’s notice of delay, SOS Children’s Villages in Ethiopia shall analyze the facts and extent of the delay and extend the time for performance when in its judgment the facts justify such an extension.

Copyright and other proprietary rights:

SOS Children’s Villages shall be entitled to all intellectual property and other proprietary rights including, but not limited to, copyrights, and trademarks, with regard to products, processes, inventions, ideas, know-how, or documents and other materials which the Contractor has developed for SOS Children’s Villages under the Contract and which bear a direct relation to or are produced or prepared or collected in consequence of, or during the course of, the performance of the Contract. The Contractor acknowledges and agrees that such products, documents, and other materials constitute works made for hire for SOS Children’s Villages.

All materials: interviews, reports, recommendations, and all other data compiled by or received by the Contractor under the Contract shall be the property of SOS Children’s Villages and shall be treated as confidential and shall be delivered only to SOS Children’s Villages authorized officials on completion of work under the Contract. The external consultant is obliged to hand over all raw data collected during the assessment to SOS Children’s Villages in Ethiopia.

Termination:

The termination of the service agreement for the assignment will be in accordance with the contractual agreement to be included at the formal agreement’s actual signing.

Qualification of the Researcher/Research Team

• The applicant consultancy firm shall have at least a master’s degree in a relevant field of study such Psychology, Sociology, Social Work, development studies, Economics, Project Management, Monitoring & Evaluation and other related fields per the required assignment
• At least 5 years’ work experience & proven competency in assessments, monitoring, research, terminal evaluations, baseline assessments or organizational/program evaluation (baseline, midterm, and final evaluations). The applicant consultancy firm shall attach at least one sample final evaluation report produced on a similar topic.
• A good understanding of family strengthening, community empowerment, livelihoods and development programme work.
• A good understanding of child/youth rights/safeguarding & other issues affecting vulnerable children in the Ethiopian context.
• proven experience in working with conceptual frameworks and data collection methods (including age-appropriate data collection methods)
• Proven experience in participatory processes and data collection methods
• Strong skills in coordination, good facilitation, organizational, and interpersonal skills
• Proven experience in participatory processes
• Strong skills in coordinating teamwork
• analytical and conceptual skills on market and livelihood assessment
• Excellent written and spoken communication skills in English.
• Ability to transfer complex concepts and ideas into practical and simple language.
• Experience in organizing research processes with SOS Children’s Villages or similar child focused organizations.
• Experience in managing baselines, final evaluations and livelihood assignments in respect of the participating communities’ culture, social norms, values, and behaviour; and maintain appropriate relationships with participants of this evaluation.
• Legally registered firms with renewed license, VAT registration and TIN number

Required Skills

• Quantitative and Qualitative research skills