ToR: Conducting mid-term Evaluation of the Waliso Educare project

SOS Children’s Villages (SOS-CV) is a global non-profit organization established in 1949. SOS Children’s Village International consists of 138 member associations all over the world, working in more than two thousand programme locations worldwide. The focus of the organization is to provide support to vulnerable children who have lost or are at risk of losing parental care and their families. In Alternative Care programs (AC), SOS CV provides a family-like environment to a child or young person and offers quality care and support for their development. Through Family Strengthening Programmes (FSP), SOS CV helps parents and communities build capacities to care for their children and prevent family breakdown.

SOS Children’s Villages Ethiopia (SOS CVE) launched its programming in 1974, and it has been operating in eight program locations in different parts of the country, including Mekelle, Addis Ababa, Bahir Dar, Harar, Hawassa, Gode, Jimma and Arba Minch.

Based on the principles of appropriateness and suitability, we provide a range of quality alternative care services, for instance family-like care, for children who have lost parental care, and we work with vulnerable families and communities to help them strengthen and prevent child abandonment, under our family and community development programs. Under our youth empowerment initiatives, we work with young people to assist them in becoming a productive and independent member of the society. Furthermore, we also provide humanitarian assistance interventions in cases of natural and human made disasters, when the livelihoods of families and communities are disrupted. We collaborate and partner with like-minded organizations, community structures, government entities, and relevant all in advocating for the fulfilment of the rights and needs of vulnerable children, young people and families.

Description of programme location

SOS Children’s Village Jimma, as an umbrella of SOS Children’s Villages International, is one of eight programs under SOS Children’s Villages in Ethiopia and has been operating various interventions primarily focusing on children, young people, families, and communities in the towns of Jimma, Agaro, Bedelle, Nekemte and Woliso towns in Oromia regional state. SOS Children’s Village Jimma currently operates alternative childcare programs (SOS Family-like Care, Kinship Care and Foster Family Care), Family and community development programs (Grow Equal and EduCare projects), humanitarian emergencies, advocacy, and the SOS Hermann Gmeiner Schools and kindergarten. The programme location has been providing alternative childcare for the children’s who already lost their parental care and under, family strengthening program also supports children who already lost their parental care.

Rationale for conducting midterm evaluation:

SOS Children’s Villages in Ethiopia has planned to conduct a midterm evaluation for its Woliso Educare project. The evaluation is intended to evaluate the process and performance at the midpoint of its implementation period. It helps determine whether the project is on track to achieve its intended results and provides recommendations for improvement during the remaining implementation period.

The project already has baseline values and indicator targets incorporated in the results framework, along with established means of verification to assurance that data is reliable, accessible, and measurable. Conducting a midterm evaluation is therefore essential to assess the progress made toward achieving planned results and to verify whether implementation is on track. The mid-term evaluation also helps determine the quality, consistency, and reliability of data sources and verification mechanisms used during monitoring and reporting processes. Additionally, the midterm evaluation provides evidence-based findings that support informed decision-making, identify implementation gaps and challenges, and generate recommendations for improving project performance during the remaining implementation period.

Objectives of the Midterm Evaluation:

General objective

The overall objective of a midterm evaluation is to assess the progress, performance, relevance, efficiency, and effectiveness of a project at the midpoint of its implementation period. It helps determine whether the project is on track to achieve its intended results and provides recommendations for improvement during the remaining implementation period of Waliso Educare project.

Specific Objective

The specific objectives of the midterm evaluation are:

• To measure the extent to which planned outcomes and output level targets have been achieved so far.
• To determine the effectiveness and efficiency of the project in terms of resources utilization, activities accomplishment, and strategies are being utilized to achieve expected results.
• To identify implementation gaps, risks, constraints, good practices, and lessons learned during project execution.
• To generate practical recommendations for strengthening implementation, improving performance, and enhancing the likelihood of achieving project goals by the end of the project period.
• To provide evidence-based information to guide strategic decisions and future planning.

Project goal, outcomes and outputs:

The project has the following goal, outcomes and outputs.

3.3.1 Goal:: To contribute to the realization of inclusive, quality education and well-being for vulnerable children in Woliso town, Southwest Shoa zone, Oromia regional state in Ethiopia.

3.3.2. Project Outcome & Output

Outcome 1: The right to participate in inclusive and quality education for girls, boys, and children with disabilities in the most vulnerable situations is enhanced.

• Output 1.1. Targeted boys and girls in all their diversity received educational support and life skills (including study skills) training.
• Output 1.2: Targeted girls & boys in all their diversity have access to health care services.
• Output 1.3. Targeted girls & boys have access to safe and stable accommodation.

Outcome 2: Targeted women in all their diversities have socio economic and parenting capacities to care for and to protect their children.

• Output 2.1. Caregivers, in all their diversity are engaged in environmentally friendly income generating activities
• Output 2.2. Women, men, in all their diversity have the knowledge and skill on parenting, child right, GBV, SRH, disability and accesses to Community based health Insurance (CBHI)

Outcome 3: Targeted public primary schools have improved capacity to enhance learning outcomes and prevent GBV and Violence Against Children (VAC) among most vulnerable children (including people with disability).

• Output 3.1: Teachers, School administrators and education experts are aware of inclusive and child-friendly and gender equality education.
• Output 3.2: Partner schools have improved, inclusive and accessible school infrastructures

Outcome 4: Inclusive and responsive community-based system in place to protect children and women invulnerable position from all forms of harmful practices such as child labour, FGM and early marriage.

• Output 4.1. Partner CSO/KIP have strengthened capacity to respond to child rights, gender equality, and VAC.
• Output 4.2. Local government have capacity to respond to children and women in vulnerable positions.

Major Midterm Evaluation questions

Child Protection

• What is the situation of child protection in Woliso Town?
• What major risks and protection issues are children facing in the target communities?
• What community-based child protection mechanisms currently exist, and how effective are they?

Education Access and Quality

• What is the current level of access to inclusive and protective education services for children in the target areas?
• What are the school enrollment, attendance, and dropout rates among children in the target communities?
• What barriers prevent children from accessing or completing education?
• What is the availability of educational resources (learning materials, infrastructure, support services) in the schools?

Teacher Capacity and School Environment

• What is the capacity of teachers to deliver inclusive, protective, and quality education?
• What training or professional support do teachers currently receive?
• How supportive and safe are the school environments for children, including vulnerable groups?

Livelihoods of Target Groups

• What are the current livelihood opportunities and income sources for households in the target areas?
• What economic challenges affect families’ ability to support children’s education and well-being?
• What skills, resources, or opportunities are lacking for improving livelihoods?

Governance and Institutional Capacity

• What is the current structural and governance capacity of community organizations, associations, and forums?
• How effective are family-based and community-based structures in supporting children and vulnerable groups?
• What coordination mechanisms exist among stakeholders (community organizations, local government, and service providers)?

Stakeholder Coordination and Service Delivery

• How do different stakeholders (community organizations, schools, NGOs, and local authorities) collaborate in delivering child protection, education, and livelihood services?
• What gaps exist in coordination and service delivery among stakeholders?

Baseline for Monitoring and Evaluation

• What are the midterm evaluation values for the outcome and output indicators?

The commissioned consultant should further list relevant, tailored and possible mid-term evaluation questions for both quantitative and qualitative methodologies. He/she is expected to refer to the project document in detail, log frame and in addition to developing evaluation questions, and data collection tools. SOS CVE Ethiopia will share the project document, log frame/result framework for winner consultancy firm.

Scope of the Midterm Evaluation

Geographically, the midterm evaluation is limited to the project participant children, youth, families, the communities and key implementation partners (CBOs & Schools) in Waliso town in Oromia reginal state under SOS children’s Village Jimma programme location. The mid-term evaluation will take place in Waliso town. The Project has the following direct and indirect participants/beneficiaries.

Direct participant
Caregiver			Children & Adolescent (0-14 years)			Young people (15-29 years)			Total
Female	Male	Total	Female	Male	Total	Female	Male	Total	Female	Male	Total
392	8	400	590	541	1131	184	176	360	1167	725	1892

 

Mid-term evaluation Methodology

The consultant is expected to develop appropriate and standard quantitative and qualitative methodologies that can generate the highest quality and most credible evidence. The commissioned consultant should use a mixed method approaches (quantitative and qualitative methods) to answer the evaluation questions. As far as possible, the consultant should disaggregate data by sex, age, disability disaggregated data (SADD) while collecting and analysing data. The consultant should also clearly explain which questions will be answered using which methods. Data collection methods proposed by the consultant should be linked to the specific target group question(s). In addition to the data collection methodology, the consultant should refer relevant desk review of the project agreement documents. Moreover, the consultant is expected to explain the design and process of data collection tools, data collection plans and data analysis instrument. The consultant is also expected to use tools like SWOT (strengths, weaknesses, opportunities & threats) analysis while facilitating meetings with partners and stakeholders.

The Consultant should also ensure that the survey and qualitative methods (such as focus group discussion (FGD), key informant interview (KII) and group discussion) with participants are representative of the project’s target groups and key stakeholders (Community members, Children, youth, care givers (men & women), CBOs. schools and SaCCo)

Sampling

The Commissioned consultant is expected to use appropriate sampling techniques and set a representative sample size for both qualitative and quantitative data collection methods. Based on the project objectives and results framework. The consultant should produce appropriate sampling methods and ensure representativeness of the sampled households or respondents, and the sampling frame is from target children, youth, care givers, schools, CBOs and community structures.

Work plan and expected deliverables

Work plan/timetable

The mid-term evaluation task is expected to be finalized within 40 days after the contractual agreement is signed.

The consultant is expected to develop her/his detailed work plan based on the following table.

Activities	Dates	Time frame	Location

 

Responsibility of the consultant:

The awarded consultant shall show feasible logistical arrangements for the assignment as part of the technical proposal

• Refer the project document, result framework and indicators and develop baseline study questions and detailed tools for both quantitative and qualitative data collection methods.
• Recruit and train data collectors/ enumerators
• Covers transport and per diem costs for data collectors
• Develop inception report with data collection tools, data collection plans and present for SOS CVE team and data collection plans
• Compiled draft and final baseline report based on scheduled time

Note that SOS CVE programme location-level staff (SOSCVE) will be available to help organize the interviews including contacting SOSCV, announcing and local preparation of evaluation, and linking to community duty bearers and national authorities. SOSCVE team will facilitate while the consultant collects data from prgramme participants, partners and key government stakeholders.

Deliverables:

The commissioned external consultant must deliver the midterm evaluation findings within 40 days of the contract signing. Based on the work plan, SOS Children’s Villages of Jimma programme location, Programme MEAL and the national office MEAL and FS teams expect the following deliverables:

• An inception report of 8 pages on the midterm evaluation design, methodology, sampling frame, sampling technique, sample size, assessment tools and work plan
• Draft midterm evaluation report of maximum 20 pages.
• The consultant is expected to present findings (for both draft and final findings) by intervention areas under Jimma programme location, Woliso Educare project.
• Final midterm evaluation report – The findings of midterm evaluation report including an executive summary and data collection tools in both electronic and hardcopy formats should be submitted.
• Raw data, which has been cleaned (both qualitative and quantitative, including original field notes for in-depth interviews and focus group discussions, and recorded audio material), should be submitted with the report. SOS CVE will have sole ownership of all final data, and any findings shall only be shared or reproduced with the permission of SOS Children’s Village Ethiopia.

Report criteria

The reporting criteria for Woliso Eudcare project midterm evaluation shall be in line with the SOS Children’s Villages Ethiopia result based project management (RBPM) toolkit and should be shared with the winner consultant along with the data review process and/or for the preparation of the inception report.

Child Safeguarding and ethical issues.

SOS Children’s Villages is committed to ensuring that all research, evaluation and data collection processes (i.e. evidence-generating activities) undertaken by SOS Children’s Villages and its partners are ethical and respect child safeguarding policy and procedure.

The consultant must respect the rights, dignity and protection of children and other vulnerable population groups and should ensure special protection for children and other vulnerable groups during any data-generating activities to minimize any potential risks. Any research, evaluation and data collection SOS Children’s Villages is directly carrying out or is involved in as a partner.

Ethical practices need to be ensured in the following circumstances:

• Any research, baseline, midterm or final evaluations and data collection SOS Children’s Villages has commissioned for ethical oversight of these processes.
• Any research, evaluation and data collection carried out by researchers/consultants on SOS Children’s Villages programmes and participants.

Hence, relevant manager in Jimma and Awassa will ensure that any researchers, evaluators and data collectors should receive awareness training on, sign and adhere to SOS Children’s Villages core policies:

Obtaining consent from research participants is central to the research relationship and signals respect for the research participant’s dignity, their capability to express their views and their right to have these heard in matters that affect them. Informed consent is an explicit agreement which requires participants to be informed about and understand the research/assessment. This must be given voluntarily and be renegotiable, so that participants may withdraw at any stage of the research process.

Logistical arrangements:

The awarded consultant should show feasible logistical arrangements for the assignment as part of the technical proposal. National or location-level staff (SOSCV) will be available to help organize the interviews including contacting SOSCV, announcing and local preparation of evaluation, and linking to community duty bearers and national authorities if required.

Duration of the contract and terms of payment

Payment will be made only upon SOS Children’s Villages’ acceptance of the work performed in accordance with the above-described deliverables. Financial proposals should include proposed stage payments. Payment will be affected by bank transfer in the currency of birr.

Funding and Payment: The consultant will be paid by SOS Children’s Villages as follows:

30% on the submission and approval of the inception report.

30% on completion of the draft report.

40% on completion of the final report.

Duration of contract: the contract is effective from the moment it was signed until the acceptance of work by the SOS Children’s Villages in Ethiopia management team.

Notice of delay

Shall the successful bidder encounter a delay in the performance of the contract which may be excusable under unavoidable circumstances; the contractor shall notify SOS Children’s Villages in writing about the causes of any such delays within one (1) week from the beginning of the delay.

After receipt of the Contractor’s notice of delay, SOS Children’s Villages in Ethiopia shall analyse the facts and extent of the delay and extend the time for performance when in its judgment the facts justify such an extension.

Copyright and other proprietary rights

SOS Children’s Villages shall be entitled to all intellectual property and other proprietary rights including, but not limited to, copyrights, and trademarks, with regard to products, processes, inventions, ideas, know-how, or documents and other materials which the Contractor has developed for SOS Children’s Villages under the Contract and which bear a direct relation to or are produced or prepared or collected in consequence of, or during the course of, the performance of the Contract. The Contractor acknowledges and agrees that such products, documents, and other materials constitute works made for hire for SOS Children’s Villages.

All materials: interviews, reports, recommendations, and all other data compiled by or received by the Contractor under the Contract shall be the property of SOS Children’s Villages and shall be treated as confidential and shall be delivered only to SOS Children’s Villages authorized officials on completion of work under the Contract. The external consultant is obliged to hand over all raw data collected during the assessment to SOS Children’s Villages in Ethiopia.

Termination

The termination of the service agreement for the assignment will be in accordance with the contractual agreement to be included at the formal agreement’s actual signing.

Qualification of the researcher / research team

• The applicant consultant shall have PHD degree (at least the team leader) in relevant fields of study such Psychology, Sociology, Social Work, development studies, Economics, Project Management, Monitoring & Evaluation and other related fields per the required assignment
• At least 5 years’ work experience in international NGOs & proven competency in assessments, monitoring, and evaluation, including baseline assessments or organizational/program evaluation (baseline, midterm, and final evaluations). The incumbent shall attach at least one sample baseline or final evaluation report produced by the candidate on a similar topic.
• A good understanding of family strengthening, community empowerment, livelihoods and development programme work.
• A good understanding of child/youth rights/safeguarding & other issues affecting vulnerable children in the Ethiopian context.
• Proven experience in working with conceptual frameworks and data collection methods (including age-appropriate data collection methods)
• Proven experience in participatory processes and data collection methods
• Strong skills in coordination, good facilitation, organizational, and interpersonal skills
• Proven experience in participatory processes
• Strong skills in coordinating teamwork
• Analytical and conceptual skills on midterm and final evaluations.
• Excellent written and spoken communication skills in English.
• Ability to transfer complex concepts and ideas into practical and simple language.
• Experience in organizing research processes with SOS Children’s Villages or similar child focused organizations.
• Experience in managing baselines, midterm and final evaluations in respect of the participating communities’ culture, social norms, values, and behaviour; and maintain appropriate relationships with participants of this evaluation.
• Legally registered firms with renewed license, VAT registration and TIN number