Final Evaluation Data Collection Consultant (ERRY III Joint Program)

  • Contract
  • Yemen

CTG (Committed To Good)

CTG overview

CTG staff and support humanitarian projects in fragile and conflict-affected countries around the world, providing a rapid and cost-effective service for development and humanitarian missions.

CTG recruits, deploys and manages the right people with the right skills to implement humanitarian and development projects. Key to successful project delivery is the ability to mobilize at speed; CTG can source and deploy anyone, anywhere, in very high pace.

Visit www.ctg.org to find out more.

Overview of position

Country context:

  • Millions of Yemenis continue to endure the devastating consequences of the conflict, facing increasingly dire living conditions as they struggle to feed their families, access healthcare & send their children to school. The country’s economy continues to decline, exacerbated by climate related shocks that displace communities & disrupt livelihoods. Food insecurity remains at critically high levels, while millions confront severe protection risks. This harsh reality disproportionately affects Yemen’s most vulnerable & marginalized groups, including women and girls, persons with disabilities, the Muhamasheen community, refugees, migrants & Internally Displaced Persons (IDPs).
  • In 2025, an estimated 19.5 million people across Yemen require humanitarian assistance & protection services an increase of 1.3 million from the previous year.
  • Over the past decade, humanitarian efforts have proven essential in saving lives & preserving human dignity. However, humanitarians alone cannot alleviate the suffering of civilians. A far greater collective effort is needed to reduce needs, achieve lasting peace, revive the economy & strengthen community resilience through sustainable development initiatives.

Program description:

The Supporting Resilient Livelihoods, Food Security & Climate Adaptation in Yemen (also called ERRY III) Joint Program (JP) is a joint initiative co financed by the European Union (EU) & Sweden & jointly implemented by the Food & Agriculture Organization of the United Nations (UN FAO), the International Labour Organization (ILO), our client & the World Food Program (WFP) in seven vulnerable governorates. The participating UN agencies implement the program activities through local & international implementing partners. The duration of the third phase of the program was three years, from March 2022 to February 2025; however, the program was extended by 4 months until June 2025. The program aims to enhance the self reliance of vulnerable people & communities to better cope with crises, risks & shocks by supporting the creation of economic & employment opportunities, enhancing productive capacities to support food security & sustainable livelihood creation, restoring community assets, supporting agricultural value chains, promoting gender equality & women’s economic empowerment & expanding access to renewable energy. Additionally, the JP enhances local capacities by improving the capacity of local institutions & supporting prioritized projects for improved gender sensitive service delivery & access to basic services. The overall objective of the JP (goal) is to strengthen resilience & self reliance of the population in the most vulnerable governorates in Yemen. The specific objective / outcome of the JP is improved management of local risks & shocks in crisis affected communities of the most vulnerable governorates in Yemen. The program aims to achieve four intermediate outcomes:

  • Outcome 1: Increased local institutional resilience management & community social cohesion in crisis affected communities.
  • Outcome 2: Broadened access of vulnerable population to sources of energy & job opportunities in the renewable energy sector.
  • Outcome 3: Increased sustainable production & productivity of crop & livestock in crisis affected communities.
  • Outcome 4: Improved access of women, youth & other vulnerable groups to food & income opportunities.

The ERRY III JP targets the most vulnerable groups, including youth, women, the unemployed, IDP’s, stressed host communities & people with disabilities. The program uses inclusive, participatory & conflict sensitive tools to mobilize & involve these groups in its activities. The program targets 17 of the most vulnerable districts within the seven governorates mentioned above. More detailed description & relevant documents of the program, including the prodoc, logical framework, etc.) will be provided to the selected evaluation team. The key stakeholders identified for the ERRY III JP include government counterparts from the Ministry of Planning & International Cooperation (MoPIC) in the IRG controlled areas as well as other relevant line ministries such as the Ministry of Agriculture & Irrigation (MoAI), the Ministry of Technical Education & Vocational Training (TEVT), chambers of commerce & the Agriculture Research and Extension Authorities (AREA). In northern regions, the program coordinates with the Ministry of Foreign Affairs (MoFA) &, previously, with the Supreme Council for the Management & Coordination of Humanitarian Affairs & International Cooperation (SCMCHA), alongside with other pertinent line ministries. Additional crucial stakeholders comprise local authorities in the targeted areas, community based committees including Sub District Committees (SDCs) & Village Cooperative Councils (VCCs) as well as the program’s implementing partners & the targeted communities & beneficiaries. During its first year of planning & implementation, the program conducted a number of studies & assessments related to its activities, including a baseline assessment, market assessments, conflict scans & value chain assessments. Additionally, two Results Oriented Monitoring (ROM) reviews of the program were conducted by the EU in July 2023 & September 2024 through external independent consultants to monitor the progress made, verify the reported achievements & assess beneficiaries’ satisfaction, as well as to formulate recommendations that could be applied before the final completion of the program. Moreover, a midterm review of the program was conducted by an independent evaluation firm with the objective of assessing the program’s progress, identifying its operational challenges & providing recommendations that would support the program management to improve the implementation during the remaining lifetime of the program.

Role objectives

The final independent evaluation aims to assess the achievements & results of the ERRY III JP through a comprehensive analysis of its implementation based on the OECD DAC evaluation criteria: relevance, coherence, efficiency, effectiveness & sustainability. This evaluation will generate evidence based insights into the program’s results, while also identifying good practices & lessons learned, both from its intended & unintended impacts, particularly in relation to resilience building. The findings & results of the evaluation will serve as a crucial tool for learning & accountability, providing key stakeholders, including partnering UN agencies, implementing partners, donors & national authorities, with objective & comprehensive information on the program’s outcomes, including its impact on women’s empowerment. Moreover, the evaluation findings will be extremely useful in guiding any necessary adjustments or redirections for future resilience initiatives. More specifically, the final evaluation is expected to assess the following:

  • Assess the relevance & strategic positioning of the ERRY JP within the current political & economic context in Yemen.
  • Evaluate the program’s contribution to fostering meaningful development changes that empower Yemeni households & communities to effectively cope with the ongoing crisis & (re)build their resilience.
  • Assess the program’s performance & progress towards achieving its intended results, while also identifying any unintended outcomes.
  • Analyse the extent to which the program’s initiatives have effectively addressed issues of social & gender mainstreaming, empowerment & climate adaptation.
  • Extract lessons learned & best practices from the interventions & formulate actionable recommendations for the design & implementation of future programs.
  • Provide objective evidence & justifications for supporting the scale up of similar programs, highlighting which components of the interventions are particularly valued by beneficiaries & other stakeholders.
  • Review the program’s management arrangements, approaches, strategies & coordination mechanisms & provide recommendations for enhancing their effectiveness.

Final evaluation scope:

  • The evaluation will focus on the ERRY III interventions implemented by our client, WFP, FAO, ILO & their implementing partners in the targeted governorates in Yemen for the period from March 2022 to February 2025.
  • The evaluation will engage all relevant stakeholders, authorities, local institutions, benefitting communities & households, donors, participating UN agencies & implementing partners. The evaluation will assess the relevance, coherence effectiveness, efficiency & sustainability of the program, explore the key factors that have contributed to the achievement or non achievement of the planned results & determine the extent to which the program contributed to improving the resilience of the targeted beneficiaries & communities. The evaluation should also address crosscutting issues of climate adaptation, synergy & women’s empowerment, assessing how gender mainstreaming & women’s empowerment had been considered in the identification / formulation documents & the extent to which they have been reflected in the implementation of the program & its monitoring.

The national consultant will collect the required data from selected target districts in the south as outlined below:

No. 1

Governate: Taizz

District: Almaafer

No. 2

Governate: Abyan

District: Ahwar & Lawdar

No. 3

Governate: Lahj

District: Tuban & Almaqatirah

Evaluation criteria & key guiding questions:

The final evaluation criteria & key questions will primarily be structured around the five evaluation criteria of OECD – DAC (Organisation for Economic Cooperation & Development – Development Assistance Committee:

  • Relevance.
  • Effectiveness.
  • Efficiency.
  • Sustainability.
  • Coherence / synergy.

Additionally, the evaluation will examine other key aspects such as gender mainstreaming, Leave No One Behind (LNOB), climate adaptation & the emerging potential impact of the intervention. The assessment of the overall impact will be addressed in a separate assignment at a later stage. The final evaluation of the ERRY III JP will be guided by the following evaluation questions:

Relevance:

  • To what extent are the ERRY III JP interventions still relevant to the current context in Yemen?
  • To what extent do the project objectives and design correspond to the needs & rights of the targeted households & communities, as well as the policies & priorities of partners at various levels?
  • To what extent did the program’s targeting strategy include the most vulnerable groups (women, youth, IDPs, persons with disabilities & other marginalized groups) as well as individuals in need?
  • To what extent was the intervention approach & the various areas of intervention relevant to national & UN priorities, SDGs, the resilience building, improving livelihoods & food security needs of the beneficiaries & the targeted local communities?
  • To what extent were the lessons learned from previous phases incorporated into the program’s design?

Effectiveness:

  • To what extent has the ERRY III JP contributed to achieving the community resilience, food security & livelihoods needs of the targeted communities, households & individuals?
  • To what extent has the ERRY III achieved its planned objectives, outputs & outcomes? What was their quality?
  • What were the main factors that have contributed to the achievement or non achievement of the program’s outputs & intermediate outcomes?
  • How effective was the community based approach in achieving the program’s results & outcomes?
  • To what extend were the results inclusive for vulnerable groups, including a gender perspective?
  • How effective were the internal & external coordination & communication mechanisms in sharing information & creating synergies among the program’s direct stakeholders?
  • In which areas has the project achieved the greatest success & in which areas has it had the fewest achievements?
  • What changes to the implementation approaches, methodologies & strategies are recommended to enhance its overall effectiveness?
  • What are the gender related challenges beyond the control of the program that hindered progress in its implementation?
  • To what extent the targeted groups & individuals enabled to create sustainable livelihoods & graduate from food assistance & / or other forms of humanitarian assistance?

Efficiency:

  • To what extent are resources being efficiently allocated to achieve the expected results in general?
  • To what extent have the program implementation processes, project management structures & execution been cost efficient, including aspects such as IP selection, contracting, procurement processes, obtaining necessary permits, staffing & other related activities?
  • To what extent have the implementation strategy, types of interventions, methodologies, approaches & technologies been efficient & cost effective?
  • What alternative options & more cost efficient methods could have been considered or utilized?
  • To what extent have project funds & activities been delivered in a timely manner?
  • To what extent has the M&E system used by the program ensured effective & efficient project management & inform adaptations to the action?
  • How efficiently were gender mainstreaming practices integrated into the overall implementation processes of the program?
  • How effectively did partnerships with local women’s organizations contribute to the efficient delivery of program objectives related to gender?

Sustainability:

  • How far the program has developed & implemented an appropriate exit / sustainability strategy?
  • Based on the available indicative evidence, to what extent the program’s outputs, outcomes & emerging impacts (if any) are likely to be sustainable beyond the program’s lifetime?
  • To what extent & how has the capacity of beneficiaries & stakeholders increased under ERRY III? Does it enable them to sustain the results achieved under the program?
  • What were the major factors that influenced the achievement or non achievement of the program’s sustainability?
  • To what extent will the targeted men, women & vulnerable groups benefit from the project interventions in the long term?

Coherence / synergy:

  • To what extent has the JP achieved its intended synergies in terms of collaboration & coordination among interventions of participating organizations?
  • How effectively did the JP leverage the comparative advantages & expertise of the four UN agencies to enhance the overall outcomes of the program?
  • What challenges or obstacles were encountered in achieving synergy within the JP & how were they addressed?

Climate adaptation:

  • To what extent have the program’s interventions incorporated climate adaptation strategies& how have these strategies contributed to the needs of the targeted communities for climate adaptation?
  • What challenges & barriers have been encountered in implementing climate adaptation interventions & how can these be addressed in future initiatives?
  • What are the lessons learned from the implementation of the climate adaptation interventions & how can they inform future projects in similar contexts?

Women economic empowerment:

  • To what extent have women’s economic empowerment been addressed in the design, implementation & monitoring of the intervention?
  • Has the project clearly defined the problems to be addressed & considered in regard to gender dimension (participation, self confidence, control over assets, gender norms, mobility)?
  • To what extent did the program adopted its interventions to help women to overcome social barriers?
  • How effectively has the program addressed the specific needs of women & marginalized groups?
  • What measures have been taken to ensure women’s participation in the program’s activities & decision making processes?
  • To what extent have the program’s interventions successfully improved women’s access to economic opportunities, resources & decision making?

Human rights:

  • To what extent have poor, indigenous & physically challenged, women, men & other disadvantaged & marginalized groups benefited from the work of the program in the country?

Disability:

  • Were persons with disabilities consulted & meaningfully involved in program planning & implementation?
  • What proportion of the beneficiaries of a program were persons with disabilities?
  • What barriers did persons with disabilities face?

The national consultant will use the questions included in the tools developed by the international consultant for field data collection.

Methodology:

  • The evaluation will be carried out in accordance with our client & other PUNOs evaluation guidelines & policies, United Nations (UN) group evaluation norms & ethical standards, OECD – DAC evaluation principles, guidelines & DAC evaluation quality standards.
  • The evaluation will employ a combination of both qualitative & quantitative evaluation methods including surveys & questionnaires, Key Informant Interviews (KIIs) & Focus Group Discussions (FGDs). In close collaboration & guidance by the international consultant, the national consultant will gather quantitative data from sampled male & female beneficiaries in the targeted districts. The national consultant will also conduct semi structured interviews with key stakeholders, including government counterparts, local authorities & community committees, etc. to gather in depth insights & diverse perspectives on various aspects of the assignment as agreed with the international consultant. The list of sampled beneficiaries & key informants to be interviewed will be, along with details on how the interviews will be conducted, will be shared by the international consultant.
  • The national consultant will submit the cleaned data to the international consultant according to the agreed upon format & timeline.

The evaluation will be expected to deliver the following deliverables as per the below schedule:

Deliverable 1:

  • Upon submission & acceptance of the preparatory work plan

Description:

  • Conduct key preparatory tasks for the field data collection phase including:
  • Coordinating with relevant authorities to secure necessary approvals
  • Collaborating with the international consultant to review & refine data collection tools, if needed
  • Translating & finalizing the data collection tools
  • Developing the forms in Kobo
  • Prepare a detailed work plan for data collection, in consultation with the international consultant
  • Submit a brief report summarizing the preparatory activities undertaken & the detailed data collection work plan

Duration:

  • 7 working days

% of payment:

  • 20%

Deliverable 2:

  • Submission of the collected data
  • Collecting all required data from the field using the developed tools & methods, this will involve conducting data entry, cleaning, consolidation & quality assurance to ensure the accuracy & reliability of the data
  • Submitting the collected data to the international consultant according to the agreed upon format & timeline

Duration:

  • 25 working days

% of payment:

  • 80%

Project reporting

  • The national consultant will work closely with & report directly to the international consultant. The Joint Coordination Unit (JCU) of the ERRY JP will provide necessary support & facilitation to the national consultant & oversee progress throughout the assignment.
  • The national consultant will be provided with all relevant information necessary for the execution of the tasks under this assignment.
  • The national consultant will be responsible for her / his own working station (i.e. laptop, internet, phone, scanner / printer, etc.) & must have access to a reliable internet connection.
  • The national consultant is expected to be reasonably flexible with his / her availability during the assignment.
  • The international consultant is responsible for reviewing the national consultant’s deliverables & providing feedback & comments.
  • The national consultant is expected to travel to the target districts as outlined in section 3 of this ToR.

Key competencies

  • A university degree in social sciences or a related discipline.
  • A minimum of 3 years of proven experience in both qualitative & quantitative data collection methods.
  • Demonstrated ability to access & collect data from program target areas, with a strong understanding of Yemen’s realities & the capacity to manage security constraints & mitigate associated risks.
  • Strong communication, facilitation & presentation skills.

Team management

The selected national consultant will support the international consultant in data collection across the targeted districts within the timeframe specified in the Terms of Reference (ToR). The national consultant must be readily available to provide timely support & ensure efficient data collection.

Further information

Schedule of payments:

  • The contract payment will be a lump sum & payment will be contingent upon the approval of the Program Manager following the satisfactory submission of the agreed upon deliverables.
  • Payments will be made in two instalments, based on the percentage of the contract value associated with each deliverable, as outlined in the table above.

Evaluation team & implementation arrangements:

  • The final independent evaluation will be conducted by an international consultant, supported by a national consultant responsible for field data collection.
  • The international consultant will lead all phases of the evaluation, ensuring the quality of data collection, methodology & the timely delivery of all evaluation outputs.
  • The national consultant will assist the international consultant by facilitating, coordinating & conducting data collection activities, including surveys, KII’s & FGd’s with the sampled respondents.
  • The national consultant will make a substantive contribution to the final evaluation by collecting data from the field and providing valuable insights on the local context.

Other generic information:

  • Qualified female candidates are encouraged to apply for this role.

How to apply

https://app.tayohr.io/jobs/detail/vac-26367-final-evaluation-data-collection-consultant-erry-iii-joint-program-25086

To help us track our recruitment effort, please indicate in your email/cover letter where (jobs-near-me.eu) you saw this job posting.