Organization: UN Children's Fund
Closing date: 16 May 2019
Purpose of the Evaluation
UNICEF Burundi Country office is looking for a qualified evaluation consultant to carry out a Summative evaluation on a project on Enhancing Monitoring and Reporting of Child Rights Violations in Burundi which begun in September 2016 and will end in May 2019. The evaluation will cover this timeframe.
The Consultant will evaluate the project in its entirety, identify gaps, assess the tendencies related to the access to adequate services as a response to violations and, develop a robust systematic framework to ensure the sustainability of this improved and efficient mechanism at national level. Gender equality will be covered through the equity criterion. With the ever evolving political, security and socio-economic context in Burundi, it is imperative that the system in place be evaluated to ensure it can adequately respond to protection needs for children especially in view of the upcoming 2020 presidential election which may present protection risk for children.
Users and Intended use of the evaluation
UNICEF Burundi CO
To inform design of appropriate response for children in an evolving Country situation
To inform advocacy efforts for investing in child protection systems in Burundi
Civil society organisations, International NGOs, UN agencies
Strengthen child rights monitoring and reporting systems in Burundi as well as referral mechanism
Scope of Work
Goal and Objective:
- Assess the relevance, effectiveness, efficiency, sustainability and equity of the Child Protection project in its content, implementation and achievement of results for enhancing the monitoring of child rights violations in Burundi;
- Assess the internal and external coherence of the project with UNICEF Burundi's country programme;
- Identify lessons learned, weaknesses, obstacles, strengths and opportunities arising from the implementation of the project, taking into account the contextual elements that have affected the implementation of the project;
- Propose recommendations of a strategic and operational nature to guide the sustainability of the project.
- Initiate the strengthening and harmonization of child protection data collection in Burundi in support to the Ministry of Human Rights Social Affairs and Gender
- Evaluation Framework and major evaluation questions
In order to meet the objectives, the evaluation will be guided by these overarching questions:
- Did the project achieve its intended objectives and if yes to what extent?
- What have been enabling and inhibiting factors for successful implementation of the project?
The evaluation will be guided by OECD/DAC criteria - relevance, efficiency, effectiveness, and sustainability. Human rights, equity and gender will be integrated into the evaluation design.Â However due to the timing of the evaluation in the project cycle, the evaluation will not assess the impact criteria.
Key Evaluation Questions:
- Was the project developed based on a situational analysis? Was it aligned with the priorities identified by this analysis?
- Were the project strategies and implementation action plan relevant to the risks of abuse, violence, exploitation faced by children? Were the priorities for action clearly identified?
- What was the theory of change used in the development of the project which linked the causes of children's situation, the interventions selected and the expected results?
- To what extent was the project integrated into the Country Programme (links with other components of the UNICEF Burundi Programme)?
- To what extent did the project clearly identify context-specific risks and bottlenecks in advance and take them into account in its development?
- To what extent were the strategies adapted to the national context, its constraints, limitations and opportunities?
Coherence, Coverage, Coordination
- To what extent has the implementation of the Project created synergies of action with the other components of the Burundi-UNICEF programme?
- To what extent has the implementation of the project created synergy of action between coordination actors?
- To what extent has the project met its expected outputs and outcomes in terms of enhancing the monitoring of child rights violations in Burundi, as well as providing appropriate services to victims of abuse, violence and exploitation?
- What were the most effective strategies?
- To what extent did the service delivery structures/institutions reach the groups targeted by the interventions: (i) what were the main constraints, (ii) what are the factors of success and/or failure?
- To what extent has the project addressed the gaps and weaknesses in the national child protection system?
- To what extent were the interventions carried out cost-effectively?
- To what extent did the project maximize the financial, material and human resources available to it?
- To what extent were interventions efficient in meeting the planned project outputs and outcomes?
- To what extent have the partners taken ownership of the vision, lines and working methods supported and led by the project?
- To what extent are the results achieved at all levels sustainable?
- To what extent are some financial burdens related to the implementation of interventions fully or partially integrated into the national budget?
Equity (including gender)
- To what extent did these interventions target the poorest and reduce inequalities?
- To what extent did the project take into account, gender disparities between women/men/boys/girls
- Were any vulnerable groups of children excluded?
The evaluation design will be based on the review of the existing documents, monitoring data, and reconstruction of theory of change with appropriate indicators. The project theory will be empirically tested through review of and collection of data (as applicable) and conducting qualitative fieldwork. The project theory will establish a logical model of cause-effect linkages by exploring the delivery of results. Reconstructing the project theory will be a critical first part of the evaluation prior to conducting review of data and fieldwork and will be done through a combination of documentary review and interviews with UNICEF staff, partners, implementing partners and beneficiaries.Â The evaluation will be required to employ predominantly a qualitative approach to ensure that data can be sufficiently triangulated to deliver aggregate judgments.
The methodology will cover review of initiative documents; any existing monitoring data; interviews and focus groups as well as document case studies. The evaluator will propose the best design and methodology to answer the evaluation questions and meet evaluation objectives.
The evaluation will at minimum follow the following data collection methods. The evaluation team will be expected to triangulate feedback from various actors to ensure validity.
- Review of relevant documents and monitoring data related to the project held by UNICEF and implementing partners.
- Semi-structured Interviews and Focus Group Discussions (FGDs) conducted with Child Protection Committee members (CPCs), Civil Society Organizations and international non-governmental associations - Federation Nationale des Association engagÃ©es dans le Domaine de l'Enfance (FENADEB), Association des Femmes Juristes du Burundi (AFJB), Terres de Hommes (TDH),Â Fondation Stamm, Plateforme des intervenants en Psychosociale et SantÃ© mentale (PPSM).
- Limitations: Owing to the tense and volatile political and security context in which the project has been implemented as well as the sensitive nature of the project, it is important to highlight that these factors may affect the evaluation methods, sources of info, disaggregated data and access to certain groups of vulnerable people.
Evaluation process and deliverables
The main activities and timetable for this evaluation will be as described in the table in the ToR.
The consultants will prepare; (a) Inception Report that includes detailed evaluation design, evaluation design matrix and data collection tools; and (b) an independent evaluation report in accordance with UNICEF Policy. The deliverables are to be:
- Evaluation Inception Report
- Draft of an Executive Summary
- Evaluation Draft Report
- Findings and recommendations validation meeting
- Evaluation Final Report of between 50 to 60 pages
30% upon validation of methodology and approval of inception report
40% upon submission of the draft report
30% upon submission of final report that meets UNICEF quality standards.
Stakeholder involvement is critical to the successful execution of this evaluation. The evaluator is expected to retain independence in coming to conclusions about the project and employ participatory and collaborative approach providing for meaningful involvement of UNICEF, partners and beneficiaries. The evaluation will be managed by a Child protection Specialist within the Child Protection Section. A reference group will be established as a platform for stakeholder participation. The membership of the reference group will include civil society organizations, members of the CPCs and International NGOs. ÂThe reference group will provide inputs and review the inception report, data collection tools and the draft final report. A broader consultative workshop will be organized to validate findings and recommendations before finalizing the report.
Ethical considerations and evaluator obligations
The evaluator is expected to adhere to existing ethical requirements including UNICEF General Terms and Conditions for individual contractors. The evaluator is also expected to adhere to UNEG standards and evaluator obligations of independence, impartiality, credibility, honesty and integrity. The Evaluator is required to clearly identify any potential ethical issues and approaches, as well as the processes for ethical review and oversight of the evaluation process in their proposal.
Roles and responsibilities
- The evaluation consultant will be responsible for:
- Conducting all necessary qualitative assessments;
- Day-to-day management of the evaluation;
- Formal and informal reporting to the Evaluation Manager, as necessary;
- Production of deliverables (evaluation report) in accordance with the Terms of Reference and contractual arrangements.
- Facilitating a validation workshop with key project stakeholders.
The evaluation consultants will report to the Evaluation Manager on all issues related to the evaluation and deliverables and commenting / responses processes. In addition, the consultant will work closely together with one national ÂM&E consultant working on the project.
- The evaluation manager will be responsible for:
- Reviewing and selection of the evaluation consultant;
- Overall responsibility and accountability for management and delivery of the evaluation up to and including approval of the final report;
- Technical guidance for the evaluation consultants; and
- Leadership of the evaluation draft report review process including collating comments and facilitating discussion.
- Submitting inception report and draft final report to ESARO for quality assurance
- Uploading final report into online evaluation database (EISI).
Desired competencies, technical background and experience
- Master's degree in law, human rights, Evaluation, Project management, or relevant fields. Having a PhD in one of these disciplines is an asset.
Specialized skills and/or training if needed:
- Minimum five years of professional work experience in conducting evaluations using either theory based approaches or qualitative methods preferably relevant to Child Protection, or closely related fields, some of which should be in Africa;
- Experience in working on Child Protection in Emergencies (CPiE) and Gender equality issues Âis required;
- Proven experience in data collection and management in child protection and/ or other social science areas
- Experience conducting evaluations for UN agencies, governments and non-governmental organizations;
- Experience in producing reports in English and French for a wide range of audiences, including practitioners in the field and policy makers;
- Languages needed:
- Fluency in oral and written French and English.
- Other: Willingness and ability to frequently travel to field locations
- The consultant will have an appropriate workspace in UNICEF premises;
- The consultant will use his/her own personal work equipment (computer, telephone, etc.);
- UNICEF will facilitate the consultant's letter of authorization for access to Burundi;
- The consultant will submit a mission report at the end of the mission to UNICEF with recommendations and action points.
- The consultant will be based in Bujumbura with workshops within the country. Transportation within Bujumbura will be the responsibility of the consultant. UNICEF will provide transportation for field missions;
- The candidate selected will be governed by and subject to UNICEF's General Terms and Conditions for individual contracts;
- The successful candidate will be responsible for his/her own insurance cover;
- Given the nature of the financing of this consultancy and the importance of the expected results, no delay in implementation will be tolerated;
- If the consultant is currently employed, he or she must provide a certificate from his or her employer authorizing him or her to do the work on a full-time basis as a consultant for UNICEF for the agreed period;
- As per UNICEF policy, payment is made against approved deliverables. No advance payment is allowed unless in exceptional circumstances against bank guarantee, subject to a maximum of 30 per cent of the total contract value in cases where advance purchases, for example for supplies or travel, may be necessary;
- UNICEF reserves the right to not pay for unsatisfactory work.
- The consultancy time might be longer than expected;
- Limited involvement of project implementing partners;
- Difficulties in the VISA access by the consultant.
- Partners will be timely and regularly informed on the consultant mission and a child protection staff has been appointed to guide and accompany the consultant;
- Regular meetings of the child protection team and involved partners will be organized to increase the contracting consultantâ€™s dynamism;
- All required documents to get VISA will be prepared and introduced in advance to whom it may concern with a joint collaboration with the Administrative unit.
How to Apply
Qualified candidates are requested to submit a cover letter, CV with the names and contacts of three references, copies of their highest University degrees, a technical and financial proposal with all costs included (fees, ticket, DSA, visa, transport) and a signed P11 form (which can be downloaded at http://www.unicef.org/about/employ/index_53129.html)
Incomplete applications will not be considered.
How to apply:
UNICEF is committed to diversity and inclusion within its workforce, and encourages qualified female and male candidates from all national, religious and ethnic backgrounds, including persons living with disabilities, to apply to become a part of our organization. To apply, click on the following link http://www.unicef.org/about/employ/?job=521867