The UNICEF Programme of Cooperation with the Government of the Republic of Zambia (GRZ) is designed to address and mitigate the threat of poverty the country’s children face, while responding to the needs with interventions addressing the multiple causative factors.
In response to the combination these threats involve the Programme supports national efforts to improve service delivery in the key areas of: child health and nutrition and HIV and AIDS, quality basic education, water, sanitation and hygiene education, child protection and social policy, advocacy and communication.
To find out more about UNICEF’s work in Zambia, please visit https://www.unicef.org/zambia/.
How can you make a difference?
Purpose of the Consultancy:To conduct an end of project evaluation of the EU/UNICEF/GRZ birth registration programme in line with the EU/UNICEF Agreement.
Description of the assignment (Scope of work) / Specific tasks
To meet the objectives and targets listed and using a pre-post test evaluation design, the Consultant will undertake the evaluation guided by the following:
This evaluation will cover the 16 districts of the targeted provinces of Zambia covered under the birth registration programme. Since it will not be practical for the evaluation to cover all communities within the given evaluation period, a statistically significant sample size will be selected such that results of the evaluation are within a reasonable confidence limit. The consultant is expected to propose a sampling approach for the quantitative as well as qualitative aspects of the evaluation.
The following criteria will be used during the final evaluation:
- Relevance: This aspect will measure the extent to which a development intervention/programme conforms to the needs and priorities of target groups and the policies of Zambia on CRVS, Regional and International development priorities.
- Effectiveness: the extent to which the programme has achieved its objectives as stated in the log frame, taking their relative importance into account. The evaluation will assess whether the planned objectives in the programme have been met along with the link in meeting the overall programme objectives in a timely manner.
- Efficiency: the extent to which the costs of the development intervention can be justified by its results, taking alternatives into account.
- Sustainability: The extent to which the enabling environment supports the continuity of the programme. The extent to which the government at micro, meso and macro levels will also be assessed. The evaluation will assess the extent to which the programme will continue and sustain results after EU funding has come to an end.
- Equity: the degree to which the birth registration services targeted the marginalized groups, including the poor, the disabled and hard to reach communities.
Tailored Evaluation Questions
Evaluation Criteria and Questions
|End of Project Evaluation Criteria||Suggested evaluation questions|
Equity and gender
Approach and Methodology
The evaluation methodology will consist of a mixture of components including desk review, qualitative and quantitative primary source data collection. As part of the proposed methodology, it will utilize a mixed methods approach, analyzing quantitative and qualitative data. The consultant will organize focus group discussions or semi-structured interview in the selected districts and key governmental partners. The objective of the discussion will be to touch on institutional factors, relevance and other qualitative aspects of the evaluation. The focus group discussion will also be used as a data triangulation exercise. Since the programme area and number of communities may be too large for the evaluation to cover within the evaluation period, a statistically significant sample size will be selected such that results of the evaluation are within a reasonable confidence limit. As part of its technical proposal, the Consultant is supposed to develop a detailed, costed methodology and work plan for delivering on the ToR. Components of the methodology will include (but not limited to):
Desk Review: Review of the relevant literature and resources that will be available to the evaluation team. These literatures / resources will include:
- Key project documents (EU proposal/business case, budgets and log-frame- including baseline data, indicator and targets etc), refer to Annex A- log frame;
- UNICEF Country Programme Document;
- Annual Workplan Plans
- MTR of the project
- Annual Review Reports;
- Programme Monitoring Reports
- Key Government of the Republic of Zambia’s planning documents (e.g CRVS 2015-19 National Strategic Action Plan).
Meetings with Key Sector Partners:
Hold meetings/undertake consultations with the key line government agencies in Lusaka (including but not limited to) Ministry of Home Affairs, Ministry of Health, Zambia Law Development Commission etc.
A quantitative analysis will be carried out to assess whether the end of programme evaluation answers the questions related with effectiveness, efficiency, equity, gender and sustainability. For this assessment, the consultant will collect primary data from: i) Key informants, ii) focus group discussions etc. The universe of the sample for the quantitative analysis will be selected from the provinces and districts that were reached with interventions targeted under the programme. A quantitative analysis of the indicator performance will be conducted and desegregated by gender and location accordingly.
For the qualitative data collection, the consultant should consider the following methodologies:
- Field observations at the service facility level
- Interviews with key stakeholders – civil registrars, health workers, community volunteers etc.
- Focus group discussions with different stakeholders, target population, including women groups, and the most marginalized groups among communities, including the disabled.
The consultant must propose and justify the qualitative methodologies chosen and the sampling strategies to select the participants. These sampling strategies must be based in and coherent with the quantitative sample proposed if any. Also, the selection criteria must consider groups with distinct characteristics that allow for comparisons between: urban versus rural, intra urban differences- highly versus low densely populated, new versus old intervention areas, distance differentials etc.
Gender and Human Rights, including child rights
The Consultant’s team will encourage women’s participation during data collection as they are both duty bearers and rights-holders of the target population. All data collected should be disaggregated by sex, location.
Gender roles and expectations will need to be considered in the evaluation and group dynamics of any FGD or interviews. The evaluation should follow the United Nations Evaluation Group norms and standards. These will be shared with the selected contractor.
The evaluation process will be guided by relevant instruments or policies on human rights, including child rights and gender equality e.g. International human rights law and human rights principles, including the Convention on the Rights of the Child, the Convention on the Elimination of All Forms of Discrimination against Women etc.
The major tasks for the assignment will be the following:
- Review progress on the implementation of activities to enhance an enabling environment for the provision of birth registration services: (i) legal and policy framework on civil/birth registration revised in line with international standards (ii) national budget resource allocation increased for birth registration service providers (iii) multi-sectoral coordination mechanisms in place for effective governance of civil registration systems (iv) CRVS and national ID systems integrated to ensure unique ID number is allocated at birth registration (v) evidence generation through conducting of a national comprehensive assessment of the CRVS system to inform planning.
- Review progress in transforming birth registration services to ensure they are available and functioning: (i) development of operational guidelines on national standards for civil registration (ii) capacity building of civil registrars, health workers and volunteers on revised registration work processes, legal framework and awareness raising for communities (iii) interoperable systems established between civil registration and health sectors and other sectors to increase coverage of both institutional and non-institutional birth registration (iv) ICT innovations introduced or expanded to facilitate access and acceleration of birth registration and certification services, including to the most vulnerable communities.
- Review progress on mobilizing communities to demand and effectively utilize birth registration authorities: (i) parents/caregivers and communities have the knowledge on the importance of birth registration (ii) development of context-specific, evidence-based communication for development strategy (iii) roll-out of communication for development strategy (iv) commemoration of mark days at national and sub-national levels such as the CRVS Day to raise awareness on BR.
- Document key lessons on the overall implementation of the EU/UNICEF supported programme so far, including how it fits in the overall CRVS national and sub-national system, highlighting what works, challenges/bottlenecks and recommendations.
Ethical aspects of the review which include, among others, data collection from human subjects and their consent should be covered in detail in the technical proposal. UNICEF has a set of ethical principles, and checklist regarding research and evaluations which must be upheld. The evaluation team will meet human objects particularly children. The research team should clearly identify in the Inception Report, the potential ethical issues specific to this evaluation as well as the processes for ethical review.
DISSEMINATION AND DATA USE
A dissemination meeting will be conducted with key stakeholders to discuss the findings and how the inform strategies and policy direction on civil registration. The key stakeholders are DNRPC, Ministry of Health, Central Statistics Office, Smart Zambia, Zambia Law Development Commission, Ministry of Justice, University of Zambia, UN agencies, among others. In addition, policy briefs will be developed for sharing with a broader audience.
|1.||Preparation of a brief inception report which should include timelines, human resources to be deployed, activities and methodology of data collection/tools||Inception report (data collection tools annexed)||30%|
|2.||Data collection and analysis- field missions- consultative meetings, focus group discussions, informant interviews||Draft report with Analytical tables||30%|
|3.||Submission of acceptable final report to UNICEF||Final report||40%|
The Consultant will report to the Social Policy Specialist and Research Focal Point in UNICEF who will be working in close collaboration with the Principal Registrar-Department of National Registration Passport and Citizenship (DNRPC) the main implementing partner.
In terms of deliverables the format of the report for each of the deliverables identified above will be as follows:
- Inception report (length as required)
- Final evaluation report1 (recommended final report 40-60 pages):
- 2.1 Table of contents (length as required)
- 2.2 Executive summary (1-2 pages)
- 2.3 Background/programme description (length as required)
- 2.4 Purpose of review (length as required)
- 2.5 Final Evaluation objectives (1-2 page)
- 2.6 Findings and analysis (length as required)
- 2.7 Conclusion (length as required)
- 2.8 Recommendations (length as required)
- 2.9 Lessons learned (length as required)
- List of stakeholders consulted, missions undertaken, data collection tools used (annexed in full)
- The consultancy will be managed by the Social Policy Specialist and Research Focal Point from the Social Policy and Research Section.
- The quality assurance for the evaluation will be provided by the UNICEF Research and Evaluation Committee (REC).
- The Consultant will be home and field based with travel to the selected Provinces/Districts which should include DNRPC offices, MoH Offices and Health facilities with birth registration desks. Communication and reporting is required on regular basis with the Chief of Programme Management Excellence in UNICEF.
LOCATION AND DURATION
- The consultancy will be for 45 Working Days.
- The consultancy is Lusaka based with field travels to the 8 selected provinces/16 districts. The consultant will be required to also visit at least 2 health facilities in each of the selected districts in addition to the Provincial and District Civil Registrars offices, Provincial and District Health Offices.
To qualify as an advocate for every child you will have…
- A minimum of a Master’s in one of the following or related fields required: Law, Business or Social Sciences.
- Five years of relevant professional work experience in child protection, civil registration, M&E and/or Research. Specifically:
- Global, regional and local experience and understanding of child protection and civil registration especially birth registration.
- In-depth knowledge of relevant Zambian policies and legal framework of civil registration
- Excellent analytical and report writing skills as well as good negotiation and communication skills.
- Computer skills: Experience in Microsoft Word, Excel and PowerPoint
- In-depth knowledge and expertise of gender and human rights in civil registration
- Specific skills and knowledge required include:
- Ability to effectively collaborate with stake and rights holders with different technical and sectoral backgrounds;
- Previous experience in project management including monitoring and evaluation either in the public sector or NGO;
- Excellent communication and interpersonal skills.
- Excellent ability to effectively communicate highly complex issues in a language that non-technical audiences can understand.
- Fluency in written and spoken English
- Knowledge of local languages is an added advantage.
The UNICEF/EU supported programme on birth registration will end in November 2019. The report for this assignment will be due to the UNICEF Regional Office together with the Donor report by 25th December 2019. Adherence to agreed time lines by the Consultant is therefore critical for this assignment.
- Consultant is required to provide their own facilities such as office space, computers, printers, etc.
- Consultant should factor in all cost implication in their budget for the assignment, including Field data collectors, travel (vehicles and fuel) and meetings, and provide an all-inclusive cost in the financial proposal.
- Payments will be made based on deliverables as shown in the expected deliverables table above.
- UNICEF will cover the Consultant’s fuel costs based on the UN calculations, to enable consultant and his/her research assistants to undertake field data collection trips to the selected provinces/districts.
For every Child, you demonstrate…
UNICEF’s core values of Commitment, Diversity and Integrity and core competencies in Communication, Working with People and Drive for Results. View our competency framework at: http://www.unicef.org/about/employ/files/UNICEF_Competencies.pdf.
UNICEF is committed to diversity and inclusion within its workforce, and encourages all candidates, irrespective of gender, nationality, religious and ethnic backgrounds, including persons living with disabilities, to apply to become a part of the organization.
UNICEF has a zero-tolerance policy on conduct that is incompatible with the aims and objectives of the United Nations and UNICEF, including sexual exploitation and abuse, sexual harassment, abuse of authority and discrimination. UNICEF also adheres to strict child safeguarding principles. All selected candidates will, therefore, undergo rigorous reference and background checks, and will be expected to adhere to these standards and principles.
Only shortlisted candidates will be contacted and advance to the next stage of the selection process.
How to apply:
UNICEF is committed to diversity and inclusion within its workforce, and encourages qualified female and male candidates from all national, religious and ethnic backgrounds, including persons living with disabilities, to apply to become a part of our organization. To apply, click on the following link http://www.unicef.org/about/employ/?job=526899
1The evaluation team is expected to make reference to the following evaluation standards: https://www.unicef.org/evaluation/files/UNICEF_adapated_reporting_standards_updated_June_2017_FINAL.pdf-