EVALUATION TERMS OF REFERENCE
Program Professionalize African Union for Rule of Law Initiatives
Evaluation type Summative evaluation
Evaluation purpose
To determine whether there is evidence that the program contributed to the AU staff capacity to advice on issues of governance, rule of law and other legal and rule of law topics suggested by AU officials; to propose effective approaches to advancing these AU priorities and to successfully oversee and implement mechanisms addressing these issues.
Evaluation start and end dates
35 work days during the period starting 15th April to 15th June 2021
Job Summary:
The American Bar Association Rule of Law Initiative (ABA ROLI) seeks a program evaluator for its Project entitled “Professionalize African Union for Rule of Law Initiatives.”
I. Project Background and Overview
The “Professionalize African Union for Rule of Law Initiatives” project (from here on forward referred to as “the Project”) is a 2 years, 9-month program awarded to the American Bar Association Rule of Law Initiative (ABA ROLI) by the U.S. Department of State Bureau of International Narcotics and Law Enforcement (INL). The Project started in September of 2018 and will end on June 30, 2021. The Project aims to strengthen the African Union Commission (AUC) staff capacity to advise on issues of governance, transnational crime, and peace and security; to propose effective approaches to advancing these African Union (AU) priorities; and to successfully oversee and implement mechanisms addressing these issues. Specifically, the project aims to achieve the following: 1. AU staff possess increased knowledge and skills for handling matters related to governance, rule of law, criminal justice, transnational crime, and other legal and rule of law topics requested by AU officials; 2. AU staff and offices have enhanced capabilities to develop and manage implementing mechanisms related to the topics identified in Objective 1;
February 17, 2021
2
- AU staff possess improved skills to measure and analyze the effectiveness of mechanisms implemented to promote rule of law, good governance, an improved law enforcement and judiciary, and human rights; and 4. AU staff have a strong knowledge of open source resources to facilitate their work.
II. Evaluation Objectives and Use
The evaluation is commissioned by the Africa Division to comply with the commitment set under the Program’s M&E Plan. The summative evaluation will covering the entire 2 year 9-month implementation period of the Project, and will assess the relevance, efficiency, effectiveness, and sustainability of outcomes of the Project. The evaluation is intended to be forward looking which will capture effectively lessons learnt and provide information on the nature, extent and where possible, the effect of the project to the African Union.
The evaluation will provide evidence-based assessments of the contributions of the Program to the bigger picture of AU staff capacity building efforts. Specifically, the evaluation will respond to the following questions:
i).Relevance of Project design and focus - Were the inputs and strategies identified realistic, appropriate and adequate to achieve the results? - Was the project relevant to the identified needs of the beneficiary institution?
ii).Effectiveness of Project activities and outputs - To what extent did the Project achieve its objectives? - How effective were the strategies and tools used in the implementation of the project? - How effective has the project been in responding to the needs of the beneficiaries, and what results were achieved? - Describe the main lessons that have emerged? - What are the recommendations for similar support in future?
iii). Efficiency of Project Implementation - Was the process of achieving results efficient? Specifically did the actual or expected results (outputs and outcomes) justify the costs incurred? Were the resources effectively utilized? - How efficient were the management and accountability structures of the project? - What are the strengths, weaknesses, opportunities and threats of the project’s implementation process?
February 17, 2021
3
iv). Sustainability- To what extent are the outcomes of the projects likely to be sustained after the completion of this project? - What is the likelihood of continuation and sustainability of project outcomes and benefits after completion of the project? - How effective were the exit strategies, and approaches to phase out assistance provided by the project including contributing factors and constraints? - Describe key factors that will require attention in order to improve prospects of sustainability of project outcomes and the merits related to replication of the project design/approach? - How were capacities strengthened at the individual and organizational level (including contributing factors and constraints)? - Based on finding, what future interventions and strategies may be taken to address AU’s goals for capacity building and sustainability? -
The evaluation shall be guided by the American Evaluation Association’s principles for evaluators 1 and will be undertaken using quantitative and qualitative methods, including the following: • Desk study and review of all relevant project documentation including project documents, annual work-plans, project progress reports, annual project reports • In depth virtual interviews to gather primary data from key stakeholders • Online discussions with project beneficiaries and other stakeholders. • Online/virtual interviews with relevant key informants
III. Uses and Users of this Evaluation:
This evaluation will be used by the African Union Commission (AUC) and the AU organs and mechanisms, as well as ABA ROLI to better understand which of their various activities were or were not effective, and will be used to better inform managers on future program design efforts.
IV. Scope
The evaluation will cover the entire project timeframe, and will review all project activities, using a representative samples of participants and other stakeholders from AU and ABA ROLI. The sampling methodology will be dependent on variables such as the extent the effort proposed can reach individuals and service providers.
V. Deliverables
The evaluator will deliver the following: • An inception report demonstrating understanding of the assignment within one
1
American Evaluation Association Guiding Principles For Evaluators July 2004 http://www.eval.org/p/cm/ld/fid=51
February 17, 2021
4
week from the start of the assignment. It will include a description of the following: o An evaluation design methodology o A time table for the evaluation exercise o Tools for the evaluation exercise • First draft evaluation report for presentations to key stakeholders by 5th June 2021 • A final project evaluation report consisting of not more than 30 pages including an executive summary to be delivered by 15th June 2021
VI. Qualifications for this Position
The Consultant should have the following qualifications:
● Advanced degree in evaluation, public administration, public policy, or other related fields; ● At least 7 years of experience undertaking process or performance evaluations using mixed research methods; ● Proven ability to organize and coordinate evaluations or studies in the field and online and with a group of program implementers in various locations. ● Familiarity with the African Union and its role, structure, mandate, functions and initiatives across the region is preferred. ● Experience having conducted similar evaluations for capacity building programs in the area of rule of law, human rights and governance is required. ● Ability to speak/understand French (advantage)
VII. Reporting
The Consultant reports to the Program Director on the day today undertaking of the assignment and will be provided the necessary coordination, logistical support and information where necessary. VIII. Application Process
Interested and qualified Consultants or Consultancy firms should submit their applications which should include the following: 1. Cover Letter 2. Detailed Curriculum Vitae 3. Proposed budget & workplan for the assignment
Please quote “African Union-ABA Project Evaluation” on the subject line. Applications should be emailed to Danielle.Schmitz@americanbar.org no later than 15 March 2021 at 16:00 EAT.
How to apply:
Please quote “African Union-ABA Project Evaluation” on the subject line. Applications should be emailed to Danielle.Schmitz@americanbar.org no later than 15 March 2021 at 16:00 EAT.