Expression of Interest (EoI)
Terms of Reference for “Project End Evaluation of EU Funded Project: DLG Pakistan”

Background

European Union and Friedrich Naumann Foundation for Freedom co-funded a four and a half years project titled “Democratic Local Governance for Development in Pakistan” (DLG Pakistan). The duration of the project is 54 months starting from January 2017 and ending in June 2021.The main objective of the project is “Improving the life of the citizens of selected districts by strengthening democratic local governance”.

This project is implemented by Center for Peace and Development Initiatives (CPDI). The geographical scope of this project is 15 districts in Pakistan (five each in Sindh, Balochistan and Khyber-Pakhtunkhwa).In each district, CPDI engaged one local Civil Society Organization, which is working on ground with the following target groups:

•           Local Citizens

•           Media

•           Government Functionaries

•           Elected Local Representatives

The objectives of this project are met by developing a culture of open discussions based on data both provided by the Government in the form of District Budgets and collected through short surveys called Citizen Report Cards for each district. At the same time, a regular schedule of meetings amongst citizens and with the Local Authorities also ensures that issues in the areas of education, water, sanitation and health are solved in a timely manner. Citizens and Media were regularly given trainings on Right to Information (RTI) and how districts budget are made. These selected citizens and media personals were further invited to attend the pre-budget consultations with appointed government functionaries and elected local representatives once a year.

The backbone of this project was citizens meetings every two months among themselves to prepare list of priority issues based on district budget understanding. Then meeting the local authorities every three month to follow up on issues they highlighted previously as well as share new identified priority issues.

For further information about the project, Partners, CSOs and districts, area of work etc, please visit at www.dlg-pakistan.org

Purpose of the Project End Evaluation

The purpose for this evaluation is to assess the performance and management arrangements of the project and capture project achievements, challenges and best practises for future similar programming. It will also review the recommendations of the project Mid Term Evaluation and ROM reports, and assess the extent to which these were implemented. The evaluation will also ensure accountability towards the European Union as a donor and the beneficiaries of the program. On the other hand, it offers a learning aspect for all stakeholders. The evaluation will also identify key lessons learned, challenges and the flexibility of the programme to adapt and respond to the changes, and sustainability of “Democratic Local Governance for Development in Pakistan’’

Objective of the Evaluation

The evaluation will cover the time from January 2017 to June 2021 has three main objectives;

Objective 1:

Evaluate, to what extent CPDI and FNF have delivered effective, efficient, relevant and timely activities to beneficiaries as set in the project log frame. Assess whether the collaboration between FNF, CPDI and the 15 CSOs has added value to the interventions with a positive effect on beneficiaries and other stakeholders. Some specific questions are

  1. Was the programme delivery nationally consistent and where could it be improved?
  2. How inclusive was the project approach in attracting marginalized sectors of society in the program activities?
  3. Evaluate the effectiveness and sustainability of the key initiatives taken during the program initiatives

To what extent the program implementation was able to advance the SDGs agenda?

Objective 2

Identify and assess key lessons learned, challenges and draw recommendation for future programming. Some key questions are:

  1. How well was the project designed to keep the interest of the stakeholders in the project activities? Have the stakeholders been actively involved in project implementation?
  2. What restrictions were faced by the implementing partners to arrange and conduct the field activities in the context of increasing government regulations?

Objective 3

Identify the opportunities and challenges towards the sustainability of the program. Some key questions are:

  1. What motivations /mechanisms exist for partners to continue playing these roles?
  2. What are the risk factors facing sustainability of programme? What has been done to mitigate this challenge?
  3. Will the changes caused by this programme continue beyond the life of the project?
  4. Has the capacity of the implementing partners been built on technical components of the programme in the context of sustainability?
  5. Have any programme structures been built to motivate the implementing partners and community to sustain the programme initiatives?

Methodology

The methodology and all relevant tools will be developed by the evaluator, and presented in the inception report. The data collection should include but not limited to undertaking the following activities

  • Desk review of background documents (project document, project monitoring data, progress reports, mid-term evaluation report, field visit reports etc.).
  • Development of instruments/questionnaire for focus group discussions and key Informant Interviews
  • Conducting key informant interviews (e.g. with  program manager, field staff, provincial coordinators and key community members/beneficiaries, local partner, CSOs and representatives to gather substantial anecdotal evidence on the effectiveness, efficiency, relevance and timeliness of the project activities implementation and delivery
  • Holding focus group discussions (e.g. with stakeholders, community members. The FGD will serve as input for the narrative anecdotal evidence.
  • Conducting end line evaluation survey with beneficiaries in project implementation districts. 
  • Report Writing

Deliverables

The evaluator is expected to submit the following deliverables within the agreed timeframe and budget:

  • An inception report, which will serve as an agreement on how the evaluation will be, conducted. The inception report will provide understanding of the issues and questions raised in the TORs. Data sources; how to assess the questions in the TORs
  • Research methodology, including suggested sample and size
  • Schedule of activities and travelling (timeline)
  • Appropriate validated draft data collection tools (e.g. methodological guidelines, group interview questions) · Raw data in any of the following statistical packages SPSS) and transcribed qualitative scripts.
  • Draft Report
  • Final Report
  • Power Point presentation of findings of results in a meeting with FNF and CPDI staff

Structure of the Report

The report must be in English Language and should not be more than 25 pages excluding annexures.

  • Have executive summary (max. 2 pages)
  • Introduction
  • Methodology, including sampling and limitations
  • Address concerns, lessons learned and comments
  • Stories of change and quotes from respondents
  • As Annexures relevant maps and photographs of the evaluation areas where necessary must be attached
  • Finalized data collection tools
  • List of interviewees with accompanying informed consent forms
  • Recommendations: Based on the conclusions set out in the report, make recommendations with a view to improving future actions. It is important to mention the actor or actors for whom each recommendation is intended.
  • Conclusions. Set out the main conclusions drawn from the evaluation criteria projects.

Power Point presentation of preliminary findings ( As annexure)

Time Frame and Professional Fee

This assignment will be for a maximum of 25 working days starting from 10 July 2021 and ending by 15 August 2020.

The proposal must not be for more than PKR 1.40 million that includes travel and boarding cost. The technical proposal must include a work schedule setting out the deadlines proposed by the organization for carrying out the evaluation tasks.

The professional charges will be in accordance with the contractual agreement signed between FNF and the consultant/s, payable on completion the tasks. Withholding tax will be deducted according to the regulations.

Required Competencies

The competencies required from the external evaluators are:

  • Experience in project monitoring and evaluation of right based, governance projects
  • Extensive knowledge of quantitative and qualitative research methods and techniques
  • Ability to use participatory approaches for evaluation
  • Experience in operational management linking governance and development programmes/projects.
  • Good knowledge of the local context, community ownership principles, and dynamics of local governance.
  • Good probing and analytical skills
  • Excellent writing skills in English
  • Appropriate language skills, knowledge of local dialects is preferred.

During the planning phase, the evaluation team must submit its final work plan and inception report, as agreed with the FNF management team, and the FNF management team must approve a model of the assessment report for the project.

 

Consultant’s Proposal and Time Line to Submit proposal

The technical proposal must have the following features:

  1. Cover page, stating name of the company, person, assessment team, etc.
  2. Technical proposal, to include: Detailed off the firm (as appropriate) Detailed CVs of the members of the evaluation team who will perform the work
  3. Scope and methodology of the work, to include
  4. Objectives of the assessment
  5. Scope of the assessment.
  6. Preliminary proposal for participatory methodologies and approach regarding
    1. Information sources
    2. Detailed work plan, to include assessment activities and timescale planning for the review and delivery of deadlines for reports
  7. Budget

In order to participate the bidder should submit its proposal by email with the Title: “Project End Evaluation of EU Funded Project: DLG Pakistan” at pakistan@fnst.org until 28st June 2021, 18:00 hrs.