Inception Report

Download as pdf or txt
Download as pdf or txt
You are on page 1of 29

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/345643329

Inception Report

Technical Report · November 2020


DOI: 10.13140/RG.2.2.15586.35526

CITATIONS READS

0 2,318

1 author:

Muhammad Abdur Rahaman


Center for People & Environ (CPE)
49 PUBLICATIONS   106 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Empowering Women & Youth through Homestead Farming in Saline Prone Areas View project

Landscape of WASH in IWRM in Bangladesh View project

All content following this page was uploaded by Muhammad Abdur Rahaman on 09 November 2020.

The user has requested enhancement of the downloaded file.


INCEPTION REPORT
On
Phase-end Evaluation of the Panii Jibon Phase II Project

Submitted to:

Muhammad Abdur Rahaman

Submitted Date:
9 November 2020

Submitted by:

BANGLADESH CENTRE FOR ADVANCED STUDIES


House 10, Road 16A, Gulshan-1, Dhaka-1212, Bangladesh
Tel: (+880-2) 9848124-27, 9851237, 9852904;
1 Fax: (+880-2) 9851417
E-mail: [email protected] Website: www.bcas.net
Table of Content

Chapter One: Background of the Study ...................................................................................... 1


1. Background of the study ........................................................................................................... 1
1.1 Introduction...................................................................................................................... 1
1.2 Understanding of the assignment key question ................................................................. 2
1.3 Objectives of the study ..................................................................................................... 4
1.4 Scope of the study ............................................................................................................ 4
1.5 Duration of the study ........................................................................................................ 5
1.6 Location of the baseline study .......................................................................................... 5

Chapter Two: Approach and Methodology of the Study ............................................................ 6


2.1 Introduction...................................................................................................................... 6
2.2 Approach of the study ...................................................................................................... 6
2.2.1 Primary data collection and Consultations ............................................................... 8
2.2.2 Sample Design and Sampling Methods .................................................................... 8
2.2.3 Field Test of the Tools and Techniques .................................................................. 10
2.2.4 Data Collection ...................................................................................................... 10
2.2.4.1 Household Survey (HHS) ........................................................................... 10
2.2.4.2 Focus Group Discussion ............................................................................. 10
2.2.4.3 Key Informants Interview........................................................................... 11
2.2.4.4 Case studies/Best practice documentation .................................................. 12
2.3 Household Survey Process ............................................................................................. 12
2.4 Data Processing and Analysis ......................................................................................... 14
2.5 Quality Control Measures ............................................................................................... 14
2.6 Follow –up data collection and provide on the spot guidance to the team during field
survey ..................................................................................................................... 14
2.7 Develop database in SPSS and code manual ................................................................... 15
2.8 Data Processing and Analysis ......................................................................................... 15
2.9 Report Preparation, triangulation and Finalization .......................................................... 16

Chapter Three: Time Frame and Team composition ................................................................ 17


3.1 Time bound Rollout Plan ................................................................................................ 17
Work Plan ..................................................................................................................... 18
Work Schedule for the study .......................................................................................... 20
3.2 Study Team Composition and Relevancy ....................................................................... 21

Annex-1 Evaluation Survey questionnaire


Annex-2 FGDs Check List
Annex-3 KIIs Checklist
Annex-4 Case study Checklist

2
Chapter One: Background of the Study

1. Background of the study


1.1 Introduction
Panii Jibon project is an integrated project of HELVETAS which addressed water related threats and vulnerabilities of an already impoverished
population living in the disaster prone coastal areas of Bangladesh. The project is implemented by HELVETAS in collaboration with local partners to
build resilience of severely disadvantaged and vulnerable communities and families (including women led households, people with special needs, and
extreme poor people affected by recurrent disasters) in accessing safe drinking water and in adapting their (homestead based) farming systems for
enhanced food security, nutrition and income. The project is implemented through four ways: i) expanding tested practices (alternative solutions for
water harvesting and management, saline tolerant crop and fish cultivation, and locally adapted early warning systems) into neighboring Districts and
Sub-districts; ii) amplifying the effects of emerging local advocacy and governance structures and capacities, connecting and integrating them
horizontally and vertically with national, regional and international climate change and development related advocacy initiatives; ii) supporting and
feeding action research on the climate change - migration nexus and related livelihood systems, and using the analysis for the development of promising
transformative potentials (skills, market integration, remittances management) and the promotion of local climate change financing.
In order to strengthen resilience and sustain the well-being of disadvantaged communities in the climate change affected and rapidly transforming agro-
ecological, social and economic context, Panii Jibon project addressed interrelated and catalytic Entry Points which enhanced the absorptive, adaptive and
transformative capacities of about 100’000 people, particularly vulnerable women and youth in the project areas. The project addressed basic rights to
water and food that leveraged and sustained with actions to enhance economic inclusion (access to markets), contribute to the diversification of income
from outside the area (migration & livelihoods), and strengthen governance and advocacy capabilities and mechanisms that support community led
initiatives and foster accountability for public resource allocation and climate change finance with the goal to build resilience and reduce well-being loss
of climate change affected disadvantaged communities, and particularly vulnerable women and youth, in the disaster prone areas of South West
Bangladesh. The project focuses on 4 outcomes:
Outcome 1: Disadvantaged communities, and particularly the women, demand their basic rights for WASH services and benefit from improved WASH
governance to increase year-round access to and use of safe drinking water, sanitation facilities and hygiene practices.

3
Outcome 2: Women and youth enhance their food security and income through adaptation of their farming and water management systems and improved
market linkages
Outcome 3 (Transversal Outcome 1): Women and youth enhance their transformative capacities and build and sustain their basic livelihood assets and
income through long-term benefits from (seasonal) out-migration.
Outcome 4 (Transversal Outcome 2): Disadvantaged communities, and particular women and youth, benefit from improved governance that leads to
more participatory, transparent and accountable resource allocation mechanisms for the scaling-up of climate resilient strategies and actions
The project is ending on 31 December 2020 and at the phase-end evaluation is planned to gather valuable information about the changes occurred in the
lives of the beneficiaries between the initial time of Phase II and the present situation. It compares both stages by describing their socio‐economic
characteristics and how it has changed over time. It will also diagnose the main learnings and to identify the challenges that still remain. The phase-end
evaluation will serve as a reference for adapting approaches and planning activities for the new phase. Therefore, this evaluation will cover capacity
building and awareness raising on DRR, awareness on gender and social equity, and human and institutional development, community mobilization and
knowledge management. So, the main focus of this phase-end evaluation shall hence be on the outcomes and processes rather than the impact level.
Through the evaluation it will be qualitatively analyze the outcomes and its underlying working mechanisms. The purpose of this phase-end evaluation is
three-fold:
 Identifying the socio-economic changes: The evaluation will identify lessons learned and generate knowledge of the socio-economic changes of
the beneficiaries both in terms of interventions and approaches of the capacity development and awareness on climate change and DRR, gender
and social equity as well as human and institutional development.
 Enhancing sustainability: Based on the gathered information and knowledge, the evaluation will recommend actions so that the achieved
changes (in capacity, knowledge, relationships, policy changes) can be sustained, as part of PJ8 project exit strategy.
 Accountability: The phase-end evaluation with allow the PJ project to provide accountability to its various stakeholders, in particular to the
project participants, other agencies/actors (including LGI), INGOs and donors in countries and at global level, and PJ’s donor; CJRF and HSI.
1.2 Understanding of the assignment key question
The main purpose of this evaluation study is to evaluate impact assessment considering the baseline information e.g. project activities such as drinking
water, sanitation, hygiene, farming and fishing techniques, financial states, food security, governance, job skill, job connectivity, gender and knowledge
management of the community people, especially the poor and disadvantaged people of the project area. The study results will recommend a set of
recommendation for the project activities. The end-line evaluation study would be conducted keep in mind the following key questions:
4
Relevancy:
 To what extent is the project design, as evidenced by its original ‘Result Framework’ components (Impact, outcomes, outputs, analysis of
assumptions/risks, and identification of problems and needs of the target population), strategy and approach appropriate to address the problems
and to the physical and policy environment of the project areas?
 Development of clear and useful result framework matrix, to remedy earlier deficiencies in design and methodology, and to provide a clear and
useful document for further monitoring and evaluation of the project;
 Adequacy of criteria used for selection of beneficiaries. Is it appropriate and relevant to the project results and objectives?
 Are all activities relevant to the outcomes, output of the project? Any major activities have not been considered which could have better impact of
the project.
 To what extent is the project’s timescale/range of activities realistic with regard to beneficiaries’ capacities and deliver the planned results in a
sustainable way?
 Finding out the appropriateness and relevancy of project activities which were not mentioned in the project proposal but have been implemented
by the project.
Efficiency:
 Evaluate the financial and technical inputs made available to implement the activities;
 Measure the efficiency of management of resources in a transparent and accountable manner;
 Assess the efficiency of the project monitoring system/framework with regard to aims, staff resources and outputs. Are the important progresses,
process and benefit monitoring data being captured and fit for purpose? To what extent is the project baseline survey (BS) qualitative and
adequate in terms of information? In carrying out the BS what lessons have been learned which can be used to improve the execution of the next
update?
 How efficient have the project’s human development and different been training been? (Module including the quality and adequacy of the training
materials, acceptance by the beneficiaries, outcomes i.e., changes in behavior, attitude and knowledge etc. and cost-efficient)
 Whether payments (skill, cash support etc.) to beneficiaries were made according to plan, timely and free of any leakage; appropriateness of
project operating costs;

5
Effectiveness:
 How effective has the needs assessment process been in terms of beneficiary participation and satisfaction?
 Whether planned benefits have been delivered and received;
 Management response/flexibility to unforeseen the external factors affecting the project purposes;
 Any shortcomings due to a failure to take account of cross-cutting issues such as gender, environment, WASH and health etc.;
 What are the major lessons learned from this project and what are the implications for the project strategy?

Impact:
 How far has the project made impact against the objectives and results so far, and what is the likely impact against such by the end of the project
and beyond?
 What is the non-tangible benefits created of the project? How the project have addressed the cross cutting issues etc. and what are the impact?
Sustainability:
 Evaluate the financial and economic sustainability of the households, SHG, Apex body etc.
 Evaluate the relationship, networking and linkages among the project staffs, community, service providers and beneficiaries. Is it appropriate and
sufficient to ensure the financial and economic sustainability of the beneficiaries after the project?
 Is the current project budget and duration adequate to achieve its purpose in a sustainable manner?
 How the project is sustainably contributing to poverty reduction and how these activities are appropriate for economic sustainability?
1.3 Objectives of the study
The phase-end evaluation emphasis on the outcomes, but it also prefers to cover the outputs in some cases. The main objectives of the Phase-end
evaluation are as follows:

6
1. To assess to what extent there is an observed change in the socio ‐economic situation (with regard to drinking water, sanitation, hygiene, farming
and fishing techniques, financial states, food security, governance, job skill, job connectivity, gender and knowledge management) of targeted
beneficiaries at the end of the Phase-II.
2. To analyze to what extent the project could contribute to the defined outcomes and objective (based on analyzing some indicators of the log
frame) of PJ Phase II project.
3. To provide effective information for steering decisions and learning process
1.4 Scope of the study
 Collecting and reviewing all project documents as well as relevant other documents
 Conducting preparatory discussions/meetings with the relevant Dhaka-based stakeholders, including Helvatas Bangladesh and field level project
team
 Designing qualitative and quantitative data collection tools, sampling methods, field survey schedules and division of tasks
 Arranging/appointing data collectors and orientation of the data collectors/ enumerators
 Collecting data and information from different levels and stakeholders including the project beneficiaries and groups, community people, project
and Helvetas Bangladesh staff, relevant government officials, government line departments, Upazila and Union Parishad representatives, etc.
 Designing/developing data entry template using MS Access software as well as data cross checking/validation of methodology
 Processing field data collection and analyzing the data applying SPSS and MS Excel program
 Writing draft report and arranging a presentation session on the draft report with Helvetas Bangladesh and collecting feedback on this report
 Finalizing evaluation report after incorporation of feedback and submitting to Helvetas Bangladesh
1.5 Duration of the study
The study will be started from 25 October 2020 and ended at 5 December 2020
1.6 Location of the baseline study
The study will be conducted at 14 unions of 3 sub districts under 3 districts. Details are as follows:

7
Table1: Study Locations

District Upazila Union


Baharmuhonia
Geodhara
Nishanbaria
Bagerhat Morrelganj
Khaulia
Morrelganj sadar
Baroikhali
Kapilmoni
Godaipur
Paikgacha
Raruli
Garoikhali
Khulna
Koyra sadar
Moharajpur
Koyra
Bagahali
Amadi

8
Chapter Two: Approach and Methodology of the Study

2.1 Introduction
In order to implement the tasks enshrined in the study objectives the methodology would consist of different quantitative tools and methods. The
methodology however would include the following step/components.
 Initial discussion with Helvetas Bangladesh and its local partner NGOs.
 Collection and review of literature and documents.
 Collection and analysis of secondary data.
 Collection of primary data.
 In designing the study tools and instruments (questionnaire, checklist).
 Compilation and processing of data generation of statistical outputs.
 Analysis and report preparation incorporating the findings and results of the study.
 Finalization of the report incorporating comments and suggestions from Helevetas Bangladesh.
Both qualitative and quantitative data from the study locations will be acquired through household questionnaire survey, Focus Group Discussion
(FGD), Key Informants Interview (KII) and consultations with stakeholder actors, LGI, Disaster Management Committee etc. at the study location.
2.2 Approach of the study
The BCAS team will be responsible to design and prepare the overall evaluation process using both qualitative and quantitative methods. The team of
experts will provide strategic and technical support to appointed filed team members, develop various quantitative and qualitative tools and determine the
methodologies that are holistic in nature so that they can provide lessons to the implementers. The experts will analyze the information and write the
evaluation report in collaboration with the evaluation team.
In the evaluation process, Helvetas Bangladesh country office, MEAL department and the project office can be included as extended team members to
provide assistance for preparing field visit plan and organizing the events as required by the evaluation team. The experts will improve enumerators’

9
skills and knowledge regarding data collection and review process through an orientation. Analysis would be made using the current familiar analysis
software like SPSS.
The study would need a participatory and multi-disciplinary approach of data collection and analysis to deeply understand the multi-dimensionality of
project effectiveness and sustainability as well as to develop appropriate strategies and actions for resilience amongst climate vulnerable communities in
the project area, food security and livelihood promotion, water and sanitation, hygiene, farming and fishing techniques, financial states, food security,
governance, job skill, job connectivity, gender and knowledge management of the poor and ultra-poor communities. The study would make for
triangulation of qualitative information and perspectives with quantitative data for understanding the effectiveness of project activities; its impacts on the
lives and livelihoods of the poor and marginal sections of the society including women and children; financial sustainability and effectiveness with value
for money analysis through financial auditing with the partners and human resources in effective project implementation, relevance of project activities
through participatory action research framework and integration of secondary data with primary data; integration of social data and perceptions with
impact and resilient interventions.
The study would be employed both qualitative and quantitative approaches and used primary and secondary data and information. Understanding the
project effectiveness and sustainability as well as to develop appropriate strategies and actions for resilience amongst climate vulnerable communities in
the project area, food security and livelihood promotion of the poor and ultra-poor communities, understanding the effectiveness of project activities; its
impacts on the lives and livelihoods of the poor and marginal sections of the society including women and children; financial sustainability and
effectiveness with value for money analysis through financial auditing, strength, weakness and human resources in effective project implementation,
relevance of project activities through participatory action research framework and integration of secondary data with primary data; integration of social
data and perceptions with impact and resilient interventions which would be carried out through analyzing available related data and information;
information on climate vulnerability, climate resilient practices, project management and administration, project substantive and technical
implementation, strength and weakness; risk management, project finances, human resource development, etc. through reviewing project documents,
project proposal and log frame, project activities monitoring and evaluation reports, baseline reports, project activities and financial progress reports etc.
Beside the literature review (The Panii Jibon proposal, The Logical Framework, Project activities guideline & work plan, Monitoring data at outcome
(KPI) at output level (activities), Various studies undertaken internally, Reports: monthly narrative reports, yearly annual reports, Audit report and project
monitoring database) as well as accumulation of secondary information, the study will accumulate primary data—both qualitative and quantitative from
the study locations through household questionnaire survey, PAR (participatory action research) and consultations with stakeholders actors,
small/marginal farmers, fisher folk, women, youth, minorities, persons with disability and entrepreneurs (including women), and socially excluded and
discriminated groups, elected representatives of Local Government Institutions (LGI) at villages and upazilas level, UDMC, UzMC, service providers
(livestock, agriculture, Cooperative dept. DPHE, DAE etc.
10
Apart from conducting survey for primary data, relevant participatory tools (Focused Group Discussion, Key Informant Interview, financial auditing and
consultation), best practice documentation/case studies will be used to capture perspectives of different stakeholders from village to upazila level.
Particular FGDs will be designed and used for villagers to analyze power and influence in relation to access and right to services and resources.
BCAS will prepare and conduct to design and prepare the overall evaluation process using both qualitative and quantitative methods. BCAS team leader
will provide strategic and technical support to the evaluation team appointed/selected by BCAS, develop various quantitative and qualitative tools and
determine the methodologies that are holistic in nature so that BCAS as an organization could do the evaluation performance. The BCAS experts/data
analysist will analyze the information and team leader/lead experts write the evaluation report in collaboration with the evaluation team.
In the evaluation process, Helvetas Bangladesh country office, MEAL Department and the project team would be included as extended team members to
take assistance for preparing field visit plan and organizing the events as required by the evaluation team. BCAS will improve enumerators’ skills and
knowledge regarding data collection and review process through an orientation and Inception Training. Data Analysts/ experts will be use the current
familiar analysis software like SPSS or MS Access.
2.2.1 Primary data collection and Consultations
Primary data about climate change and disaster impacts on water, sanitation, agriculture, fisheries, food and livelihoods, perspectives of vulnerable
communities, perspectives of degree of resilience, effective and relevance sustainability of project activities would be collected form project beneficiaries
and non-beneficiaries as control and different stakeholders as well as adaptation responses will be collected from the local communities and actors,
service providers including local government, DAE, livestock, UDMC, UzMC, fisheries, DPHE and NGOs through Participatory Action Research (PAR)
using various participatory research tools like village profiling, resource mapping and vulnerability assessment/matrix, resilience matrix, FGD, KII,
stakeholder analysis (Venn Diagram) and development of adaptation & Institutional response strategy. The target population for the Household Survey
(HHS) of this research are poor and extreme poor people as well as project beneficiaries and non-beneficiaries. The research would be made use of
probability sampling in order to select the respondents for investigation. This will help us to obtain the necessary data for the scenario synthesize with
minimum cost and time. This study will use structured questionnaires (SQ) as a quantitative tool for collecting data. The sample size will estimate to
ensure the representation of all the indicators set forth in the ToR. The sample size will determine using the following formula considering 95 percent
confidence level with 5 percent level of errors.
2.2.2 Sample Design and Sampling Methods
Appropriate sampling technique and right size of sample for the best estimation of the population characteristics are two important factors for designing
the sampling. Determination of representative sample size is a challenging issue. In most cases, previous information required to determine the sample

11
size particularly standard deviation of population is not available. The alternative way is to consider p = q = 0.50 that will allow maximum standard error
and also ensure maximum size of sample for specific requirements.
The sample size of the baseline study has been estimated in such a way that the obtained result of the study may be within 5 percent of the true value with
95 percent confidence. Therefore, the sample size for the baseline study can be determined by using the formula as follows:
z2.p.q.N
n=
e2 (N-1) + z2 p.q
Where,
N = Size of population,
n = Size of sample to be determined;
p = Proportion of the target population estimated to have a particular characteristics;
q = 1-p;
e = Acceptable error (precision);
z = Standard variate at a given confidence level.
If the estimated sample size is greater than 5% of the population size then the estimated sample may be adjusted by the following formula:
n
no= -----------
1+n/N
Considering all pros and & cons of using different areas of beneficiaries as population, it is found more appropriate to use the total number of populations
in the seven district/region sample size will be estimated by using the above formula as furnished below:
Overall number of Producer Group (PG) and Households are = 5000.
z2.p.q.N
Desired sample size n =
e2 (N-1) + z2 p.q

12
(1.96)2 x(..25) x (.5) x 5000
=
(.05)2 x (5000-1) + (1.96)2 x (..25) x (.5)
3.8416 x .13 x 5000
=
.
0025 x 4999 + 3.8416 x 0.13
0.50 x 5000
=
12.4975+0.50
2500.00
=
13.00
= 192.31, Say 192

Table: Household Sample distribution

Population size Sample size


Upazila Union Number of Number of PG PG member interview
PG members (HHs level)
Baharmuhonia 8 160 5
Geodhara 9 180 6
Nishanbaria 9 180 5
Morrelganj
Khaulia 8 160 5
Morrelganj sadar 7 140 6
Baroikhali 9 180 5
Paikgacha Kapilmoni 25 500 20

13
Godaipur 25 500 20
Raruli 25 500 20
Garoikhali 25 500 20
Koyra sadar 25 500 20
Moharajpur 25 500 20
Koyra
Bagahali 25 500 20
Amadi 25 500 20
Total 250 5000 192

2.2.3 Field Test of the Tools and Techniques


The developed tools and techniques will grounded in the study area (at least two unions based on different climatic disaster by the consultation with
Helvetas Bangladesh team) for field testing. The study team will conduct focus group discussion and household survey to receive the response of the
respondents. The questionnaire and checklists would be corrected considering the field test outputs. Finally, a sharing meeting with Helvetas officials at
Helvetas office will be conducted to finalize all the tools and techniques developed for this mid-term evaluation
2.2.4 Data Collection
2.2.4.1 Household Survey (HHS)
Questionnaire survey would be conducted with community people to explore in-depth impact and effectiveness of project activities, future direction for
resilient practices among project beneficiaries. Three teams consisted of two enumerators (one female and one male in each group) will carry out the
HHS for seven days.
2.2.4.2 Focus Group Discussion
A total of 18 FGD was proposed in the proposal but it will be increased and finally it was decided that the 24 FGDs will be conducted in the study areas.
Focus group discussions will be conducted with project beneficiaries, government agencies, LGIs, UDMC, UzMC, service providers, women, youth,
minorities, persons with disability, farmers, fisher folk in order to explore to project effectiveness, sustainability, and response issues. 24 FGDs will take
place in project areas. FGD checklist, guidance note would be developed by the consultation with Helvetas Bangladesh team.

14
Name of District Name of Upazila Name of Union Target Group Number
Baharmuhonia Women, WDMC 2
Geodhara Youth, Health Village Group 2
Nishanbaria Minorities, SMC 2
Bagerhat Persons with disability, 2
Morrelganj Khaulia
Mother’s Parliament
Morrelganj sadar Farmers, Masson 2
Fisher folk, Wash Budget 2
Baroikhali
Monitoring Club
Women, Youth, Service 2
Kapilmoni
Provider Association
Minorities, Persons with 2
Godaipur
Paikgacha disability
Fisher folk, Farmers, 2
Raruli
Vocational Trainee
Students (boys), students 2
Khulna Garoikhali
(girls)
Koyra sadar Women, Youth 2
Minorities, Persons with 2
Moharajpur
Koyra disability
Farmers, climate displaced 2
Bagahali
(seasonal migrant family)
Amadi Fisher folk, WDMC 2
Total 28

2.2.4.3 Key Informants Interview


A total of 28 KIIs was proposed in the proposal but it will increased and finally it is decided that 42 KIIs will be conducted with key stakeholders of the
target institutions (Helvetas Bangladesh, ICCCAD, DORP, BDPC, OKUP, LGI, local level government agency, UDMC, UzMC, service providers, SHG)
in order to explore the technical, financial and human resources sustainability, effectiveness of project activities in the project area.
Name of District Name of Upazila Name of Union Target Group Number
Bagerhat Morrelganj Baharmuhonia UDMC, Local Agribusiness 2

15
Name of District Name of Upazila Name of Union Target Group Number
Network
Geodhara WDMC, Entrepreneurs 2
WDMC, Sales and Collection 2
Nishanbaria
Center
Khaulia UDMC, SMC President 2
Union Standing Committee, 2
Morrelganj sadar
Agriculture Support Center
UDMC, Local Agribusiness 2
Baroikhali
Network
Kapilmoni WDMC, Entrepreneurs 2
WDMC, Sales and Collection 2
Godaipur
Paikgacha Center
Raruli UDMC, SMC President 2
Union Standing Committee, 2
Garoikhali
Agriculture Support Center
Khulna
UDMC, Local Agribusiness 2
Koyra sadar
Network
Koyra Moharajpur WDMC, Entrepreneurs 2
WDMC, Sales and Collection 2
Bagahali
Center
Amadi UDMC, SMC President 2
District DRRO, DPHE 2
Bagerhat UzDMC, DAE, DSS, 6
Morelganj
DoWCA, BWDB, NGO
District DRRO, DPHE 2
UzDMC, DAE, DSS, 6
Paikgacha
Khulna DoWCA, BWDB, NGO
UzDMC, DAE, DSS, 6
Koyra
DoWCA, BWDB, NGO
Planning Commission, 6
National MoEFCC, ICCAD, DORP,
OKUP, BDPC

16
Name of District Name of Upazila Name of Union Target Group Number
Total 54

2.2.4.4 Case studies/Best practice documentation


A total of 12 case studies/best practices documentation would be conducted in project area to explore best project management, project activities, resilient
institution etc. The list of case studies are given bellow:
Issue of case study Name of Union
Resilient water technology Baharmuhonia
Resilient Agriculture Geodhara
Climate responsive union (budget) Nishanbaria
Climate resilient health education (School) Khaulia
Resilient livelihoods (vocational training and
Kapilmoni
entrepreneurship)
Climate responsive WDMC Godaipur
Resilient sanitation Raruli
Resilient IGA Garoikhali
Success of WASH budget monitoring club Koyra sadar
Success of Village health group Moharajpur
Sales and Collection Center Bagahali
Climate responsive SMC Amadi

2.3 Household Survey Process


Questionnaire survey would be conducted with community people to explore in-depth the trends and effects of flood on livelihoods and food security,
with particular focus on how flood reshapes the livelihoods of the poor and marginalized section of the population in this area and also to understand
community needs and priority of forecast based early warning system, institutional response, social safety net issue. Three teams consisted of six
enumerators (one female and one male in each group) will carry out the HHS for twelve days. The enumerators will also be proportionately selected
among from the local community to give them a sense of ownership to the study. It will also help the study team to get easy access to the local
community and ensure quality of data and information. Household survey would be anchored using Kobbo Toolbox.

17
Data would be collected using a pretested structured questionnaire through Kobbo/QUALT/ODK by trained and experienced data field researchers.
Figure: KOBO Process

18
2.4 Data Processing and Analysis
Collected data would be processed and analyzed by the following ways:
1) Automating the data downloads. Included in this: a timer that will automatically pull new data submissions on a set schedule; a script to use ODK
Briefcase to pull data so that encrypted submissions can be decrypted; a way of ensuring non-English alphabets are saved in UTF-8 format properly;
saving all files in an acceptable format (.csv in my case) to a local or cloud (encrypted) server.
2) Automating data cleaning and data associations. Included in this: making sure labels are substituted for 1s, 2s, 3s, etc.; associating "repeat" data
with their parent keys; translating data results into multiple languages (based on the ODK form); flagging duplicates.

19
3) Automating data analysis. Included in this: setting up standard indicators to be calculated based on the collected data (such as age categories if
collecting age, or "time to complete questionnaire" based on start/end times).
4) Automating data visualization (maybe this is combined with #3 above). Included in this: loading clean data and visualizing indicators set up
through data analysis; ideally, this visualization is via a URL that can be accessed by appropriate stakeholders through #5.
5) Automating data dissemination. Included in this: having a website that people can log into to view visualized data, ideally with user management
capabilities to allow access to different dashboards by different stakeholders; or having a PDF report template set up that inserts new data
automatically so that reports can be created automatically.
2.5 Quality Control Measures
The study team will emphasize on achieving and maintaining the highest level of quality possible throughout the performance of the evaluation research. All
collected, accepted and analyzed data in this research will undergone specific quality control assessment. All data will critically assess during and after
collection to ensure the quality of the data. The quality control would be ensured through:
 Maintain length of time to finish each questionnaire
 Collecting GPS from each location
 Re-interviewing 5% respondents through phone
 Collecting photo evidence from respondents
2.6 Follow –up data collection and provide on the spot guidance to the team during field survey
The Field Researchers will collect data using the questionnaire while the Field Coordinator will provide spot guidance to the field researchers; and
carryout spot-checking and monitoring of the field interviews. Before the field coordinator and field researchers will be deployed in the filed for data
collection, they will be briefed thoroughly on the purpose of the survey and trained on interviewing skills and how to conduct the interviews. Guided by
the sampling plan and respondent list, the interviewers locate the respondents, conduct the interviews, and check the completed questionnaires after the
interview.
Highly qualified and skilled supervisors and field investigators will collect the data. Members of the research team will be formed from social science
backgrounds. A training program will be organized to ensure that they understand the approaches and rationale of the study. The training program will
include basic concept of research, techniques of data collection, recording of qualitative data, and writing up of field notes. Field Coordinator and Field

20
Researchers will be involved with field supervision and data collection. All field data will be edited immediately after the completion of fieldwork. The
team leader will check and guide coding of data before entering them into the computer. The team leader and research associate independently interpret
the quantitative data to ensure a double check.
2.7 Develop database in SPSS and code manual
A data entry system will be designed under SPSS database environment to facilitate the data entry work. The data entry form i.e. user interface will be
designed to confirm the double entry method. So that during data entry the operator’s error through data entry could be minimized. The data entry screen
will be in the way that after the completion entry of each record, the system will ask for confirmation before to store the record to the data table and then
move to ready for new entry. All the entered data will be checked to identify if there are any deviation. A draft data entry sheet will be produced for
comment and verification of statistical data analyst.
2.8 Data Processing and Analysis
The quantitative data will be analyzed through statistical analysis. The quantitative data will be processed through SPSS Programme. Tools for data entry
and analysis as well as the dummy tables will prepare on the basis of indicators required. Qualitative data will crossed check against findings from
different sources and triangulated. The study team will explore the possible linkages and relations between different categories of data.
For quantitative data analysis following analysis will be follows:
(i) One-sample t-test:
In testing the null hypothesis that the population mean is equal to a specified value , we can use the statistic

Where X the sample mean, s is the sample standard deviation of the sample and n is the sample size. The degrees of freedom used in this test are n-1.
(ii) pair t-test:
The two sample sizes (that is, the number, n, of participants of each group) are equal, and then pair t-test can be used comparing two sample means as:
The t statistic to test whether the means are different can be calculated as follow:

21
Where,

Here 2is the grand standard deviation (or pooled standard deviation), 1= group one, 2= group two
(iii) Chi-square test
It is a test of independence assesses whether paired observations on two variables, expressed in a contingency table, are independent of each other. The
value of the test-statistic is

Where,
X2= Pearson’s cumulative test statistic, which asymptotically approaches a X 2 distribution.
O2= an observed frequency;
Ea= the number of cells in the table
The following approaches would be applied to analyze qualitative information collected from field research:
 Narrative Analysis would be used to analyze FGD text that will come from variety of Focus Group Discussion transcripts, resource maps, village
profiling, historical time line, seasonal calendar, vulnerability matrix etc. Narrative analysis will involve reformulating stories presented by people
in different context and based on their different experiences.

22
 Grounded Theory as well as analytic induction method would be applied in analyzing qualitative data to develop causal explanations of a
phenomenon from vulnerability analysis, natural asset assessment, and land use analysis.
 Conversation Analysis approach would be deployed to analyze Key Informants Interview conducted with different key informants. A key
concept in this analysis is the principle of people taking turns in conversation.
QDA Miner Lite would be used in organizing the data, assigning the coding and looking for connections of qualitative data.
2.9 Report Preparation, triangulation and Finalization
In this phase, the collected information (both qualitative and quantitative) would be analyzed and drafted report by triangulating with secondary
information, primary information collected through HHS and validated at local level consultation with LGI, government agency through workshop. The
draft report would be shared with Helevetas Bangladesh after incorporating.

23
Chapter Three: Time Frame and Team composition
3.1 Time bound Rollout Plan
The study will be accomplished in 2 months (25 October 2020 to 5 December 2020). A brief programme strategy with time schedule is described at
following table.
Time frame and work schedule

Key Activities # days Place Responsibility Time


Document review and analysis, 5 days At BCAS Team Leader and 1st week
developing study tools and Experts
drafting inception report
Orientation of associates 1 day At BCAS Team Leader, Experts 2ndweek
and Enumerator
Field testing of study tools 1 day Study area Team Leader, Experts 2ndweek
and Enumerator
Field visits for FGD & KII 7 days Study area Team Leader, Experts 2nd& 3rd week
and Enumerator
Data Collection through 7 days Study area Field Coordinator & 2nd& 3rd week
questionnaire survey Enumerators
Data analysis 7 days At BCAS Data analyst 4th & 5th week
Drafting report 10 days At BCAS Team Leader and 5th, 6th & 7th
Experts week
Circulation draft report to 1 day At BCAS Team Leader 7th week
Helvetas Bangladesh
Feedback accommodation and 3 days At BCASs Team Leader, Experts 7th week
report finalization
Final report 1 day Helvetas Team Leader 8th week
Office
Total Working Day for 35 days
Consultants.

24
Error! Not a valid link.

25
3.3 Work Schedule for the study

Month -1 Month -2
Description of the activities
W1 W2 W3 W4 W5 W6 W7
Signing of the Contract
Collecting and reviewing all project documents as well as
relevant other documents
Designing qualitative and quantitative data collection tools,
sampling methods, field survey schedules and division of
tasks Questionnaire for HH survey and FGD, KII checklist
Mobilize Field Survey Team, impart training on the
questionnaire, and conduct pre-testing using the
questionnaire
Deploy field study team to carry out questionnaire survey,
FGDs, KIIs, SWOT analysis, Financial Auditing, case
study, knowledge product analysis, validation workshop.
Collecting data and information from different levels and
stakeholders including the project beneficiaries and groups,
project and IRB staffs, relevant government officials,
government line departments, Upazila and Union Parishad
representatives etc. through carry out questionnaire survey,
FGDs, KIIs,analysis, Financial Auditing, case study,
knowledge product analysis, validation workshop.
Designing/developing data entry template using suitable
software (SPSS) as well as data cross checking/validation of
methodology
Processing field data collection and analyzing the data
Writing draft report and arranging a presentation session on
the draft report with Helvetas Bangladesh and collecting
feedback on this report.
Finalizing evaluation report after incorporation of feedback
and submitting to Helvetas Bangladesh

Data collection Plan


Date Activities Location
09.11.2020 Travel (Dhaka-Paikgacha)
11.11.2020 Training and field testing on study tools Paikgacha
11.11.2020 HHS, FGD, KII & Case study Paikgacha and Koyra
10.11.2020 HHS, FGD, KII & Case study Paikgacha and Koyra
11.11.2020 HHS, FGD, KII & Case study Paikgacha and Koyra
12.11.2020 Travel to Morelganj and KII Paikgacha and Koyra
13.11.2020 HHS, FGD, KII & Case study Paikgacha and Koyra
14.11.2020 Travel to Morrelganj Bagerhat
15.11.2020 HHS, FGD, KII & Case study Morrelganj
16.11.2020 HHS, FGD, KII & Case study Morrelganj

26
3.2 Study Team Composition and Relevancy:
The study will be implemented by a team of experts of 4 personnel. Evaluation team have excellent
knowledge and skills in CC, DRR, livelihoods and food security, CC & gender, participatory
research, advocacy and capacity building, institutional development, good knowledge and
experience of working with the poor, NGO, multi-disciplinary stake holders and respectful towards
the dignity and honour of the extreme poor: BCAS proposed team members are the following:
 Study Advisor: Dr. Atiq Rahman
 Team Leader-Dr. Dwijen Mallick
 CC, DRR & Livelihood Expert-Muhammad Abdur Rahaman
 CC & Gender Expert-Olena Reza
 Water & Sanitation Expert-Sawrav Barua
 Knowledge Management Expert-Khandakar Mainuddin
 Data Analyst-Mynul Islam
 Study Coordinator-Mohammad Belayet Hossain
 Field Researches (6) – Noor Jahan, SanzidaMarzia, Md. Golam Mustofa, Md. Tofayel
ahmed, Mr. Bidhan, Md. Farhad Hossain, Md. Morshed, Md. Jahangir, Md. Nazrul islam.

Dr. Atik Rahman (Study Guide the study team member and editing the report
Advisor)
Dr. Dwijen Mallick (Lead The Team Leader will be responsible for team building and preparation of
Researcher & Food guidelines and study tools, overall supervision and communication functions
Security expert) in relation to assessment, liaison with IRB and partners.
Olena Reza (Climate CC & Gender expert will responsible for look after the study from the lens of
change & Gender expert) gender perspective related to study, developing guiding principles related to
gender parameters, input support in guideline and study tools development,
information collection through FGD & KII, data analysis and report
preparation
Muhammad Abdur He will responsible for look after the whole CC & DRR issues in the study,
Rahman (CC, DRR & impact of climate change and resilience issues, developing guiding principles
Livelihood expert) related to CC, DRR & Livelihoods parameters, input support in guideline and
study tools development, information collection through FGD & KII, data
analysis and report preparation
Sawrav Barua( Water & He will work on WASH, Information collection and reporting
Sanitation Expert)
Khandakar Mainuddin Literature review, tools development and reporting
(K.Management Expert)
Md. Belayet Hussain Responsible for supervision of Field data and arrange FGD, PVA session.
(Field Coordinator) Maintain and progress sharing with the experts. Also responsible for quality
assurance of the study.
Field Researchers (Noor Associates will responsible for data collection, data profiling, data sorting,
Jahan, SanzidaMarzia, data cleaning, data analysis, drafting report in collaboration with team leader
Md. Golam Mustofa,) and experts, FGD & KII scheduling etc.
Mynul Isalm (Data Data entry operator responsible for data entry on household survey
Analyst) questionnaire

27
28

View publication stats

You might also like