LHW Balochistan Report
LHW Balochistan Report
LHW Balochistan Report
Balochistan
Survey Report
1. Summary of Results
2. Management Review
3. Systems Review
4. Financial and Economic Analysis
5. Quantitative Survey Report
6. Punjab Survey Report
7. Sindh Survey Report
8. NWFP Survey Report
9. Balochistan Survey Report
10. AJK/FANA Survey Report
11. Lady Health Worker Study on Socio-Economic Benefits and Experiences
This evaluation of the National Programme for Family Planning and Primary Health Care was
undertaken by Oxford Policy Management UK and Save the Children Fund, and funded by
the Canadian International Development Agency, through a World Bank Trust Fund.
The core evaluation team included: Simon Hunt (Team Leader); Shafique Arif (Survey
Manager); Dr Imtiaz Malang, Dr Tehzeeb Zulfiqar, Philippa Wood (Management and
Systems Review); Rana Asad Amin, Mark Essex, Georgina Rawle (Financial Experts); Sarah
Javaid, Emily Wylde (Qualitative Research); Patrick Ward (Technical Team Leader); Alex
Hurrell and Luca Pellerano (Survey Design and Analysis); Juan Munoz (Sample Design);
Dr Laila Salim (Quantitative Survey Design); Iftikhar Cheema, Alamgir Morthali (Data Entry
and Data Analysis). The design and analysis of the Quantitative Surveys was managed by
Alex Hurrell and Patrick Ward. Other members of the OPM evaluation team assisted in the
design of the survey and questionnaires, particularly Simon Hunt and Juan Munoz, Luca
Pellerano, Shafique Arif, Laila Salim, Tehzeeb Zulfiqar and Philippa Wood. A team of
analysts worked on the analysis and report writing. They were: Shafique Arif, Luca Pellerano,
Alex Hurrell, Ramlatu Attah, Sophie Witter, Tehzeeb Zulfiqar, Phillipa Wood and Iftikhar
Cheema. Dr Salim Sadruddin and Dr Aman ullah Khan (Save the Children Fund) assisted
the Quantitative team and contributed to the peer review of the reports. Mr Ejaz Rahim was
involved in an advisory capacity and peer review. The team is also grateful for the external
peer review provided by Dr Franklin White.
A large team of supervisors, enumerators and others worked on the survey fieldwork. They
were: Muhammad Shafique Arif (Survey Manager); Abdul Rashid Bhatti (Survey Coordinator);
Amir Khan (Survey Coordinator); Rubina Akbar (Survey Coordinator); Sabeena Gul (Survey
Coordinator); Sadia Sharif (Office Coordinator); Kamran Bhutta (Provincial Coordinator); Tufail
Laghari (Provincial Coordinator); Adeela Ahmad (Editor); Ayesha Ashfaq (Editor); Kashif Amin
(Editor); Lubna Rauf (Editor); Madeeha Ali (Editor); Sabiha Masud (Editor); Anila Yasmin
(Supervisor); Aysha Noreen (Supervisor); Azra Jabeen (Supervisor); Benazir Bibi (Supervisor);
Fakhra Ahmed (Supervisor); Hamida Narejo (Supervisor); Humera Soomro (Supervisor);
Rabia Basri (Supervisor); Raj Bibi (Supervisor); Saira Memon (Supervisor); Shazia Batool
(Supervisor); Shazia Qudrat (Supervisor); Zubaida Baloch (Supervisor); Abdul Wadood
(Logistics i/c); Aftab Mangi (Logistics i/c); Ahmed Hassan (Logistics i/c); Azam Hussain
(Logistics i/c); Barkat Shah Kakar (Logistics i/c); Imdad Ullah (Logistics i/c); Khizar Hussain
(Logistics i/c); Mohammad Qasim Hasni (Logistics i/c); Mohsin-ud-din Muhammad (Logistics
i/c); Rashid Unar (Logistics i/c); Wahid Marri (Logistics i/c); Waseem Nawaz (Logistics i/c);
Zahoor Ahmad (Logistics i/c); Abida Bibi (Interviewer); Anila Gohar (Interviewer); Asia Abro
(Interviewer); Asma Ahmad (Interviewer); Farah Deeba (Interviewer); Gul-e-Rana (Interviewer);
Haleema Baloch (Interviewer); Iram Jilani (Interviewer); Iram Latif (Interviewer); Jamal Khatoon
(Interviewer); Nafees Manzoor (Interviewer); Naheed Mustafa (Interviewer); Nasreen Gul
(Interviewer); Naureen Anjum (Interviewer); Nelofar Hassan (Interviewer); Noushin
(Interviewer); Rabia Bashir (Interviewer); Rabia Rashid (Interviewer); Rashida Baloch
(Interviewer) Rukhsana Jamali (Interviewer); Salma Aziz (Interviewer); Samina Abbas
(Interviewer); Samina Bibi (Interviewer); Shabana Hingoro (Interviewer); Shazia Malik
(Interviewer); Shumaila (Interviewer). The evaluation team thank all of them for the hard work
put into the survey.
The cooperation and assistance provided by staff members of the National Programme for
Family Planning and Primary Health Care throughout the country, including the Lady Health
Workers and their supervisors, is also gratefully acknowledged, as is the cooperation of the
householders, community members and health facility staff interviewed.
i
LHWP – Balochistan Survey Report
OPM evaluation team also want to thank the peer reviewers designated by the National
Programme for Family Planning and Primary Health Care who reviewed all the reports: The
Peer reviewers included:
ii
Executive summary
The Lady Health Worker Programme (LHWP) is an increasingly important element in the
Government of Pakistan’s plan to improve the health status of women and children in
villages and poor urban areas. The Programme has expanded substantially since it was
founded in the early 1990s. Over 80 million people now have access to services from a Lady
Health Worker (LHW) in their community.
The third independent programme evaluation (the 3rd Evaluation) in 2000 showed that these
services have a positive impact on the health of the poor, particularly women and children. It
showed that through their work, LHWs are contributing directly to improved hygiene and
higher levels of contraceptive use, iron supplementation and vaccination amongst their
clients. In 2008, over 90 percent of communities reported that the LHW has generally
improved peoples lives and that there have been improvements in health due to LHWs work.
This report comprises part of the 4th Evaluation. Specifically, it reports key findings of the
quantitative survey on the performance of the LHWP in Balochistan. Where appropriate,
these findings are compared nationally and with the results of the 3rd Evaluation (2000).
Service delivery
In terms of LHWP service delivery, LHWs in Balochistan are working harder than they were
in 2000. Nationally, they report an average of 30 hours per week of work, compared with 20
in 2000, although an appreciable part of this increase is accounted for by increased activity
on National Immunisation Days (NIDs).
In Balochistan, LHWs are providing many services to a higher proportion of their clients than
they were in 2000. The proportion of eligible clients receiving services provided by LHWs
varies according to the type of service. The LHW performance score, which measures the
coverage rate of preventive and promotive services, increased from 42 percent to 52 percent
nationally, and by a greater amount in Balochistan from 31 percent to 54 percent. Over a half
of the LHWs’ clients in Balochistan are now receiving the preventive and promotive services
for which they are eligible.
In delivering these services the LHW should be visiting all of her registered households at
least once every two months. In Balochistan this would mean visiting an average of 10
households per week, as she has on average, 86 registered households. If she was following
the Programme’s norm of visiting five households per day, for six days a week, she would
cover all of her registered households in three weeks. On an average Lady Health Worker in
Balochistan is actually visiting 15 households per week – the lowest level across the country.
Moreover, 19 percent of households in Balochistan had not received a visit in the past three
months.
The results from the survey showed that overall 37 percent of LHWs in Balochistan have
worked on National Immunisation Days (NIDs) for the EPI Programme, in the past three
iii
LHWP – Balochistan Survey Report
months, for an average of nine days, of which 68 percent of these worked outside of their
catchment area. Some 95 percent of those LHWs working on NIDs in Balochistan received
extra payment.
In Balochistan 17 percent of LHWs are High Performers and 24 percent are Poor Performers
compared to 25 percent in each category nationwide.
Statistical analysis was used to identify the factors associated with variations in LHW
performance nationally. The analysis identified a range of factors which help to explain these
variations, some of which are within the control of the LHWP and which therefore imply some
clear policy implications. Specifically, efforts should be made to:
The improvements have not been uniform, with knowledge improving in some topic areas but
not in others. A minority of LHWs continue to lack basic clinical knowledge. The low scores
iv
and lack of in-depth knowledge of this minority of LHWs could have serious clinical
consequences as well as undermining the professional reputation of the programme.
The Programme needs to continue to develop its on-going system of knowledge assessment
and reinforcement for all LHWs and LHSs. It has been shown that education, effective
training and supervision and good district management practices are important factors in
determining LHW levels of knowledge. These results also have clear policy implications for
the programme. Specifically, efforts should be made to:
LHWs and supervisors should expect to receive their pay monthly in full and on time. Only
Balochistan 72 percent of LHWs had received their pay within the past three months. This is
a substantial increase in the level of such late payments compared with 2000, against
improvements nationwide, and so is a cause for concern.
Medical supplies and equipment are essential in ensuring an effective community health
service and ensuring the credibility of the LHW. The previous evaluation found a substantial
problem with stock outs, with many LHWs out of stock of medicines for a significant period.
The 4th Evaluation has shown there remains a significant problem, with many LHWs having
key medicines out of stock for two months or more. Balochistan is the best performing
province in terms of keeping LHWs stocked up.
Looking ahead
The Programme has expanded substantially since 2000, at the same time as facing the
challenges due to decentralisation. As it has expanded, it has penetrated into more rural and
less advantaged areas, although it is still not reaching some of the most disadvantaged
areas.
At the same time, the Programme has managed to institute a number of improvements that
were identified as important in the previous evaluation. It has improved supervision and has
v
LHWP – Balochistan Survey Report
increased average levels of knowledge. The level of service delivery has increased. These
changes must all be recognised as significant achievements.
However, there remain a group of underperforming LHWs, whose working practices must be
further improved, and important gaps in LHWs’ knowledge. There remain also significant
failures in supply systems, both in medicines and equipment. These issues must be further
addressed going forwards.
vi
Table of contents
Acknowledgements ................................................................................................................... i
Executive summary ..................................................................................................................iii
List of tables and figures ......................................................................................................... ix
Abbreviations .......................................................................................................................... xi
1 Evaluating the Lady Health Worker Programme .......................................................... 1
1.1 Background ............................................................................................................ 1
1.2 Lady Health Worker Programme evaluation ........................................................... 1
1.3 Characteristics of Lady Health Workers ................................................................. 2
1.4 Key points ............................................................................................................... 5
2 Providing services at the doorstep ............................................................................... 7
2.1 Levels of service delivery ....................................................................................... 7
2.2 Delivery of curative services ................................................................................... 8
2.3 Activities in the community ..................................................................................... 9
2.4 Referral to health facilities .................................................................................... 10
2.5 Contribution to National Immunisation Days (NIDS)............................................. 11
2.6 Key points ............................................................................................................. 13
3 Levels of performance ................................................................................................ 15
3.1 Performance of Lady Health Workers in service delivery ..................................... 15
3.2 Explaining high performance ................................................................................ 16
3.3 Key points ............................................................................................................. 17
4 The Lady Health Worker workload ............................................................................. 19
4.1 Client registration .................................................................................................. 19
4.2 Time spent working .............................................................................................. 20
4.3 Household visits made and clients seen............................................................... 22
4.4 Taking on additional paid work ............................................................................. 24
4.5 Key points ............................................................................................................. 24
5 Knowledge, skills and training of Lady Health Workers and their supervisors ........... 25
5.1 The knowledge test .............................................................................................. 25
5.2 Improving knowledge through training .................................................................. 27
5.3 Explaining LHW knowledge levels ........................................................................ 28
5.4 Key points ............................................................................................................. 30
6 Supervision of Lady Health Workers .......................................................................... 31
6.1 Managing performance through supervision ........................................................ 31
6.2 Supervision of Lady Health Workers .................................................................... 31
6.3 Transportation ...................................................................................................... 33
6.4 Key points ............................................................................................................. 34
7 Programme salary payment and medical supply systems ......................................... 35
7.1 Performance of the pay system ............................................................................ 35
7.2 Supply of medicines and equipment ..................................................................... 35
vii
LHWP – Balochistan Survey Report
viii
List of tables and figures
Table 2.1 Consulting the Lady Health Worker for illness or injury, by province ................ 9
Table 2.2 Comparison on LHW reports on referrals to health facilities .......................... 11
Table 5.1 Percentage of LHW training that was provided by at least one female trainer27
Table 5.2 Type of refresher training received by LHW in the previous year, by province28
Table 7.1 Proportion of Lady Heath Workers receiving less salary than expected ........ 35
Table 7.2 Percentage of LHWs with stock outs for more than two months .................... 36
Table A.1 Sample breakdown by unit of observation ...................................................... 41
Table B.1 Demographic and educational characteristics of Lady Health Workers ......... 43
Table C.1 Lady Health Workers preventive and promotive services by province ........... 46
Table C.2 Lady Health Workers participation in National Immunisation Days (NIDS) .... 47
Table E.1 Different levels of performance amongst Lady Health Workers ..................... 51
Table F.1 Number of households and persons registered by Lady Health Workers ...... 53
Table F.2 Number of hours Lady Health Workers worked last week by type of activity . 54
Table F.3 Days worked by Lady Health Workers during last week ................................. 54
Table F.4 Number of household visits made by the LHW and number of clients seen
during the past week as reported by the client ............................................... 56
Table G.1 Scoring for general knowledge section of the knowledge test ........................ 57
Table G.2 Scoring for case-based section of the knowledge test ................................... 58
Table H.1 The knowledge test-general knowledge section, percentage of correct
answers given by LHWs, nationally and in Balochistan .................................. 61
Table H.2 The knowledge test-case based questions, percentage of correct answers
given by LHWs, nationally and in Balochistan ................................................ 62
Table I.1 Training Received by Lady Health Workers ................................................... 66
Table J.1 Supervision of Lady Health Workers .............................................................. 67
Table K.1 Lady Health Worker work planning and reporting ........................................... 69
Table L.1 Lady Health Worker stock of medicines, nationwide ...................................... 71
Table L.2 Percentage of Lady Health Workers with functional equipment and
administrative materials .................................................................................. 71
Figure 1.1 Percentage of LHWs who have replaced an LHW in their catchment area ...... 3
Figure 1.2 Percentage of LHWs serving their original catchment area .............................. 4
Figure 1.3 Percentage of LHWs with the use of a mobile phone, by province .................. 4
Figure 2.1 Lady Health Workers average coverage of preventive and promotive services
to eligible individuals (performance score) ....................................................... 8
Figure 2.2 Activity and meetings of women’s health committees, by province ................ 10
Figure 2.3 Place of referral of last acute case by LHW in Balochistan ............................ 11
Figure 2.4 Participation of LHWs in NIDS in the past three months ................................ 12
Figure 3.1 Comparing Lady Health Worker provision of service by performance category
between 2000 and 2008 ................................................................................. 15
Figure 3.2 Proportion of Balochistan Lady Health Workers in each performance category16
Figure 4.1 Average number of persons registered with the LHWs .................................. 19
ix
LHWP – Balochistan Survey Report
Figure 4.2 Comparison of the number of hours worked last week by LHWs ................... 20
Figure 4.3 Number of days worked by the LHW in the previous week, by province ........ 21
Figure 4.4 Allocation of work time by Lady Health Workers in Balochistan ..................... 22
Figure 4.5 Average number of household visits made last week by Lady Health Worker23
Figure 4.6 Average number of clients seen last week by Lady Health Worker ................ 23
Figure 4.7 Proportion of Lady Health Workers with another paid job .............................. 24
Figure 5.1 Knowledge score for Lady Health Workers (2000 and 2008) ......................... 26
Figure 5.2 Percentage LHWs who have received on the job training in the past year and
training at their last monthly meeting, by province .......................................... 28
Figure 6.1 Percentage of Lady Health Workers visited by supervisor in the past month for
supervision...................................................................................................... 32
Figure 6.2 Percentage of LHWs who reported the LHS using her checklist in her previous
supervision visit .............................................................................................. 32
Figure 6.3 Percentage of Lady Health Workers who have attended the monthly meeting
at their health facility in the past month .......................................................... 33
Figure 7.1 Percentage of LHWs paid within the past three months ................................. 35
x
Abbreviations
xi
Evaluating the Lady Health Worker Programme
1.1 Background
The Lady Health Worker Programme (LHWP) is an important element in the Government of
Pakistan’s plan to raise the health status of women and children in rural villages and poor
urban areas. The Programme was launched in April 1994 as a Federal development
programme funded by the Ministry of Health (MoH), and implemented by both the MoH and
the provincial Departments of Health. The Lady Health Worker Programme (LHWP) has, with
increased funding, delivered more services in the past five years. Since the previous
evaluation in 2000, the Programme has expanded from 38,000 LHWs to 90,000 Lady Health
Workers (LHWs), only 10,000 short of the target of 100,000. The LHWs are now an
occupational group that is recognized by the community for the services that they are able to
deliver. The organizational structure and service delivery model has remained the same.
The main goal of the programme was to establish a primary health care service:
• Characteristics of LHWs;
• The range and level of preventive, promotive, curative and referral services provided
by the LHW;
• Differences between high performing and poor performing LHWs;
• Activities of the LHW including hours of work and the number of registered clients;
• Knowledge and skills levels that the LHWs bring to their jobs; and
• Quality of the organisational support received by the LHW.
1
This report is one of a series of ten reports providing the results of the evaluation. Provincial reports have been
written for Punjab and ICT, NWFP, AJK/FANA, Sindh and Balochistan. FATA was not able to be included in the
survey due to security concerns for the field workers. In addition there are five national level reports: the Final
Report which summaries the key findings, the Quantitative Survey Report providing an extensive analysis of the
quantitative results, the Financial and Economic Analysis presenting costs and spending patterns of the LHWP,
the Management and Systems Review, and the Study of the Lady Health Worker, Socio-Economic Benefits and
Experience.
1
LHWP – Balochistan Survey Report
This information should support programme managers in Balochistan and at the Federal
level to identify initiatives to improve the quality and level of service delivery.
Note that two districts in NWFP and all seven districts in FATA were excluded from the
sample frame in 2008 due to high levels of insecurity. This has implications for the
comparability of the NWFP results with the previous evaluation. Furthermore, in addition to
the nine districts in FATA and NWFP that were excluded from the sample frame, some of the
selected districts were subsequently found to be insecure and therefore had to be dropped
from the survey. In NWFP, three of the 12 sampled districts (Lakki, Karak and Dir Lower) and
two served and two unserved FLCF clusters in the Malakand district could not be surveyed
due to insecurity. These insecure areas were not replaced because this could have
introduced bias.2
The implication of this is that the survey is representative of all areas in Pakistan that were
secure at the time of the fieldwork. In contrast, the 3rd Evaluation was representative of all
Pakistan, because the whole country was accessible to field teams in 2000. This needs to
taken into account when comparing results from the two surveys. Particular care needs to be
taken when comparing NWFP/FATA estimates from 2000 with the NWFP 2008 estimates,
which exclude FATA completely and are only representative of those parts of NWFP that
were secure enough to be accessible at the time of the survey.
LHWs should be between twenty and fifty years old, when recruited, though if married,
eighteen and nineteen-year-olds are acceptable. Only 1 percent of LHWs were under twenty
years old at the time of the survey.
In Balochistan, LHWs tend to be younger than the national average with 33 percent under
age 25, compared to 14 percent nationally. The Programme prefers LHWs to be married and
58 percent of the LHWs in Balochistan meet this criterion. This is lower than the national
average of 66 percent (Annex Table B.1). The assumption is that married LHWs are more
likely to have gathered knowledge and skills from personal experience, particularly with
regard to family planning practices and child and maternal health.
2
See Quantitative Survey Report for more information.
3
See Quantitative Survey Report for more information.
2
Evaluating the Lady Health Worker Programme
LHWs should be educated to at least the eighth class, though it is preferable for them to be
matriculated. All Lady Health Workers in Balochistan report having an education of at least
an eight class pass and 70 percent have class ten or above. Sixty two per cent of LHWs in
Balochistan could confirm class achievement through showing their school certificate.
The vast majority of LHWs live in the village/mohalla in which they work, as required by
Programme standards. In Balochistan 2 percent are non-resident, in line with the national
average. LHWs are very much part of the community they work in. In Balochistan 83 percent
of the LHWs were born within the community and a further 16 percent have been resident for
more than five years (Annex Table B.1). The Programme in Balochistan has been successful
in ensuring that the vast majority of LHWs and their supervisors meet the educational, age
and residency criteria.
Due to staff turnover, villages are starting to have a second generation of Lady Health
Workers. In Balochistan, 15 percent of LHWs are currently working in a catchment area that
was already being served by the Programme before they took over (Figure 1.1). This
compares to 29 percent nationally.
LHWs tend not to move from their village, particularly in Balochistan (Figure 1.2). Some 96
percent of serving LHWs in Balochistan are still serving their original catchment area.
50
Percentage of LHWs
40
30
20
10
0
Punjab/IC Balochist
Sindh NWFP AJK/FANA
T an
Percentage replaced 30 26 30 15 37
an LHW
3
LHWP – Balochistan Survey Report
100
Percentage of LHWs
90
80
70
60
50
Punjab/I Balochist
Sindh NWFP AJK/FANA
CT an
Percentage serving the 86 86 91 96 86
same catchment area
Access to a mobile phone could potentially enable the LHW to strengthen the link between
the community and health care providers, for example by facilitating communication between
the LHW and health facilities in regard to referral cases. In Balochistan, only 36 percent of
LHWs have use of a mobile phone, compared to 79 percent nationally (Figure 1.3). Many of
these have shared access with their husband or another family member.
Figure 1.3 Percentage of LHWs with the use of a mobile phone, by province
100
80
Percentage of LHWs
60
40
20
0
Balochista
Punjab Sindh NWFP AJK/FANA
n
Access to mobile 85 62 82 36 74
phone
4
Evaluating the Lady Health Worker Programme
5
Providing services at the doorstep
Overall there has been some increase in the level service provision in all provinces,5
although variations exist between them. The overall rate of LHW service provision, as
assessed by the percentage of eligible individuals receiving services from LHW, has
increased in Balochistan, from 31 to 54 percent (when considering all LHWs). However,
comparing provinces there is variation, with Sindh and Punjab/ICT having the lowest
performing LHWs on average on this measure. This contrasts with 2000, when Balochistan
was singled out as worst performing province (Figure 2.1).6 However, as well as the rate of
LHW service delivery, which is what is being measured here, the total number of households
registered and clients served is also important. Figure 4.1 and Figure 4.5 in Section 4 below
show that in both these two measures Punjab/ICT LHWs are the most active and
Balochistan LHWs the least.
4
See the Quantitative Survey Report for information on the impact of the LHW on health outcomes.
5
‘Province’ is used throughout the Report to refer to both Provinces and Federally Administrated Areas.
6
See Annex C: Service delivery of Lady Health Workers, by province.
7
LHWP – Balochistan Survey Report
Percentage of eligible individuals receivin
100
services from LHW 80
60
40
20
0
Balochista
Punjab Sindh NWFP AJK/FANA
n
2000/01 42 40 47 31 52
2008 53 50 54 54 58
Similarly, provincial variations exist in the type of service provided. For example, 73 percent
of households registered with the LHW in Balochistan reported that the LHW has talked to
them at some point about ways to improve the cleanliness of drinking water. . The survey
also revealed that 68 percent of currently married women aged 15-49 in Balochistan, who
are current users of modern contraceptives, were supplied by the LHW.
The analysis of what factors can help increase LHW performance is presented in Chapter 3.
Across the board, the main reason why LHWs were not consulted – for children under five, at
least – was that they felt that consultation was not necessary. A fifth felt that the LHW was
not available or was not helpful, down from 37 percent in 2000. However, this is a problem
that better supervision and training ought to be able to address. When the lack of medicines
is added to this, over a third of the reasons given for not taking up the service are due to
factors that the programme should be able to improve in order to increase the uptake of
curative services.
When the LHW is consulted, she usually provides the expected ‘first contact’ service. In most
of the cases where the LHW was consulted for children under five with diarrhoea or
respiratory infections, she was the first service provider consulted.
Some 22 percent of mothers with children under five, consulted their LHW about a
respiratory infection in the past fortnight, compared to 18 percent in 2000. In the case of
8
Providing services at the doorstep
diarrhoea, the level of consultation was slightly lower, although there was a similar slight
improvement since 2000. Given that there are a number of other sources of care available,
this level of use indicates some confidence in the LHW on behalf of the households served.
As would be expected, female members of a household are more likely than males to consult
with the LHWs.
As found in the 3rd Evaluation, curative services remain an important part of the LHWs’ work.
Treatment of fever and diarrhoea were the most commonly reported activities (excluding
‘other’).
Table 2.1 Consulting the Lady Health Worker for illness or injury, by
province
LHWs were also asked to report on the last emergency case seen – that is, the last case that
they saw who required immediate referral to a health facility or hospital. Throughout the
country, 35 percent had never seen such a case, up from 20 percent in 2000. This might
reflect increased access to other providers in emergencies. For those who had seen an
emergency case, complications of delivery and pregnancy together with severe dehydration,
were the most common. This may reflect the community’s awareness of her role and
services.
A small proportion of LHWs appear to be charging a consultation fee to see sick children.
This is against Programme policy. The only provision for which charges are permitted is for
oral contraceptive pills and for condoms. Nationally, respondents stated that they paid the
LHW in 9 percent of consultations for diarrhoea.
In the 4th Evaluation, Balochistan has 92 percent of communities with women’s health
committees, the second highest proportion after Punjab, half of which met in the last month.
NWFP has the lowest proportion of communities with women’s health committees with 81
percent (Figure 2.2)
9
LHWP – Balochistan Survey Report
100
90
80
70
Percentage
60
50
40
30
20
10
0
Balochista
Punajb Sindh NWFP AJK/FANA National
n
women's health committee 93 90 81 92 87 91
met within the past month 95 63 80 50 64 83
undertaken activity in past yea 84 70 92 69 54 80
There is also a positive perception of the work of most LHWs. In Balochistan 91 percent of
respondents reported that the LHW has generally improved peoples' lives in the communities
and over two thirds reported that once the women had become an LHW, she was usually
respected.
The LHW was asked to where she had referred her last acute case (Figure 2.3). Referrals
tend to be dispersed fairly evenly between the LHWs own facility, the government hospital
and private hospitals or clinic. In the previous evaluation, a half of these referrals were to the
LHWs own health facility. This has fallen to a third. Referrals to private providers, has risen
from nearly a quarter of all referrals in 2000, to nearly a third in 2008.
There are differences throughout the country. Particularly in Balochistan, the LHW is more
likely to refer to a private hospital/clinic (39 percent of all referrals) than her own health
facility. Similar results were found in Sindh and Punjab. However, in NWFP the referrals tend
to be to the LHW’s health facility, government hospital or another primary health facility. In
AJK/FANA, the referrals are typically to her health facility, then to a private hospital or clinic.
Clearly variations in the type of facility to which cases are referred will depend greatly on the
availability of the various facilities across the different provinces and their accessibility.
10
Providing services at the doorstep
Nearly two thirds of LHWs had used a referral slip with their last acute case in Balochistan:
this is the highest among all the provinces and higher than the national average of 42
percent (Table 2.2). Ninety two per cent of LHWs in Balochistan reported that patients went
to the facility they had been referred to. Some 83 percent of LHWs (compared to 78 percent
overall) reported receiving information including feedback slips from the health facility,
though this was significantly less for Sindh with 70 percent and AJK/FANA with only 56
percent.
Unfortunately, nationwide, staffing and supplies at the health facilities to which the LHWs are
attached are often very poor and some of the communities where LHWs work are under-
served by vaccination services.7 Similar problems were identified in the 3rd Evaluation and
would be expected to limit the effectiveness of the LHWs’ referral role. It is recognised that
this is an area where it is difficult for the Programme by itself to institute change.
7
See the Quantitative Survey Report for information on services at health facilities.
11
LHWP – Balochistan Survey Report
catchment area which gives the opportunity for children under the age of six months to be
immunised. LHWs are supposed to be paid Rs.150 per day by the organisers of the Polio
Campaign.
The results from the survey show only 37 percent of LHWs in Balochistan have worked on
National Immunisation Days or Sub-National Immunisation Days (NIDS) in the past three
months (compared to 81 percent nationally).
Some 68 percent of those LHWs working on NIDs in the Balochistan had worked outside of
their catchment area (see Table C.2 in Annex C). Those LHWs in the Balochistan who had
worked on NIDs had done so for an average of nine days. Almost all of LHWs working on
NIDs in the Balochistan (95 percent) reported receiving extra payment, compared to 78
percent nationwide.
12
Providing services at the doorstep
13
Levels of performance
3 Levels of performance
On our performance measure, the poor performers are on average only providing services to
26 percent of their eligible clients. By comparison, High Performers provide services to 78
percent (Figure 3.1)
Overall service delivery, as measured by the proportion of expected services being delivered
to eligible clients, has improved in all categories since 2000. Poor performers previously only
provided services to 17 percent of their eligible clients and High Performers provided
services to 68 percent.
It is easy to distinguish Poor Performers because they fail to deliver across the whole range
of services whereas High Performers cover nearly 80 percent of clients9 – and often well
above this for all services, except growth monitoring.10 In other words, performance appears
8
See Annex D for specific details
9
See Annex E for more information on different levels of performance amongst Lady Health Workers.
10 rd
As in the 3 Evaluation, the low level of growth monitoring even in the relatively high performing LHWs
suggests that there continue to be specific problems that need to be addressed if the Programme considers it
important to offer this service. This service level is even lower than the previous evaluation.
15
LHWP – Balochistan Survey Report
to be linked across different services, indicating that specialisation is not taking place. This is
consistent with the previous evaluation. High Performing LHWs are also working longer
hours, score higher on the knowledge test, and the households registered with them are
more likely to have been visited by the LHW in the past three months.
In Balochistan 17 percent of LHWs are in the high performing category and 24 percent are
Poor Performers (Figure 3.2). Note that over the entire (national) sample each category
contains 25 percent of LHWs by design.
While there have been improvements amongst all categories, the challenge for the LHWP
managers’ remains to further improve the performance of the Poor and Below Average
Performers.
The statistical analysis identifies a range of factors which help to explain these variations,
some of which are within the control of the programme and which therefore provides some
clear policy implications. Specifically, efforts should be made to:
11
A model was constructed and regression methods used to show the variables, which have the strongest
relationship with performance. For a full description of the model and techniques used see the Quantitative
Survey Report.
16
Levels of performance
17
The Lady Health Worker workload
In Balochistan each LHW serves 86 households registered.12 This figure is much lower than
the national average, where each LHW registers 131 households (down from 145 in 2000).
However, the number of individuals served is a more important indicator of population
covered. Based on LHWs’ own reports, in Balochistan the average number of individuals
registered is 636 (Figure 4.1), which is also much lower than the national average.
Despite being contrary to programme norms, variations in the number of households per
LHW could be appropriate if they reflect relative ease of access and transportation feasibility
and other factors that affect registration and other service parameters. In fact the “one size
fits all” policy might usefully be examined with a view to developing different norms and
standards for different parts of the country, based on factors such as the degree of difficulty
in providing LHW services.
In every province there are fewer people registered on average by LHWs, than in 2000. The
national average has reduced from 980 in 2000 to 919 in 2008.
1200
Number of persons registered
1000
800
600
400
200
0
Punjab/ICT Sindh NWFP (FATA) Balochistan AJK/FANA
The minimum population for a catchment area of an LHW is 700 people. In Balochistan, 64
percent of LHWs had less than 700 people registered. The standard for client registration not
met.
In addition to recording the numbers of people that the LHW reported having registered, the
survey team checked a sample of her households from her register. The households were
12
See Annex F for information on LHW activities and population coverage.
19
LHWP – Balochistan Survey Report
asked if they knew they were registered with their LHW. In Balochistan and NWFP they all
did. In the other provinces there was a small proportion of households (around 5 percent),
who did not know they were registered with their LHW, suggesting that they were not being
served at all by the LHW.
In Balochistan 82 percent of LHWs reported working at least one day in the previous week
which lowest among all provinces. Nationally 4 percent reported not working at all in the
previous week. A variety of reasons were given including taking leave, illness and Eid
holidays.
Figure 4.2 Comparison of the number of hours worked last week by LHWs
Number of hours worked last week
40
30
20
10
0
Punjab/ICT Sindh NWFP Balochistan AJK/FANA
2000/01 23 14 23 15 21
2008 33 25 32 17 27
Nearly half of the LHWs reported working seven days in the week prior to the survey, which
is contrary to the Programme policy. Field visits by the evaluation team to LHWs confirmed
this was happening and that it was being reinforced with monitoring by the LHSs. A fifth of
LHWs in Balochistan reported working seven days in the previous week.
20
The Lady Health Worker workload
Figure 4.3 Number of days worked by the LHW in the previous week, by
province
100
80
Percentage of LHWs
60
40 Six days
Seven days
20
0
Punjab/ICT Sindh NWFP Balochistan AJK/FANA
Six days 26 44 48 43 31
Seven days 59 25 35 20 35
In Balochistan, reflecting what is happening nationally, the activity taking up the largest
portion of an LHW’s time is visiting households, followed by working on NIDs (Figure 4.4).
On average, LHWs had spent seven hours participating in NIDS in the previous week. Once
a LHW is working outside her catchment area, even in providing a public health service,
should it still be considered a part of her core service provision? The programme might
consider how much time it is appropriate for LHWs to spend on NIDs, in the light of other
service requirements.
21
LHWP – Balochistan Survey Report
Other, 3%
Health NIDs, 13%
Committees, 1%
Individual
meeting with LHS,
1%
MIS activities, 6%
Monthly
meetings, 3%
Going with
referral case, 1% Household visits,
Health House 67%
patients, 4%
Source: OPM LHWP Fourth Independent Evaluation, Quantitative Survey Data (2008).
The number of household visits reported by the LHW is highest in Punjab/ICT, and it has
increased slightly in all provinces since 2000 with the exception of NWFP, where there has
been a decrease (Figure 4.5). The overall average number of household visits was 27 per
week. Given that the average number of households registered with the LHW is now 131,
she would only need to visit fifteen households per week to achieve the programme standard
of visiting all households at least once in two months. However, community distances and
consequently travel time involved may impeded the attainment of this programme standard
in Balochistan.
22
The Lady Health Worker workload
Figure 4.5 Average number of household visits made last week by Lady
Health Worker
Number of household visits last week
35
30
25
20
15
10
5
0
NWFP
Punjab/ICT Sindh Balochistan AJK/FANA
(FATA)
2000/01 30 16 27 14 21
2008 32 20 24 15 24
The LHWs were also asked how many patients/clients they saw in the week preceding the
survey including those to whom they only gave advice. In Balochistan the average was 9
clients (Figure 4.6). In Balochistan, 79 percent of LHWs had seen less than ten clients in the
past week.
Figure 4.6 Average number of clients seen last week by Lady Health Worker
30
Number of patients/clients seen last week
25
20
15
10
0
Punjab/ICT Sindh NWFP Balochistan AJK/FANA
Number of 25 16 23 9 24
patients/clients
Source: OPM LHWP Quantitative Survey Data (2008).
23
LHWP – Balochistan Survey Report
Although the percentage of LHWs with other paid jobs is significantly less than in 2000, in
undertaking other paid employment LHWs are not complying with programme policy.
However, the statistical analysis of the factors associated with high performance, suggest
that once other factors are accounted for, having additional paid work does not affect LHW
performance, although there may be other policy objectives that could be put at risk by some
forms of employment.
Figure 4.7 Proportion of Lady Health Workers with another paid job
24
Knowledge, skills and training of Lady Health Workers and their supervisors
•General questions covering a range of preventive and curative health care issues;
and
• Case histories where the problem must be identified and responded to with the
treatment or advice that would be provided to the patient.
A knowledge score was arrived at on the basis of how many questions were answered
correctly. The score is the percentage of correct answers given out of the total number of
questions.14 For purposes of comparison, exactly the same test that was applied in the
previous evaluation was also used in the current one.
The average score for LHWs in Balochistan was 64 percent. LHWs in NWFP have the
highest average score of 78 percent, and the largest improvement since 2000 (Figure 5.1).
As was the case in the previous evaluation, LHWs in Balochistan again had consistently
lower scores than their counterparts in other areas. Nevertheless, there was a significant
improvement in the knowledge score in all provinces compared with 2000.
Nationally, the overall mean score was 74 percent – an improvement on the mean score of
69 percent in 2000. There was some variation in the score between LHWs, although some
90 percent of LHWs scored between 60 and 90 percent of the possible total. Around 8
percent of LHWs scored below 60 percent; less than 3 percent of LHWs scored less than 50
percent.
LHSs’ knowledge scores have also increased. The national average LHS knowledge score
was 78 percent, compared to 74 percent in 2000. The LHS knowledge scores cannot be
analysed by province because the sample sizes are too small.
13
This is a test developed by the Evaluation team to assess LHWs and LHSs work-related knowledge and skills.
14
See the Quantitative Survey Report for further information on the knowledge test and the results.
25
LHWP – Balochistan Survey Report
Figure 5.1 Knowledge score for Lady Health Workers (2000 and 2008)
Percentage knowledge score
90
70
2000/01
50
2008
30
Punjab NWFP Balochist
Sindh AJK/FANA
and ICT and an
2000/01 70 71 67 60 69
2008 73 74 78 64 77
There has been some improvement in the level of in depth knowledge, as is shown by the
large number of LHWs able to provide multiple correct responses.15
There were some specific areas of weakness in Balochistan. Knowledge of the vaccination
schedule is poor.. Less than a third of the Balochistan LHWs were able to name all four
vaccines, provide correct doses and also the correct ages for each dose.
There are serious deficiencies in the ability of LHWs to provide the correct doses of
medicines required in basic situations, as was found in the 3rd Evaluation. None of the LHWs
in Balochistan were able to provide the correct dose of Chloroquine to a child with symptoms
of malaria, even though they were encouraged to use the Programme manual or medicine
box to answer the question. The knowledge of LHWs and LHS about HIV transmission has
improved substantially, though less than two third of LHWs in Balochistan could give three or
more correct responses on how HIV is transmitted.
LHW performance in Balochistan was not good on the case history-based questions. Only a
third of LHWs were able to provide the correct weight of a normal/moderately malnourished
child, and just 30 percent for a severely malnourished child, according to the growth card
More than three quarters of LHWs in the province were able to identify anaemia, and stated
that they would prescribe iron tablets to anaemic patients. Over half of the LHWs in
Balochistan stated that they would advise the patients to eat iron containing diet.
15
See Annex G for the knowledge test results.
26
Knowledge, skills and training of Lady Health Workers and their supervisors
Furthermore, 28 percent of LHWs said they would advise the patient to rest, which was more
than the national level.
Although the knowledge levels of LHWs in Balochistan have generally improved, further
improvements are required to avoid serious clinical consequences to their clients.
The training system has produced sufficient number of trainers to ensure that all LHWs have
completed their initial training. At the district level, a half of the EDO-Hs, nearly three
quarters of the District Coordinators and four out of five of the Assistant District Coordinators
are master trainers.
LHWs across the country are receiving their core training.16 Doctors at the health facility have
been important in the provision of the training along with the Lady Health Visitor and
Dispensers. Dispensers are being used less than in 2000.17
LHWs have completed their training, but it appears that not all of them had a female trainer.
In Balochistan only 8 percent of LHWs reported not having been trained by either a female
medical officer, a Lady Health Visitor or a female medical technician compared to nearly to a
fifth nationally.
Sindh had the highest proportion of LHWs who were not trained by either a female medical
doctor, a Lady Health Visitor or a female medical technician (Table 5.1). The Programme
also appears to have difficulty in providing female trainers in AJK/FANA. While it is not
common practice, in some instances Districts have used LHSs to conduct initial training.
Table 5.1 Percentage of LHW training that was provided by at least one
female trainer
Refresher and on-the-job training needs to be readily available in order to maintain and
update knowledge. The Programme has put enormous effort into developing and conducting
refresher training for all LHWs (Figure 5.2 and Table 5.2). In Balochistan nearly 90 percent of
LHWs report receiving on-the-job training from their supervisor.
The improvement in the average knowledge score reflects some success. However, there
remain substantial gaps in LHWs’ knowledge across the country. This problem was identified
16
The standard is three months basic training and twelve months task-based.
17
See Annex I for more information on training of LHWs (I.1) and their supervisors (I.2).
27
LHWP – Balochistan Survey Report
in the 3rd Evaluation, and although knowledge levels have improved, it appears that more
needs to be done to strengthen the initial and subsequent training processes.
Figure 5.2 Percentage LHWs who have received on the job training in the
past year and training at their last monthly meeting, by province
100
80
Percentage
60
40
20
0
Punjab/I Balochist
Sindh NWFP AJK/FANA
CT an
on the job training in 72 80 90 89 19
the past year"
training at last 34 44 42 33 21
monthly meeting
Table 5.2 Type of refresher training received by LHW in the previous year,
by province
The results show that LHWs who are more experienced and/or more educated tend to have
higher knowledge scores. LHWs that are currently married will, all else equal, have higher
28
Knowledge, skills and training of Lady Health Workers and their supervisors
knowledge scores. A possible interpretation of this is that married LHWs are more likely to
have gathered knowledge and skills from personal experience.
Knowledge scores are considerably lower amongst LHWs whose household’s main source
of income is agricultural wage earnings, suggesting that LHWs from poorer households will
have lower knowledge levels. This is also suggested by the finding that LHWs serving
communities with poor road access have lower knowledge levels.
Refresher training does not appear to have had an effect on LHW knowledge levels in
general, although those LHWs with a Counselling Cards Refresher Training manual
(received during refresher training) do have considerably higher knowledge scores.
Knowledge levels are higher for LHWs who received Continuing Education Training at the
last monthly meeting at the health facility, and also for those who have attended additional
Food and Nutrition training in the past year, perhaps because this is an area of particular
weakness. LHWs that produced a monthly plan for the previous month tend to have much
higher knowledge scores.
In terms of the impact of LHS and DPIU supervision and support, it appears that those LHWs
with more knowledgeable supervisors have higher knowledge scores. Furthermore LHWs in
districts where all served facilities have a specific individual with responsibility for overseeing
LHWP activities also have higher knowledge scores.
These results have some clear policy implications for programme. Specifically, efforts should
be made to:
29
LHWP – Balochistan Survey Report
30
Supervision of Lady Health Workers
The LHS receives her supervision from the District Co-ordinator and the Assistant District
Coordinator (ADC). She should attend a monthly meeting at the District Programme
Implementation Unit (DPIU) where she reports on the past month’s work and plans for the
following month. Both the LHW and the LHS may receive feedback from the Field
Programme Officer (FPO) who acts as an internal inspector and advisor, and from
Programme Management.
The intention of the programme was that each supervisor would be responsible for the
supervision of twenty-five LHWs. The national average is 23, which has come down from 28
in 2000. Supervisory responsibilities have therefore become better spread across
supervisors.
The percentage of LHWs who reported that they met their supervisors in the last 30 days has
increased nationwide. In Balochistan 49 percent of LHWs had had a supervision meeting
with their supervisors in the last month, compared to 44 percent in 2000. However there was
a sharp decline in AJK/FANA where only 50 percent of LHWs reported a visit by LHS in the
last month, compared to 73 percent in 2000 (Figure 6.1).
The LHS checklist is used to inspect the LHW’s level of service delivery and check her
knowledge. A high proportion of LHSs are using their performance checklists when
supervising the LHWs. There are variations in actual practices between provinces, with LHSs
in NWFP and AJK/FANA being more likely to use the checklist (Figure 6.2).
Just under two thirds of LHWs in Balochistan reported that the LHS had used this checklist in
her previous supervision visit. Of these, nearly half had informed the LHW of her score.
31
LHWP – Balochistan Survey Report
100
80
Percentage
60
40
20
0
NWFP Baloch‐
Punjab Sindh AJK/NA
(FATA) istan
2000/01 78 56 69 44 73
2008 84 78 81 49 50
Figure 6.2 Percentage of LHWs who reported the LHS using her checklist in
her previous supervision visit
100
90
80
70
Percentage
60
50
40
30
20
10
0
Baloch‐
Punjab Sindh NWFP AJK/NA
istan
LHW report that LHS 81 62 92 65 95
used checklist
A high proportion of LHWs in all provinces could produce reports for the previous month and
though only 58 percent of the LHWs in Balochistan could show a current work plan.18
Monthly meetings at the health facility are well attended. There has been an increase in
LHWs attending their monthly meeting since the previous evaluation.
18
See Annex K: Work planning and reporting.
32
Supervision of Lady Health Workers
Figure 6.3 Percentage of Lady Health Workers who have attended the
monthly meeting at their health facility in the past month
6.3 Transportation
In the original design of the programme, all supervisors were supposed to have access to
their own vehicle, a driver and an appropriate POL allowance. Transportation is essential for
supervisors for monitoring LHWs and visiting the health facilities and the community.
At the time of the 3rd Evaluation, there were substantial shortfalls in supervisors’ access to
vehicles and POL. Nationally, the situation has improved, with 72 percent of supervisors
usually or always having access to a programme vehicle compared with 64 percent in 2000.
However, problems remain. At the time of the survey, DPIU staff reported that, on average,
that over a quarter of their vehicles were non-operational.
The POL allowance is supposed to be a budget in litres rather than a set amount. This is not
happening. The POL allowance needs to be sufficient to enable the Lady Health supervisor
to visit all of her LHWs once a month as well as undertaking her additional responsibilities,
for example National Immunisation Days and transportation of supplies.
If a LHS did not have vehicle she used other forms of transport. However this incurs
expenses. The average cost for the previous month was Rs.1,730. This was paid by the LHS
and only 66 percent of them reported that it would be reimbursed. In addition, nationally, 62
percent of LHS were responsible for the repair of their vehicle and only 77 percent reported
being reimbursed for vehicle repairs.
33
LHWP – Balochistan Survey Report
34
Programme salary payment and medical supply systems
Figure 7.1 Percentage of LHWs paid within the past three months
Table 7.1 Proportion of Lady Heath Workers receiving less salary than
expected
Balochistan appears to have particular problems with the following items: Benzyl Benzoate,
Injectables, and Antiseptic Lotion.
35
LHWP – Balochistan Survey Report
In general, expired stock is not a big problem. If the LHW has the item in stock it appears to
be dispensed with a reasonable frequency.19
Table 7.2 Percentage of LHWs with stock outs for more than two months
Though most LHWs have the necessary equipment, only one third has a functional weighing
scale. The proportion of LHWs that have a functioning weighing scale is worryingly low in
Balochistan, at a mere 11 percent. Only 42 percent of LHWs in Balochistan have blank
growth monitoring cards. Lack of weighing scales means that the growth monitoring service
cannot be provided.
In general, LHWs in Balochistan are relatively less likely to have the required functional
equipment and administrative materials compared to LHWs in all other provinces.
Overall, it is clear that there remain significant problems in keeping LHWs supplied with all
the necessary equipment. The programme needs to both furnish the LHW’s kit when she
begins her job and ensure that items are replaced or kept up-to-date throughout her service.
19
See Quantitative Survey Report.
36
Programme salary payment and medical supply systems
better aligned to actual usage rates and this relates to budget requests. These problems are
for the FPIU to resolve with co-operation from the PPIU and DPIU.
Some 75 percent of DPIUs reported that they do not issue to facilities on the basis of their
demands; in other words the replenishment system is not operational. The LHS is often
taking the medicines from the DPIU to her facilities, after she has come into her monthly
meeting (not necessarily every month).
37
Annexes
39
Annexes
The objective of the quantitative survey was to provide a nationally representative picture of
the functioning of the programme. Interviews were conducted with lady health workers; the
households that they serve; the communities where they work; the LHWs’ supervisors; and
the First Level Care Facilities (FLCFs) to which the LHWs are attached (‘served’ FLCFs).
This information provides a comprehensive picture of the work carried out by the LHWs and
of the functioning of the programme support services necessary to their work. Information
was collected on a set of unserved households in areas where the Programme does not
operate, to enable an assessment of the impact of the LHWs on the health status of the
population they serve. Information was also collected from health facilities and from the
community in these areas.
Altogether, 554 LHWs and 5,752 households were interviewed. The final sample sizes for
each type of interview used in the analysis are shown in Table A.1.
The sample used five geographic strata, which were provinces or federally administered
areas: Punjab, Sindh, NWFP, Balochistan and AJK/FANA.20 The focus of this report is on the
performance of the programme as a whole, although some of the key estimates are also
presented by stratum. Separate reports have also been produced for each of the five strata.
Sampling weights were defined to allow the calculation of representative national and
provincial estimates. All estimated standard errors used in significance testing and in the
econometric modelling have been adjusted for sample clustering. More details on the
sampling methodology and the calculation of the survey weights are given in Annex A in the
main Quantitative Report.
In the first stage of sampling 60 districts were selected to be covered by the survey. Districts
assessed to be too insecure for fieldwork to be conducted safely were excluded from being
selected. In this way, nine of the 133 districts in existence in Pakistan in April 2008 were
excluded from the sample frame due to insecurity: two in North West Frontier Province
(NWFP) and the whole of the Federally Administered Tribal Areas (FATA). In addition, after
20
Note that two districts in NWFP and all seven districts in FATA were excluded from the sample frame in 2008
due to high levels of insecurity.
41
LHWP – Balochistan Survey Report
the district sample was drawn, three of the selected NWFP districts were dropped, also due
to insecurity. So the final number of districts covered by the evaluation is 57.
In each selected district a sample of served health facilities (i.e. those with LHWs attached)
was drawn from the programme database.21 LHWs were then sampled from these facilities.
LHWs were included in the sample if they had completed their initial three months training.22
Households were sampled from the selected LHWs’ registers. The supervisor of each
selected LHW was interviewed; community interviews were also conducted for each LHW
sampled.
A different sampling scheme was used for the unserved population. One or two FLCFs not
attached to the LHWP (‘unserved’ FLCFs) were sampled in each of the 60 selected districts.
Since it was not possible to get a reliable national list of all unserved health facilities, these
were identified in each of the sampled districts with the help of District Coordinators of the
programme. For each sampled unserved FLCF, the in-charge of the health facility was
consulted to assist the field-teams in dividing the FLCF catchment area into small territorial
segments. The segmentation was designed so as to mimic the partition of the area into the
territories of ‘virtual LHWs’ (see Annex A of the main Quantitative Report for details). At each
facility one segment was randomly selected. All households were listed in the selected
segments and a sample of unserved households was randomly selected for interview.
Fieldwork was conducted between July and November 2008. Losses were generally low.
The largest problem of non-response was at the unserved FLCFs, where around 23 percent
of interviews with facility staff could not be undertaken (although households attached to
these FLCFs were interviewed in any case).
21
The sampling procedure was designed such that the served FLCF sample included a small panel of FLCFs that
rd
had been covered in the 3 Evaluation.
22
Note this is a difference from the design of the TIPE where only LHWs with at least three years’ experience
were covered by the evaluation.
42
Annexes
43
Annexes
Service delivery by Lady Health Workers to four of their important target groups is shown in
Annex Table C.1. These are: households (as a unit); women who have had a birth in the
previous five years; married women aged 15–49; and children under three.
LHWs provide a range of promotive and preventive services to these groups. The Table
shows the extent to which LHWs in each of the provincial areas:
45
LHWP – Balochistan Survey Report
46
Annexes
47
Annexes
Households sampled from each LHW’s register were asked about the provision of a range of
services by the LHW. For each LHW, we construct a summary measure of LHW
performance which covers a range of the preventive services that all LHWs are supposed to
provide.
This summary LHW Performance score is exactly equivalent to that in the 3rd Evaluation. It
includes five broad categories of preventive and promotive services in the areas: hygiene
promotion, vaccination, family planning, pregnancy and birth, child nutrition and growth. For
each category two tasks were selected.
• Number of households who report that the LHW talked about ways to improve
cleanliness of water;
• Number of households who report that the LHW talked about ways to improve
hygiene;
• Number of women aged 15-49, who are non users of modern contraceptives, who
report that the LHW discussed family planning;
• Number of women aged 15-49, who are users of modern contraceptives, who report
that the LHW supplied them or referred them to a health centre;
• Number of mothers who gave birth in last 3 years who report that the LHW gave
advice on which foods to eat during pregnancy;
• Number of mothers who gave birth in last 3 years who report that the LHW saw
mother at birth or within a week of birth;
• Number of children under 3 years whose mothers report that the LHW talked about
vaccination;
• Number of children under 3 years whose mothers report that the LHW encouraged
vaccination of the child at appropriate ages;
• Number of children under 3 years whose mothers report that the LHW gave advice on
feeding the child; and
• Number of children under 3 years whose mothers report that the LHW weighed the
child within the last three months.
Most of these services are only relevant to particular groups. For example, in order to
evaluate a LHW’s performance on vaccination and weighing children under 3 years, we must
sum the total number of children under 3 years in the sample interviewed for that LHW. This
provides the denominator for the measure. The numerator is given by the number of those
children whose mothers were informed about vaccination, were encouraged to take their
child for vaccination at an appropriate age and the number who were weighed in the last
three months.23
In this way each LHW was evaluated on the basis of the people she should have served,
which vary across the LHWs. The summary performance measure was constructed by
23
To illustrate, suppose there were six children below three years in the sample of households interviewed for a
particular LHW. She weighed two in the last three months, and discussed vaccination for five and encouraged
vaccination for four. In other words, she was supposed to carry out 18 tasks (6 weightings + 6 discussions on
vaccination + 6 encouragements of vaccinations). Out of the 18 she has performed 2 + 5 + 4 = 11. Hence, a
simple score on these three tasks alone is 11/18.
49
LHWP – Balochistan Survey Report
summing the numerator and denominator in this manner across all of the services listed
above. The final proportion was then expressed as a percentage. It was decided not to
standardise for client group composition.
Curative services are excluded from this measure as they are carried out on demand and
may therefore reflect a more complex range of factors than the promotive services listed
above. Measures of activities, rather than services delivered, are also excluded. For
example, the number of hours worked, numbers of households visited etc. This is partly
because many of these measures are reported by the LHW herself, and therefore more likely
biased, whereas the service delivery measures are reported by the households.
50
Annexes
Annex Table E.1 provides more detailed information on the difference between Poor
Performers and High Performers on ten services provided by the LHW.24 We can see from
the table that the Poor Performers (the bottom 25 percent of LHWs scored an average of 26
percent, and the High Performers (the top 25 percent of LHWs) scored and average of 78
percent. It is quite easy to distinguish Poor Performers from High Performers.
24
For further information see the Quantitative Survey Report.
51
Annexes
53
LHWP – Balochistan Survey Report
Table F.2 Number of hours Lady Health Workers worked last week by type
of activity
Table F.3 Days worked by Lady Health Workers during last week
54
Annexes
55
LHWP – Balochistan Survey Report
Table F.4 Number of household visits made by the LHW and number of
clients seen during the past week as reported by the client
56
Annexes
During their interviews LHWs and LHSs were asked a number of questions to test their
knowledge in areas important in the LHWs service delivery. The questions covered a range
of preventive and curative health care issues, hygiene and nutrition. They were also
presented with a number of hypothetical case histories where they were asked to identify the
problem and to respond with the treatment or advice they would provide the patient.
A Knowledge Score was arrived at on the basis of how many questions were answered
correctly. It is possible to score fifty-five points, twenty-eight for the general knowledge
section (Annex Table G.1) and twenty-seven points (Annex Table G.2) for the case studies.
The score is presented as a percentage of the highest possible score.
The scoring attempts to identify LHWs with sufficient, general knowledge as well as to
identify those LHWs with a depth of knowledge. For example, for questions with multiple
possible responses, one point was given if a LHW was able to provide one correct response,
and another point if she was able to provide three or more correct responses. The scoring
was as follows:
Table G.1 Scoring for general knowledge section of the knowledge test
57
LHWP – Balochistan Survey Report
58
Annexes
59
Annexes
The results for Lady Health Workers, both nationwide and for Balochistan are presented
below. These include the results for the general knowledge (Annex Table H.1) and the case
based results (Annex Table H.2)
61
LHWP – Balochistan Survey Report
62
Annexes
63
Annexes
• Three months full time basic training for each LHW at the health facility where she
was recruited.
• Twelve months task based (in-service) training, comprising one week full-time per
month for twelve months at the health facility.
After 2005, the LHWP has introduced 15 days mandatory refresher trainings for all the Lady
Health Workers. The lady health workers are provided with 15 days compulsory refresher
training on different topics, which are decided by the National training cell in consultation with
the provinces
All the LHWs who were recruited before 2005 were provided with a refresher training on the
revised LHW manual.
In addition, training can be provided, though not on a universal and compulsory basis, via:
• Phase One: Three months training including initial training using the same curriculum
as the LHW (8 weeks) and on supervisory skill (3 weeks);
• Phase Two: Three months task-based training with two weeks in the field and two
weeks at their training centre; and
• Phase Three: Six months task-based training with three weeks in the field and one
week at their training centre.
The training pattern was changed in 2005 and the new training schedule is as follows:
• Phase One: Three months training including the initial training, using the same
curriculum as the LHW (8 weeks) and additional supervisory skills (3 weeks);
• Phase Two: Nine months of task based training with three weeks in the field and one
week at their training centre.
In addition, training can be provided, though not on a universal and compulsory basis, via:
65
LHWP – Balochistan Survey Report
66
Annexes
Annex J Supervision
67
Annexes
Work planning is an important self-management tool for LHWs. The LHW reports contribute
to the Programme’s management information system. For Balochistan LHWs 47% could
produce last month’s report were able to show their current work plan.
69
Annexes
Table L.2 Percentage of Lady Health Workers with functional equipment and
administrative materials
71
LHWP – Balochistan Survey Report
72