Next Article in Journal
The Acute Effects of Single or Repeated Bouts of Vigorous-Intensity Exercise on Insulin and Glucose Metabolism during Postprandial Sedentary Behavior
Previous Article in Journal
Multi-Elemental Analysis of Human Optic Chiasm—A New Perspective to Reveal the Pathomechanism of Nerve Fibers’ Degeneration
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Comparison of the Validities of Traditional Chinese Versions of the Work Productivity and Activity Impairment Questionnaire: General Health and the World Health Organization’s Health and Work Performance Questionnaire

by
Kim-Ngan Ta-Thi
1,2 and
Kai-Jen Chuang
1,3,*
1
School of Public Health, College of Public Health, Taipei Medical University, Taipei 110, Taiwan
2
Faculty of Public Health, University of Medicine and Pharmacy at Ho Chi Minh City, Ho Chi Minh City 700000, Vietnam
3
Department of Public Health, School of Medicine, College of Medicine, Taipei Medical University, Taipei 110, Taiwan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(7), 4417; https://doi.org/10.3390/ijerph19074417
Submission received: 3 March 2022 / Revised: 3 April 2022 / Accepted: 4 April 2022 / Published: 6 April 2022

Abstract

:
There is a lack of valid instruments for measuring productivity loss due to illness. This study aimed to compare the validities of traditional Chinese versions of the Work Productivity and Activity Impairment: General Health (C-WPAI:GH) and the World Health Organization’s Health and Work Performance Questionnaire (C-WHO-HPQ), and to define the factors associated with productivity loss. We conducted a cross-sectional study of 165 Taiwanese employees in technology companies. Spearman’s correlation coefficients and ANOVAs were used to test the validities of the C-WPAI:GH and C-WHO-HPQ. Bayesian model averaging was used for multiple linear regression to define the factors related to productivity loss. The C-WPAI:GH had acceptable validities for assessing the productivity loss of Taiwanese employees. The C-WHO-HPQ had acceptable content validity and concurrent criterion validity. However, the construct validity of the C-WHO-HPQ was insufficient (less than 75% of results were consistent with our hypotheses). Absenteeism in the C-WPAI:GH was associated with education, physical functioning and job satisfaction. There were significant associations of bodily pain, social functioning and general health with presenteeism, overall work impairment and activity impairment in the C-WPAI:GH. A linear correlation was found between education and activity impairment in the C-WPAI:GH. The C-WPAI:GH can be used to evaluate productivity loss due to illness.

1. Introduction

Work productivity is one of the most important resources contributing to organizational development and also sustainable national development. Assessing work performance is an issue of concern for employers. By assessing this information, employers have data to develop policies on promotions, incentive bonuses and salary increases.
Health problems act as a deterrent to employee productivity. To measure productivity loss due to illness, many researchers use two concepts: absenteeism and presenteeism. Absenteeism means that employees are away from their work due to sickness or disability. Presenteeism means productivity loss due to the sickness or medical conditions of employees who are present at work but not performing their duties at full competence [1,2,3].
Many studies have been conducted to estimate absenteeism and presenteeism. The absenteeism cost due to smoking by Taiwanese employees is estimated to be USD 184 million every year [4]. In a self-reported productivity questionnaire, the average presenteeism score of Vietnamese patients in a methadone maintenance program was estimated to be 31.5% and was converted into a mean weekly presenteeism cost of USD 8.7 [5]. In a cross-sectional study in Iranian hospitals, the average absenteeism days of 1958 healthcare workers who had COVID-19 in 2021 was 16.44 days and it was equivalent to USD 671.4 per person [6]. However, using a health measure with limited evidence on its validity when estimating absenteeism and presenteeism might increase the bias of the results.
To date, many measurement tools of work productivity have been developed. A key issue is that a valid instrument on productivity loss due to health problems might help managers and policymakers better evaluate the economic burden of illness and the cost-effectiveness of health interventions. In a systematic review of 21 instruments measuring presenteeism by the Institute of Health Economics (Edmonton, AB, Canada) in 2015 [7], the Work Productivity and Activity Impairment Questionnaire: General Health (WPAI:GH) and the World Health Organization’s Health and Work Performance Questionnaire (WHO-HPQ) (short form) were two of the most popular instruments because they are short and available online. In addition, these scales can be used for the general population, general health and monetization of lost productivity. Although these two scales have some limitations [8], the WPAI:GH and WHO-HPQ were validated and have been used commonly in papers published during 2018–2021 according to the newest systematic review [9].
There is limited evidence on the validity and reliability of these instruments [10]. In 1993, Reilly et al. [11] developed the quantitative work productivity and activity impairment (WPAI) questionnaire. The WPAI was correlated with the Short Form-36 (SF-36) and the self-reported severity of health problems, which proved the construct validity of the WPAI. The Portuguese version of the WPAI:GH was associated with the SF-36 in a validation study on 100 Brazilian employees and patients [12]. Other validation studies of the WPAI:GH were carried out in English-speaking countries, such as the UK (2010) and Singapore (2020) [13,14]. It was found that, until now, the WHO-HPQ (short form) has been both translated and validated only in Japan in 2020 [15]. Overall, according to a systematic review in 2015 [10], the WPAI:GH and WHO-HPQ were proved to have acceptable construct validity and concurrent validity. To our best knowledge, data on employees’ work performance and related factors are still deficient because valid instruments for this use in Taiwan are lacking. In addition, although health problems affect employee productivity, there is limited evidence on the models or mapping algorithms for predicting productivity loss using measures of health status [16]. Therefore, this study aimed (i) to compare the validities of the traditional Chinese versions of the WPAI:GH and WHO-HPQ in Taiwanese employees in technology companies in northern Taiwan and (ii) determine the associations of demographics, health status, job satisfaction, and disability status with productivity loss.

2. Materials and Methods

2.1. Process of Translation

We contacted the authors of the WHO-HPQ and WPAI:GH. There were no terms and conditions on translating these questionnaires for use in our validation study.
We followed Sousa’s guidelines for the process of translation [17]: forward translation, back-translation and an expert panel. Two independent translators translated the WHO-HPQ from English into traditional Chinese. For the WPAI:GH, we obtained one traditional Chinese version from the website of the WPAI:GH’s author [18] and another version translated from English to traditional Chinese by a translator. Another independent translator synthesized the two versions of these scales into the preliminary initial traditional Chinese versions.
Two other independent translators translated the traditional Chinese version back into English and another third independent translator synthesized the English back-translated version. Next, two independent native English-speaking researchers compared the back-translated version with the original English version to define any differences in meaning.
After that, we conducted two sessions with panels of experts in the field of health economics and occupational health. We emailed four experts in the first session to obtain independent ratings of the content validity from each expert, especially regarding the clarity, relevance and translation equivalence of the traditional Chinese versions. In the second face-to-face expert panel meeting, three experts discussed and reached a consensus on some minor revisions to finalize the translated versions (Supplementary Material).

2.2. Instruments

Table 1 describes information of the Work Productivity and Activity Impairment Questionnaire: General Health (WPAI:GH) and the World Health Organization’s Health and Work Performance Questionnaire (WHO-HPQ).
The health status was measured by the 36-Item Short Form Survey (SF-36) Version 1.0 (RAND 36-Item Health Survey 1.0 Questionnaire). The SF-36 includes 36 questions on eight domains: physical functioning, bodily pain, general health, vitality, social functioning, role limitations due to physical problems (role—physical), role limitations due to emotional problems (role—emotional) and mental health. Higher scores represent better health outcomes [20].
Job satisfaction was assessed by one item: “Overall, how satisfied are you with your job?” on a five-point Likert scale from 1 to 5, with five respective categories as follows: “completely dissatisfied”, “moderately dissatisfied”, “neither satisfied nor dissatisfied”, “moderately satisfied” and “completely satisfied” [21].
Disability status was classified into work-related disability, non-work-related disability and no disability [21].

2.3. Sample

A cross-sectional study was conducted in 10 technology companies in northern Taiwan. Among 3308 employees, we recruited 165 study participants by random sampling with the following inclusion criteria: (i) a Taiwanese employee, (ii) at least 20 years of age, (iii) the ability to read and speak Chinese, (iv) having a full-time job, (v) no missing data on the WHO-HPQ and WPAI:GH questionnaires, and (vi) agreeing to join this study. Informed consent was obtained from each participant before the employees were interviewed.

2.4. Validities

Based on the results of the COSMIN study about consensus on the definitions of psychometric properties for health measurement instruments [22], we present the content validity, construct validity and criterion validity.
(1) Content validity: we emailed four experts two questions to evaluate the content validity of the traditional Chinese versions of the WPAI:GH (C-WPAI:GH) and the WHO-HPQ (C-WHO-HPQ): “Has the translated version kept the same meaning as the original English version?” and “Is the translated version clear and easy to understand for the general Taiwanese population?”. Possible answers were: (1) strongly disagree, (2) disagree, (3) neutral, (4) agree, and (5) strongly agree.
(2) Construct validity: We examined the construct validity by testing hypotheses on the correlates of the C-WHO-HPQ and C-WPAI:GH with another instrument (the SF-36), and discrepancies between relevant groups (job satisfaction and disability status).
(3) Criterion validity: Because there is no gold standard to measure productivity loss due to illness, the C-WHO-HPQ scores were compared with the C-WPAI:GH scores for concurrent criterion validity between two similar instruments.

2.5. Data Analysis

Data were analyzed by R Version 4.1.2. Shapiro–Wilk’s test and histograms were used to define whether the continuous variables were normally distributed. We assumed that missing values were missing at random and used the multiple imputation method to handle missing data.
To evaluate the construct validity, we formed hypothesies based on previous validation studies [11,12,13,21], as follows:
  • 80 hypotheses for the C-WHO-HPQ: Eight outcomes of the C-WHO-HPQ were correlated with the eight domains of the SF-36, job satisfaction and disability status.
  • 40 hypotheses for the C-WPAI:GH: Four outcomes of C-WPAI:GH were correlated with the eight domains of the SF-36, job satisfaction and disability status.
The construct validity was considered adequate if at least 75% of the results were consistent with the hypotheses [23].
We used the Spearman correlation coefficients among the C-WHO-HPQ, C-WPAI:GH, and SF-36, because these variables were not normally distributed. Spearman’s rho values of <0.3, 0.3~0.5 and >0.5 were, respectively, considered weak, moderate and strong relationships [24]. To decrease the risk of a Type I error, we used Bonferroni correction with p < 0.0008 (C-WHO-HPQ and SF-36) and p < 0.0016 (SF-36 and C-WPAI:GH, and C-WHO-HPQ and C-WPAI:GH) as statistical significance for multiple comparisons [25].
An analysis of variance (ANOVA) was used to test differences in the productivity scores of employees reporting that they had had a work-related disability, a non-work-related disability and no disability in the past month, and the associations of the C-WHO-HPQ and C-WPAI:GH with job satisfaction. The Tukey–Kramer test was calculated for multiple comparisons to determine where the significant differences existed.
We used the Bayesian model averaging approach for the multiple linear regression models to determine the associations among demographic information, health status, job satisfaction and productivity loss [26,27]. It was shown that this approach performed better than stepwise regression of the frequentist approach [28,29]. The regression coefficient (β) and 95% credible interval (95% CrI) [30] were computed under the non-informative reference prior by using the BAS package in R software [31,32].

3. Results

3.1. Descriptive Statistics

Study subjects were aged 22~61 years (mean = 35). The majority of the participants were male (78%). Over half of employees had received a bachelor’s degree or higher (70%). Of the 165 employees who answered the questionnaire, the percentages of each job category were as follows: 15% were managers or professionals (e.g., computer engineers, researchers), 13% were technologists (e.g., nutritionists, electricians), 35% were in an office job or service, 26% were productive technologists who operated machines, and 11% were productive technologists who used their bodies (e.g., cleaning, packaging).

3.2. Content Validity

All experts agreed that the C-WPAI:GH kept the same meaning as the original version, and was clear and easily understood by the general Taiwanese population (one out of the four experts strongly agreed and three-fourths of the experts agreed). The response rate was 25% strongly agree, 50% agree and 25% neutral regarding the clarity, relevance and translation equivalence of the C-WHO-HPQ.

3.3. Construct Validity

As presented in Table 2, significant correlations were presented, with correlation coefficients and p values in bold.
There were significant associations between health status and the C-WPAI:GH scores, especially presenteeism, overall work impairment and activity impairment with physical functioning, role—physical, bodily pain, general health, vitality and social functioning (strong relationships, rs values ranged from −0.76 to −0.53, p < 0.0001). Only activity impairment had a moderate relationship with role—emotional (rs values = −0.33, p < 0.0001). Absenteeism was negatively correlated with health status, except for role—emotional and mental health (rs values ranged from −0.45 to −0.35, p < 0.0001), while presenteeism, overall work impairment and activity impairment were moderately correlated with mental health (rs values ranged from −0.44 to −0.36, p < 0.0001).
Table 3 presents significant differences between three C-WPAI:GH outcomes (presenteeism, overall work impairment and activity impairment) of three groups of employees who reported that they had had a work-related disability, non-work-related disability or no disability in the past month (p < 0.001). Job satisfaction was positively correlated with relative absenteeism (4-week estimate), relative hours of work (4-week estimate) (p = 0.004), absolute presenteeism, relative presenteeism (p < 0.0001), relative absenteeism (7-day estimates) and relative hours of work (7-day estimates) (p = 0.045) in the C-WHO-HPQ. All C-WPAI:GH scores were also correlated with job satisfaction (p < 0.0001). However, associations were not found between disability status and any C-WHO-HPQ scores.
In Table S1 (Supplementary Materials), the results of the Turkey–Kramer tests show that subjects who had a work-related disability had significantly higher presenteeism scores (Δ = 23.924, p = 0.0001) and overall work impairment scores (Δ = 24.090, p = 0.0001) than subjects who had no disability. The activity impairment scores were significantly different between subjects with a work-related disability and those with no disability (Δ = −21.667, p = 0.0004). Tables S2 and S3 show the statistically significant differences among the compared groups in detail.
Table 2 and Table 3 show there were 14 (18%) and 35 (88%) correlations, respectively, of the C-WHO-HPQ (80 hypotheses) and C-WPAI:GH (40 hypotheses) with the eight subscales of the SF-36, job satisfaction and disability status. These results indicate the construct validity of the WPAI:GH was sufficient (over 75% of results were consistent with our hypotheses) while the construct validity of the WHO-HPQ was insufficient.

3.4. Criterion Validity

Table 4 shows that all C-WPAI:GH outcomes and absolute presenteeism in the C-WHO-HPQ were negatively correlated (rs values ranged from −0.48 to −0.32, p < 0.0001). All C-WHO-HPQ outcomes and absenteeism measured by the C-WPAI:GH were significantly correlated (rs values ranged from −0.47 to 0.47, p < 0.0003).

3.5. Associations of Demographics, Health Status, Job Satisfaction and Disability Status with Productivity Loss

In Table 5, given these data, there was a 95% chance that presenteeism, overall work impairment and activity impairment scores increased by 0.09 to 0.95, 0.10 to 0.96 and 0.02 to 0.88, respectively, with one additional increase in age. There was a 95% probability that absenteeism and activity impairment scores would increase by 0.22 up to 17.40 and 6.46 up to 53.41 or higher, respectively, if the employees had graduated from senior high school. There was a 95% probability that absenteeism and activity impairment scores would be within 0.47 to 17.79 and 5.62 to 52.95, respectively, if the employees graduated from university, given the data. The 95% credible intervals were (−14.04; −4.09), (−15.90; −5.25), (−15.65; −4.90) and (−16.06; −2.76) when employees were moderately dissatisfied, neither satisfied nor dissatisfied, moderately satisfied and completely satisfied with their jobs, respectively. Correlations were found among bodily pain, social functioning, and general health with presenteeism, overall work impairment and activity impairment.

4. Discussion

Employers might pay little attention to productivity loss due to health problems because of a lack of valid and reliable instruments. In our study, the C-WPAI:GH was a valid instrument for assessing the productivity loss of Taiwanese employees. The C-WHO-HPQ had acceptable content validity and concurrent criterion validity. However, the construct validity of the C-WHO-HPQ was insufficient (less than 75% of results were consistent with our hypotheses). There were linear relationships of education, job satisfaction and physical functioning with absenteeism. Linear relationships were found for age, pain, social functioning and general health with presenteeism, overall work impairment and activity impairment. A linear correlation was found between education and activity impairment.
Our study confirms that the C-WPAI:GH is a valid instrument for assessing productivity loss due to illness. However, previous validation studies yielded inconsistent results on the associations between health status and the WPAI:GH [11,14]. Our results of the associations between health status and productivity were inconsistent with those of previous validation studies because the participants in previous studies were patients and older than our study subjects. Another possible explanation for this inconsistency might be that different versions of the SF-36 instrument or other instruments were used to evaluate health status in previous studies. Three measures of the SF-36 instrument (role—physical, role—emotional and pain) were used in the first validation study of the WPAI [11]. The findings of other validation studies on patients with axial spondylarthritis in Singapore and patients with rheumatoid arthritis in the UK differed from those of our study because other instruments were used to measure the health status or specific diseases of those patients [13,14]. A validation study in Brazilian patients showed that absenteeism was not related to the SF-36 instrument, while other WPAI:GH outcomes were correlated with most subscales of the SF-36; particularly good correlations existed with physical functioning, pain and role function (physical) [12]. There were 82% female participants in that study, which might have caused the different results for health status and productivity compared with the 78% male participants in our study.
Contrary to expectations, our study was unable to demonstrate that the construct validity of the C-WHO-HPQ was adequate for our hypotheses to evaluate productivity loss due to health problems. This result may be explained by the fact that the short form of the WHO-HPQ was used in our study, while the long form or the work functioning subscale of the WHO-HPQ was used in previous validation studies [1,33]. Another possible explanation for this could be differences in the age, gender and education of participants and the study designs between our study and another validation study (an online survey in Japan) [15].
There was no significant relationship between any absenteeism scores of the C-WHO-HPQ and presenteeism in the C-WPAI:GH. This finding is consistent with the absenteeism scores of the WHO-HPQ not being associated with the presenteeism scores of other presenteeism scales [15]. In addition, our study confirmed that the presenteeism scores of the C-WHO-HPQ were associated with the scores of other presenteeism scales. A note of caution is due here, since the presenteeism of the WHO-HPQ reflects productivity loss at work for any reason (including health problems) [15].
Our study had similar results with other studies on the associations between physical functioning and absenteeism [34], and also between pain and presenteeism [13]. Physical functioning might cause bad consequences for musculoskeletal conditions, which would result in absenteeism [34]. Pain makes it difficult for employees to concentrate on their work, which means reduced performance at work (presenteeism) [35].
There are several limitations of this study. First, the study participants were recruited in technology companies, so we cannot generalize the results to employees in other fields or businesses. Second, the WPAI:GH and WHO-HPQ are questionnaires based on the number of working hours, which might be prone to recall bias. Third, our study had a cross-sectional design which could not provide cause-and-effect relationships between health and productivity.
Our study suggests that the C-WPAI:GH has acceptable validity for Taiwanese employees in technology companies. A valid instrument for productivity loss due to health problems might help managers and policymakers better evaluate the economic burden of illness and the cost-effectiveness of health interventions. The results of our study also highlight which domains of health status, especially physical functioning, bodily pain, social functioning and general health, were associated with employee productivity.

5. Conclusions

In conclusion, the traditional Chinese version of the WPAI:GH is a valid instrument for assessing productivity loss due to illness in Taiwanese employees in technology companies. The C-WHO-HPQ had acceptable content validity and concurrent criterion validity. However, the construct validity of the C-WHO-HPQ was not adequate (less than 75% of the results were consistent with our hypotheses). Employers and policymakers should consider the domains of health status in designing suitable health promotion programs in organizations and treatments in hospitals to reduce production loss because work productivity is an important factor in the sustainability of any organization’s overall performance. A further validation study is suggested to generalize the results on the validity of these two scales for other jobs and organizations.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph19074417/s1. The Traditional Chinese Version of Work Productivity and Activity Impairment Questionnaire: General Health (C-WPAI:GH) [11]. The Traditional Chinese Version of the World Health Organization’s Health and Work Performance Questionnaire (C-WHO-HPQ) [1,[2]]. Table S1: Comparison of mean C-WPAI:GH scores among disability status groups. Table S2: Comparison of mean C-WPAI:GH scores among job satisfaction groups. Table S3: Comparison of mean C-WHO-HPQ scores among job satisfaction groups.

Author Contributions

Conceptualization, K.-N.T.-T.; methodology, K.-N.T.-T.; software, K.-N.T.-T.; validation, K.-N.T.-T. and K.-J.C.; formal analysis, K.-N.T.-T.; investigation, K.-J.C.; resources, K.-J.C.; data curation, K.-N.T.-T.; writing—original draft preparation, K.-N.T.-T.; writing—review and editing, K.-J.C.; supervision, K.-J.C.; project administration, K.-J.C.; funding acquisition, K.-J.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Institute of Labor, Occupational Safety and Health, Ministry of Labor, Taiwan, grant number ILOSH110-A701. The APC was funded by the Institute of Labor, Occupational Safety and Health, Ministry of Labor, Taiwan.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Joint Institutional Review Board of Taipei Medical University (TMU-JIRB No.: N201602045 on 2 April 2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Acknowledgments

We are grateful to the experts, translators and researchers for their contributions during the process of translation. We would like to thank the participants for their time, and the Institute of Labor, Occupational Safety and Health, Ministry of Labor, Taiwan, for the funding.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Kessler, R.C.; Barber, C.; Beck, A.; Berglund, P.; Cleary, P.D.; McKenas, D.; Pronk, N.; Simon, G.; Stang, P.; Ustun, T.B.; et al. The World Health Organization Health and Work Performance Questionnaire (HPQ). J. Occup. Environ. Med. 2003, 45, 156–174. [Google Scholar] [CrossRef]
  2. Kessler, R.C.; Ames, M.; Hymel, P.A.; Loeppke, R.; McKenas, D.K.; Richling, D.E.; Stang, P.E.; Ustun, T.B. Using the World Health Organization Health and Work Performance Questionnaire (HPQ) to Evaluate the Indirect Workplace Costs of Illness. J. Occup. Environ. Med. 2004, 46, S23–S37. [Google Scholar] [CrossRef] [PubMed]
  3. Suzuki, T.; Miyaki, K.; Song, Y.; Tsutsumi, A.; Kawakami, N.; Shimazu, A.; Takahashi, M.; Inoue, A.; Kurioka, S. Relationship between Sickness Presenteeism (WHO–HPQ) with Depression and Sickness Absence Due to Mental Disease in a Cohort of Japanese Workers. J. Affect. Disord. 2015, 180, 14–20. [Google Scholar] [CrossRef] [PubMed]
  4. Tsai, S.P. Workplace Smoking Related Absenteeism and Productivity Costs in Taiwan. Tob. Control 2005, 14, i33–i37. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Tran, B.X.; Nguyen, L.H.; Nguyen, C.T.; Latkin, C.A. Health-Related Work Productivity Loss Is Low for Patients in a Methadone Maintenance Program in Vietnam. Int. J. Drug Policy 2018, 60, 1–7. [Google Scholar] [CrossRef]
  6. Faramarzi, A.; Javan-Noughabi, J.; Tabatabaee, S.S.; Najafpoor, A.A.; Rezapour, A. The Lost Productivity Cost of Absenteeism Due to COVID-19 in Health Care Workers in Iran: A Case Study in the Hospitals of Mashhad University of Medical Sciences. BMC Health Serv. Res. 2021, 21, 1169. [Google Scholar] [CrossRef]
  7. Institute of Health Economics. Available online: https://www.ihe.ca/publications/a-systematic-review-of-the-measurement-properties-of-self-report-instruments-that-assess-presenteeism (accessed on 28 December 2019).
  8. Tang, K. Estimating Productivity Costs in Health Economic Evaluations: A Review of Instruments and Psychometric Evidence. Pharmacoeconomics 2015, 33, 31–48. [Google Scholar] [CrossRef]
  9. Hubens, K.; Krol, M.; Coast, J.; Drummond, M.F.; Brouwer, W.B.F.; Uyl-de Groot, C.A.; Hakkaart-van Roijen, L. Measurement Instruments of Productivity Loss of Paid and Unpaid Work: A Systematic Review and Assessment of Suitability for Health Economic Evaluations From a Societal Perspective. Value Health 2021, 24, 1686–1699. [Google Scholar] [CrossRef] [PubMed]
  10. Ospina, M.B.; Dennett, L.; Waye, A.; Jacobs, P.; Thompson, A.H. A Systematic Review of Measurement Properties of Instruments Assessing Presenteeism. Am. J. Manag. Care 2015, 21, e171–e185. [Google Scholar] [PubMed]
  11. Reilly, M.C.; Zbrozek, A.S.; Dukes, E.M. The Validity and Reproducibility of a Work Productivity and Activity Impairment Instrument. Pharmacoeconomics 1993, 4, 353–365. [Google Scholar] [CrossRef]
  12. Ciconelli, R.M.; de Soárez, P.C.; Kowalski, C.C.G.; Ferraz, M.B. The Brazilian Portuguese Version of the Work Productivity and Activity Impairment: General Health (WPAI-GH) Questionnaire. Sao Paulo Med. J. 2006, 124, 325–332. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Phang, J.K.; Kwan, Y.H.; Fong, W.; Tan, C.S.; Lui, N.L.; Thumboo, J.; Leung, Y.Y. Validity and Reliability of Work Productivity and Activity Impairment among Patients with Axial Spondyloarthritis in Singapore. Int. J. Rheum. Dis. 2020, 23, 520–525. [Google Scholar] [CrossRef] [PubMed]
  14. Zhang, W.; Bansback, N.; Boonen, A.; Young, A.; Singh, A.; Anis, A.H. Validity of the Work Productivity and Activity Impairment Questionnaire—General Health Version in Patients with Rheumatoid Arthritis. Arthritis Res. 2010, 12, R177. [Google Scholar] [CrossRef] [Green Version]
  15. Kawakami, N.; Inoue, A.; Tsuchiya, M.; Watanabe, K.; Imamura, K.; Iida, M.; Nishi, D. Construct Validity and Test-Retest Reliability of the World Mental Health Japan Version of the World Health Organization Health and Work Performance Questionnaire Short Version: A Preliminary Study. Ind. Health 2020, 58, 375–387. [Google Scholar] [CrossRef] [Green Version]
  16. Jones, C.; Payne, K.; Thompson, A.; Verstappen, S.M.M. Predicting Presenteeism Using Measures of Health Status. Qual. Life Res. 2022, 31, 425–435. [Google Scholar] [CrossRef] [PubMed]
  17. Sousa, V.D.; Rojjanasrirat, W. Translation, Adaptation and Validation of Instruments or Scales for Use in Cross-Cultural Health Care Research: A Clear and User-Friendly Guideline: Validation of Instruments or Scales. J. Eval. Clin. Pract. 2011, 17, 268–274. [Google Scholar] [CrossRef]
  18. Margaret Reilly Associates, Inc. Available online: http://www.reillyassociates.net/Contact_Us.html (accessed on 31 December 2020).
  19. The World Health Organization Health and Work Performance Questionnaire (HPQ). Available online: https://www.hcp.med.harvard.edu/hpq/info.php (accessed on 11 November 2019).
  20. Hays, R.D.; Sherbourne, C.D.; Mazel, R.M. The Rand 36-Item Health Survey 1.0. Health Econ. 1993, 2, 217–227. [Google Scholar] [CrossRef]
  21. Koopman, C.; Pelletier, K.R.; Murray, J.F.; Sharda, C.E.; Berger, M.L.; Turpin, R.S.; Hackleman, P.; Gibson, P.; Holmes, D.M.; Bendel, T. Stanford Presenteeism Scale: Health Status and Employee Productivity. J. Occup. Environ. Med. 2002, 44, 14–20. [Google Scholar] [CrossRef]
  22. Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L.; Bouter, L.M.; de Vet, H.C.W. The COSMIN Study Reached International Consensus on Taxonomy, Terminology, and Definitions of Measurement Properties for Health-Related Patient-Reported Outcomes. J. Clin. Epidemiol. 2010, 63, 737–745. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Prinsen, C.A.C.; Mokkink, L.B.; Bouter, L.M.; Alonso, J.; Patrick, D.L.; de Vet, H.C.W.; Terwee, C.B. COSMIN Guideline for Systematic Reviews of Patient-Reported Outcome Measures. Qual. Life Res. 2018, 27, 1147–1157. [Google Scholar] [CrossRef] [Green Version]
  24. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Lawrence Erlbaum Associates: Hillsdale, NJ, USA, 1988; ISBN 978-0-8058-0283-2. [Google Scholar]
  25. Armstrong, R.A. When to Use the Bonferroni Correction. Ophthalmic Physiol. Opt. 2014, 34, 502–508. [Google Scholar] [CrossRef]
  26. Raftery, A.E.; Madigan, D.; Hoeting, J.A. Bayesian Model Averaging for Linear Regression Models. J. Am. Stat. Assoc. 1997, 92, 179–191. [Google Scholar] [CrossRef]
  27. Raftery, A.E. Bayesian Model Selection in Social Research (with Discussion by Andrew Gelman & Donald B. Rubin, and Robert M. Hauser, and a Rejoinder); Marsden, P.V., Ed.; Blackwells: Cambridge, MA, USA, 1995. [Google Scholar]
  28. Genell, A.; Nemes, S.; Steineck, G.; Dickman, P.W. Model Selection in Medical Research: A Simulation Study Comparing Bayesian Model Averaging and Stepwise Regression. BMC Med. Res. Methodol. 2010, 10, 108. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Wang, D.; Zhang, W.; Bakhai, A. Comparison of Bayesian Model Averaging and Stepwise Methods for Model Selection in Logistic Regression. Stat. Med. 2004, 23, 3451–3467. [Google Scholar] [CrossRef] [PubMed]
  30. Hespanhol, L.; Vallio, C.S.; Costa, L.M.; Saragiotto, B.T. Understanding and Interpreting Confidence and Credible Intervals around Effect Estimates. Braz. J. Phys. 2019, 23, 290–301. [Google Scholar] [CrossRef] [PubMed]
  31. Hoeting, J.A.; Madigan, D.; Raftery, A.E.; Volinsky, C.T. Bayesian Model Averaging: A Tutorial. Stat. Sci. 1999, 14, 382–417. [Google Scholar] [CrossRef]
  32. Van den Bergh, D.; Clyde, M.A.; Gupta, A.R.K.N.; de Jong, T.; Gronau, Q.F.; Marsman, M.; Ly, A.; Wagenmakers, E.-J. A Tutorial on Bayesian Multi-Model Linear Regression with BAS and JASP. Behav. Res. 2021, 53, 2351–2371. [Google Scholar] [CrossRef]
  33. AlHeresh, R.; LaValley, M.P.; Coster, W.; Keysor, J.J. Construct Validity and Scoring Methods of the World Health Organization: Health and Work Performance Questionnaire Among Workers With Arthritis and Rheumatological Conditions. J. Occup. Environ. Med. 2017, 59, e112–e118. [Google Scholar] [CrossRef]
  34. Geuskens, G.A.; Hazes, J.M.; Barendregt, P.J.; Burdorf, A. Predictors of Sick Leave and Reduced Productivity at Work among Persons with Early Inflammatory Joint Conditions. Scand. J. Work. Environ. Health 2008, 34, 420–429. [Google Scholar] [CrossRef]
  35. Kawai, K.; Kawai, A.T.; Wollan, P.; Yawn, B.P. Adverse Impacts of Chronic Pain on Health-Related Quality of Life, Work Productivity, Depression and Anxiety in a Community-Based Study. Fam. Pract. 2017, 34, 656–661. [Google Scholar] [CrossRef]
Table 1. Items in the Work Productivity and Activity Impairment Questionnaire: General Health (WPAI:GH) and the World Health Organization’s Health and Work Performance Questionnaire (WHO-HPQ).
Table 1. Items in the Work Productivity and Activity Impairment Questionnaire: General Health (WPAI:GH) and the World Health Organization’s Health and Work Performance Questionnaire (WHO-HPQ).
WPAI:GH [11,18]WHO-HPQ (Short Form) [1,2,19]
ConstructSix questions:
Q1: Current employment status;
Q2: Hours missed because of illness;
Q3: Hours missed for other reasons;
Q4: Hours actually worked;
Q5: Degree of illness that affected productivity while working;
Q6: Degree of illness that affected regular activities.
Five main questions:
B3: The number of hours the employee worked in the past 7 days;
B4: The number of hours the employer expects the employee to work in a typical 7-day week;
B6: The number of hours the employee worked in the past 4 weeks (28 days);
B9: How the employee rates the usual performance of most workers in a job similar to his/hers;
B11: How the employee rates his/her overall productivity on days he/she worked during the past 4 weeks (28 days).
ScoringThe scores were multiplied by 100 to convert them into percentages. The WPAI:GH has four outcomes as follows:
(1)
Absenteeism = Q2/(Q2 + Q4) × 100;
(2)
Presenteeism = Q5/10 × 100;
(3)
Overall work impairment = Q2/(Q2 + Q4) + [(1 − (Q2/(Q2 + Q4))) × (Q5/10)] × 100;
(4)
Activity impairment = Q6/10 × 100.
The WHO-HPQ has eight outcomes as follows:
Absenteeism (Using 4-week estimates):
(1)
Absolute absenteeism = 4 × B4 − B6;
(2)
Relative absenteeism = (4 × B4 − B6)/(4 × B4);
(3)
Relative hours of work = B6/(4 × B4);
Absenteeism (Using 7-day estimates):
(4)
Absolute absenteeism = (4 × B4) − (4 × B3);
(5)
Relative absenteeism = ((4 × B4) − (4 × B3))/(4 × B4);
(6)
Relative hours of work = B3/B4;
Presenteeism:
(7)
Absolute presenteeism = 10 × B11;
(8)
Relative presenteeism = B11/B9
InterpretationWPAI:GH outcomes estimate impairment percentages, with higher impairment indicating lower productivity.Higher scores of absenteeism indicate higher amounts of productivity loss (hours lost per month).
A higher score of presenteeism indicates a lower amount of productivity loss.
Table 2. Associations of the C-WPAI:GH and C-WHO-HPQ with the Short Form (SF-36) using Spearman’s correlation coefficients (rs and p values).
Table 2. Associations of the C-WPAI:GH and C-WHO-HPQ with the Short Form (SF-36) using Spearman’s correlation coefficients (rs and p values).
C-WPAI:GH
AbsenteeismPresenteeismOverall Work ImpairmentActivity Impairment
Physical functioningrs = −0.39; p < 0.0001rs = −0.74; p < 0.0001rs = −0.74; p < 0.0001rs = −0.68; p < 0.0001
Role—physicalrs = −0.37; p < 0.0001rs = −0.73; p < 0.0001rs = −0.73; p < 0.0001rs = −0.66; p < 0.0001
Bodily painrs = −0.45; p < 0.0001rs = −0.73; p < 0.0001rs = −0.74; p < 0.0001rs = −0.66; p < 0.0001
General healthrs = −0.40; p < 0.0001rs = −0.57; p < 0.0001rs = −0.57; p < 0.0001rs = −0.57; p < 0.0001
Vitalityrs = −0.35; p < 0.0001rs = −0.54; p < 0.0001rs = −0.53; p < 0.0001rs = −0.59; p < 0.0001
Social functioningrs = −0.37; p < 0.0001rs = −0.70; p < 0.0001rs = −0.70; p < 0.0001rs = −0.76; p < 0.0001
Role—emotionalrs = 0.02; p = 0.78rs = −0.22; p = 0.005rs = −0.21; p = 0.006rs = −0.33; p < 0.0001
Mental healthrs = −0.25; p = 0.001rs = −0.36; p < 0.0001rs = −0.36; p < 0.0001rs = −0.44; p < 0.0001
C-WHO-HPQ
Absolute Absenteeism aRelative Absenteeism aRelative Hours of Work aAbsolute Absenteeism bRelative Absenteeism bRelative Hours of Work bAbsolute PresenteeismRelative Presenteeism
Physical functioningrs = −0.03;
p = 0.70
rs = −0.03;
p = 0.68
rs = 0.03;
p = 0.68
rs = −0.01;
p = 0.88
rs = −0.01;
p = 0.88
rs = 0.01;
p = 0.88
rs = 0.33;
p < 0.0001
rs = 0.08;
p = 0.34
Role–physicalrs = −0.03;
p = 0.66
rs = −0.04;
p = 0.64
rs = 0.03;
p = 0.68
rs = −0.04;
p = 0.64
rs = −0.04;
p = 0.64
rs = 0.04;
p = 0.64
rs = 0.32;
p < 0.0001
rs = 0.12;
p = 0.13
Bodily painrs = −0.07;
p = 0.38
rs = −0.07;
p = 0.37
rs = 0.07;
p = 0.37
rs = −0.05;
p = 0.53
rs = −0.05;
p = 0.53
rs = 0.05;
p = 0.53
rs = 0.29;
p = 0.0001
rs = 0.04;
p = 0.65
General healthrs = −0.09;
p = 0.26
rs = −0.09;
p = 0.25
rs = 0.09;
p = 0.25
rs = −0.06;
p = 0.46
rs = −0.06;
p = 0.45
rs = 0.06;
p = 0.45
rs = 0.42;
p < 0.0001
rs = 0.27;
p = 0.0005
Vitalityrs = −0.06;
p = 0.43
rs = −0.06;
p = 0.42
rs = 0.06;
p = 0.42
rs = −0.06;
p = 0.44
rs = −0.06;
p = 0.43
rs = 0.06;
p = 0.43
rs = 0.45;
p < 0.0001
rs = 0.17;
p = 0.03
Social functioningrs = −0.01;
p = 0.93
rs = −0.01;
p = 0.90
rs = 0.01;
p = 0.90
rs = 0.03;
p = 0.69
rs = 0.03;
p = 0.70
rs = −0.03;
p = 0.70
rs = 0.42;
p < 0.0001
rs = 0.18;
p = 0.02
Role–emotionalrs = 0.21;
p = 0.006
rs = 0.21;
p = 0.006
rs = −0.21;
p = 0.006
rs = 0.20;
p = 0.01
rs = 0.20;
p = 0.009
rs = −0.20;
p = 0.009
rs = 0.22;
p = 0.005
rs = −0.02;
p = 0.81
Mental healthrs = −0.04;
p = 0.59
rs = −0.04;
p = 0.57
rs = 0.04;
p = 0.57
rs = −0.03;
p = 0.69
rs = −0.03;
p = 0.68
rs = 0.03;
p = 0.68
rs = 0.35;
p < 0.0001
rs = 0.18;
p = 0.02
a 4-week estimates; b 7-day estimates.
Table 3. Associations of the C-WPAI:GH and C-WHO-HPQ with disability status and job satisfaction (mean ± standard deviation).
Table 3. Associations of the C-WPAI:GH and C-WHO-HPQ with disability status and job satisfaction (mean ± standard deviation).
Productivity ScoresWork-Related Disability
(n = 131)
Non-Work-Related Disability
(n = 3)
No Disability
(n = 31)
Disability Status
F Value, p Value, df
Job Satisfaction
F Value, p Value, df
C-WPAI:GH
Absenteeism1.71 ± 7.222.10 ± 8.040 ± 00.23 ± 1.28F = 0.88; p = 0.42; df = 2F = 15.8; p < 0.0001; df = 4
Presenteeism26.67 ± 28.3831.45 ± 29.140 ± 09.03 ± 15.13F = 11.30; p < 0.0001; df = 2F = 13.19; p < 0.0001; df = 4
Overall work impairment 27.03 ± 28.8431.86 ± 29.690 ± 09.26 ± 15.05F = 11.08; p < 0.0001; df = 2F = 13.57; p < 0.0001; df = 4
Activity impairment25.52 ± 28.5329.85 ± 29.350 ± 09.68 ± 17.60F = 9.09; p = 0.0002; df = 2F = 17.33; p < 0.0001; df = 4
C-WHO-HPQ
Absolute absenteeism a−0.63 ± 26.78−0.15 ± 23.53−1.00 ± 1.73−2.65 ± 38.95F = 1.48; p = 0.23; df = 2F = 2.31; p = 0.06; df = 4
Relative absenteeism a−0.01 ± 0.12−0.01 ± 0.10−0.01 ± 0.01−0.04 ± 0.17F = 1.85; p = 0.16; df = 2F = 4.03; p = 0.004; df = 4
Relative hours of work a1.01 ± 0.121.01 ± 0.101.01 ± 0.011.04 ± 0.17F = 1.85; p = 0.16; df = 2F = 4.03; p = 0.004; df = 4
Absolute absenteeism b−6.52 ± 31.66−5.53 ± 27.590 ± 0−11.35 ± 46.33F = 2.14; p = 0.12; df = 2F = 1.72; p = 0.15; df = 4
Relative absenteeism b−0.05 ± 0.17−0.04 ± 0.160 ± 0−0.09 ± 0.23F = 2.29; p = 0.10; df = 2F = 2.49; p = 0.045; df = 4
Relative hours of work b1.05 ± 0.171.04 ± 0.161 ± 01.09 ± 0.23F = 2.29; p = 0.10; df = 2F = 2.49; p = 0.045; df = 4
Absolute presenteeism79.03 ± 19.8578.40 ± 20.64100 ± 079.68 ± 16.22F = 1.74; p = 0.18; df = 2F = 31.95; p < 0.0001; df = 4
Relative presenteeism0.99 ± 0.190.98 ± 0.201 ± 01.06 ± 0.15F = 2.50; p = 0.09; df = 2F = 19.02; p < 0.0001; df = 4
df: degrees of freedom; a 4-week estimates; b 7-day estimates.
Table 4. Associations between the C-WHO-HPQ and C-WPAI:GH.
Table 4. Associations between the C-WHO-HPQ and C-WPAI:GH.
C-WPAI:GHAbsenteeismPresenteeismOverall Work ImpairmentActivity Impairment
C-WHO-HPQ
Absolute absenteeism ars = 0.42; p < 0.0001rs = 0.07; p = 0.39rs = 0.08; p = 0.29rs = −0.02; p = 0.72
Relative absenteeism ars = 0.43; p < 0.0001rs = 0.07; p = 0.38rs = 0.08; p = 0.28rs = −0.03; p = 0.75
Relative hours of work ars = −0.43; p < 0.0001rs = −0.07; p = 0.38rs = −0.08; p = 0.28rs = 0.03; p = 0.75
Absolute absenteeism brs = 0.46; p < 0.0001rs = 0.03; p = 0.74rs = 0.04; p = 0.57rs = −0.03; p = 0.71
Relative absenteeism brs = 0.47; p < 0.0001rs = 0.03; p = 0.73rs = 0.05; p = 0.57rs = −0.03; p = 0.72
Relative hours of work brs = −0.47; p < 0.0001rs = −0.03; p = 0.73rs = −0.05; p = 0.57rs = 0.03; p = 0.72
Absolute presenteeismrs = −0.32; p < 0.0001rs = −0.48; p < 0.0001rs = −0.48; p < 0.0001rs = −0.45; p < 0.0001
Relative presenteeismrs = −0.29; p = 0.0002rs = −0.11; p = 0.16rs = −0.11; p = 0.17rs = −0.11; p = 0.17
a 4-week estimate; b 7-day estimates.
Table 5. Factors correlated with the C-WPAI:GH using Bayesian model averaging (regression coefficient β and 95% credible interval (95% CrI)).
Table 5. Factors correlated with the C-WPAI:GH using Bayesian model averaging (regression coefficient β and 95% credible interval (95% CrI)).
C-WPAI:GH
AbsenteeismPresenteeismOverall Work
Impairment
Activity Impairment
Age 0.52 (0.09; 0.95)0.53 (0.10; 0.96)0.45 (0.02; 0.88)
Gender (female vs. male)
Education (vs. junior high school)
Senior high school8.81 (0.22; 17.40)29.94 (6.46; 53.41)
Undergraduate9.13 (0.47; 17.79)29.28 (5.62; 52.95)
Postgraduate8.21 (−1.03; 17.44)20.81 (−4.42; 46.05)
Job (vs. manager, professional)
Disability status
(vs. work-related disability)
Non-work-related disability
No disability
Job satisfaction
(vs. completely dissatisfied)
Moderately dissatisfied−9.06 (−14.04; −4.09)
Neither satisfied nor dissatisfied−10.58 (−15.90; −5.25)
Moderately satisfied−10.27 (−15.65; −4.90)
Completely satisfied−9.41 (−16.06; −2.76)
Physical functioning−0.41 (−0.59; −0.22)
Role—physical
Role—emotional
Bodily pain −0.56 (−0.75;−0.36)−0.56 (−0.76; −0.36)−0.45 (−0.65; −0.25)
Social functioning −0.33 (−0.57; −0.09)−0.33 (−0.57; −0.08)−0.50 (−0.74; −0.25)
Mental health
Vitality
General health −0.27 (−0.50; −0.04)−0.27 (−0.50; −0.04)−0.30 (−0.53; −0.07)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ta-Thi, K.-N.; Chuang, K.-J. A Comparison of the Validities of Traditional Chinese Versions of the Work Productivity and Activity Impairment Questionnaire: General Health and the World Health Organization’s Health and Work Performance Questionnaire. Int. J. Environ. Res. Public Health 2022, 19, 4417. https://doi.org/10.3390/ijerph19074417

AMA Style

Ta-Thi K-N, Chuang K-J. A Comparison of the Validities of Traditional Chinese Versions of the Work Productivity and Activity Impairment Questionnaire: General Health and the World Health Organization’s Health and Work Performance Questionnaire. International Journal of Environmental Research and Public Health. 2022; 19(7):4417. https://doi.org/10.3390/ijerph19074417

Chicago/Turabian Style

Ta-Thi, Kim-Ngan, and Kai-Jen Chuang. 2022. "A Comparison of the Validities of Traditional Chinese Versions of the Work Productivity and Activity Impairment Questionnaire: General Health and the World Health Organization’s Health and Work Performance Questionnaire" International Journal of Environmental Research and Public Health 19, no. 7: 4417. https://doi.org/10.3390/ijerph19074417

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop