Back to Journals » Patient Related Outcome Measures » Volume 10
![Highly-accessed](assets/img/article_icons/highly-accessed.png)
The Oxford Participation and Activities Questionnaire (Ox-PAQ): development of a short form and index measure
Authors Jenkinson C , Kelly L, Dummett S, Morley D
Received 29 March 2019
Accepted for publication 9 July 2019
Published 29 July 2019 Volume 2019:10 Pages 227—232
DOI https://doi.org/10.2147/PROM.S210416
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 2
Editor who approved publication: Dr Robert Howland
Crispin Jenkinson, Laura Kelly, Sarah Dummett, David Morley
Health Services Research Unit, Nuffield Department of Population Health, University of Oxford, Oxford OX3 7LF, UK
Background: The Oxford Participation and Activities Questionnaire (Ox-PAQ) is a 23-item patient-reported outcome measure (PROM) theoretically grounded in the World Health Organisation International Classification of Functioning, Disability and Health. Initial validation of the Ox-PAQ identified three domains; routine activities (14 items), emotional well-being (5 items) and social engagement (4 items). The purpose of the analyses reported here were to determine whether an overall index score can be calculated from the measure, and then to determine whether a shorter form measure can replicate results on the index score.
Methods: Two surveys of people with long term conditions were undertaken. In the first study, higher order factor analysis is used to determine that a single index score can be calculated for the Ox-PAQ. Regression analyses are used to determine a sub-set of items selected for the Short Form Ox-PAQ (SF-Ox-PAQ). In the second study, results on the Ox-PAQ Single Index and SF-Ox-PAQ Single Index are compared with results from another generic measure, the EuroQol EQ-5D-5l.
Results: Higher order factor analysis confirmed that a single index score can be created from the Ox-PAQ. Further, linear regression indicated 14 items could reliably and accurately produce this index. The two methods of creating the index were highly correlated (ICC =0.99). The two indices were found to provide almost identical levels of correlation with EQ-5D-5L scores.
Conclusion: Results indicate that the Ox-PAQ can be summed to provide an index score, and, furthermore, a sub set of fourteen items can very closely replicate the results gained from the original parent form.
Keywords: activity, participation, routine activities, higher order factor analysis, summary index
Background
The Oxford Participation and Activities Questionnaire (Ox-PAQ) is a 23-item patient-reported outcome measure (PROM), theoretically grounded in the World Health Organisation International Classification of Functioning, Disability and Health.1 The measure is a generic PROM. It is intended primary use is in clinical trials, as well as in the evaluation of interventions targeted at improving and/or maintaining participation and activity. However, as a generic measure it permits comparison across treatment groups, and populations.
The development of the Ox-PAQ has been reported elsewhere.2–8 A key feature of the development process is its compliance with current best practice guidelines, such as those provided by the United States Food and Drug Administration (FDA) and European Medicines Agency (EMA).9,10 The content of the measure was based upon interviews with lay people diagnosed with a variety of illness conditions. Subsequent exploratory factor analyses and validation of the measure in patient surveys6–8 identified three domains; Routine Activities (14 items), Emotional Well-Being (5 items) and Social Engagement (4 items). Analyses indicated that the measure demonstrates good reliability and validity and low levels of missing data across all three domains. Furthermore, the operating characteristics of the instrument have been found to be stable across paper and computer forms of administration7,8 To date no evidence has been presented suggesting an overall index score could be calculated for the measure. Such an index may prove useful as a general summary of the health of respondents, and can reduce the role of chance, due to multiple comparisons when analyses include all individual dimensions of a PROM, in trials where the measure is adopted as a secondary outcome. It is hypothesised here that a single index can be derived for the Ox-PAQ and results from this Index can also be obtained from a shorter form version. It is also hypothesised that results from the two measures would be virtually identical, and demonstrate a very similar level of correlation with another generic patient outcome measure. The methods adopted have been used on a variety of instruments to both provide summary scores and make them more economic in nature (and hence less of a burden to patients).11–13
The purpose of this paper is to report (i) procedures undertaken to determine if the three dimensions of the Ox-PAQ can meaningfully be summed into a single index measure, and (ii) to determine if a subset of items will replicate the results of the single index but in a shorter measure. Two studies are reported, based upon two separate surveys, one detailing the development of the index score and Short Form Ox-PAQ (SF-Ox-PAQ), and a second to determine that the two Ox-PAQ measures have similar operating characteristics, in terms of convergent validity, by comparing results on the two measures with another generic index score of health, the EQ-5D-5L.14
Study 1: the development of the Ox-PAQ index and SF-Ox-PAQ
Methods
Ethical approval for the data collected in the analyses reported here was granted by the Medical Sciences Inter Divisional Research Ethics Committee of the University of Oxford (ref: R44281/RE001).
Participants
Three hundred and seventy three people with a primary diagnosis of chronic obstructive pulmonary disease (COPD), multiple sclerosis (MS) or Parkinson’s disease (PD) were recruited via their respective support organisations in the United Kingdom; the British Lung Foundation, MS Society and Parkinson’s UK. Informed consent to participate in the study was obtained from each participant. Participants must have had a confirmed diagnosis of the relevant condition, be 18 years of age or over and competent in the use of English.
Materials
Procedure
Recruitment was undertaken via adverts on the relevant charities website, and potential participants contacted a member of the research team via email. They were consented into the study and subsequently forwarded a unique link to the survey. An e-based version of the Ox-PAQ was administered via Qualtrics survey software.15 Demographic information (gender, age, primary condition, age at diagnosis, marital status, employment status and ethnicity) was collected prior to completion of the Ox-PAQ.
Statistical analysis
Data were checked for the presence of outliers and normality of distribution prior to statistical analysis. Furthermore, tests of significance were conducted to determine that factor analytic procedures could be meaningfully be carried out on the data.16 The three domain scores of the Ox-PAQ were subjected to higher order principal components analysis. Reliability was assessed via Cronbach’s alpha.17 A single score was calculated from the Ox-PAQ by summing all three domains and expressing results on a metric of 0–100. Higher scores indicate greater problems with activity and participation. Linear regression of items for each of the three Ox-PAQ dimensions were separately run against the Index to determine those which were significantly predictive of the Index. These items were summed to create an Index and this “Short Form” Index was compared to the parent version using the intra-class correlation coefficient (ICC). Due to the nature of the analyses, i.e. validating a parent measure against a shorter form, any respondents with missing data were removed. Data were analysed using SPSS Version 23.
Results
Three hundred and forty people fully completed the Ox-PAQ, a response rate of 91.4%. The sample comprised 140 males and 199 females, had a combined mean age of 61.52, a mean age at diagnosis of 52.51 and mean disease duration of 9.01 years. Detailed sample characteristics by disease group are reported in Table 1.
![]() |
Table 1 Sample characteristics |
The Kaiser-Meyer Olkin (KMO) and Bartlett’s Test measure of sampling adequacy were used to examine the appropriateness of factor analytic techniques. Chi-square was 590.04 with 3 degrees of freedom, which is significant at 0.001 level. The KMO statistic of 0.70 is also acceptable. Hence factor analysis is as an appropriate technique for further analysis of the data. In the principal components analysis one factor with an Eigenvalue in excess of one was identified, accounting for 80.52% of the variance. Each domain of the Ox-PAQ loaded on this one factor which had an eigenvalue of 2.42. Consequently, all three domains of the Ox-PAQ were summed to create a summary index score. The mean of the Summary Index figure was 43.16. (S.D. =23.66, min =0.00, max =96.73, n=340). Cronbach’s alpha value was calculated as 0.88.
Three linear regressions were undertaken of items in the three dimensions of the Ox-PAQ against the Summary Index. Seven items from the Routine Activity dimension were found to be statistically significant predictors of the Index, with an adjusted R2 of 0.88. Three items from the Emotional Well-Being scale were found to be predictors of the Summary Index (R2 = 0.77). The regression of items in the Social Engagement dimension indicated all four to be predictive of the Single Index (R2=0.88), leading to a total of 14 items (see Table 2). Cronbach’s alpha for the 14 items was calculated as 0.93. Results gained from the two indices are compared in Table 3 and indicate the Short Form replicates the results of the parent form to a very high degree. Furthermore, intra-class correlation coefficients of the Ox-PAQ Index and Short Form Ox-PAQ Index were found to be very high: ICC =0.99 (p<0.001) for each condition.
![]() |
Table 2 Items found to be significantly predictive (p≤0.01) of their own scale scores in three independent linear regressions |
![]() |
Table 3 Comparison of results from the Ox-PAQ summary index against those derived from the SF-Ox-PAQ Summary Index across three conditions |
Study 2: validation of the Ox-PAQ index and short form and comparison with results from the EQ-5D
Methods
Ethical approval for this aspect of the Ox-PAQ study was granted by the Medical Sciences Inter Divisional Research Ethics Committee of the University of Oxford (reference MSD-IDREC-C1-2014–089).
Participants
Recruitment of participants was undertaken over a period of 6 months with the assistance of three patient support organizations: the Motor Neurone Disease Association, MS Society, and Parkinson’s UK. The organizations advertised the study through various means, including social media, Web sites, print and electronic publications, research bulletin boards, and emails, inviting potential participants to contact the research team to express their interest in taking part. Participants were required to have a confirmed diagnosis of motor neurone disease (MND), multiple sclerosis (MS), or Parkinson’s disease (PD), as well as the ability to complete the survey independently. Participants were also required to be competent in the use of English, be aged 18 years or above, and be living in the UK.
Procedure
The survey booklet which contained questions on demographic variables (including sex, age, age at diagnosis), the Ox-PAQ (as detailed earlier), and the EQ-5D-5L. The EQ-5D-5L12 is a five-item generic measure assessing mobility, self-care, usual activities, pain/discomfort, and anxiety/depression. Initially developed with questions answered on a three-point Likert scale, a revised version of the measure now incorporates a five-point Likert scale. The EQ-5D-5L includes a visual analogue scale (VAS) to indicate general health, with a score of zero reflecting worst health status and 100 indicating the best possible health status. Recent studies18–20 suggest that the updated measure is both valid and reliable.
After contacting the research team by telephone or email, participants were sent the booklet of questionnaires and a written consent form for completion and return. A follow-up email or letter was sent to non-responders after 2 weeks.
Statistical analysis
A single Score was calculated for the Ox-PAQ and the SF-Ox-PAQ. Descriptive statistics were calculated for both measures, and results compared by intra-class correlation coefficient. Results were then correlated (Spearman’s rho) with results on the EQ-5D-5L Index and Visual Analogue Scale (VAS).
Results
A total of 334 participants completed the postal survey, a response rate of 86.5%. 97 (29.04%) respondents reported a diagnosis of MND, 100 (29.94%) a diagnosis of MS and 137 (41.02%) a diagnosis of PD. Mean age was 60.06 years (SD 12.10; range 24–88), mean age at diagnosis 52.82 years (SD 14.50; range 18–87) and mean disease duration 7.31 years (SD 7.52; range 0–50). The sample comprised 162 males (48.5%) and 172 females (51.5%). Mean scores for the measures for the entire sample were found to be very similar: a mean of 42.14 (SD 24.40, 39.42–44.86, n=309) on the Ox-PAQ compared to a mean of 42.67 (SD 24.43, 95% CI 39.95–45.39, n=309) on the SF-Ox-PAQ. A similar picture emerged when analyses were broken down by condition with scores on the two measures never varying by more than one point. As in the development survey reported above the two measures were found to be highly correlated (ICC=0.99, p<0.001, n=309). Furthermore, the measures were found to exhibit similar characteristics when compared to the EQ-5D. The Ox-PAQ and SF-Ox-PAQ were correlated with the EQ-5D-5L rho= −0.81 (p<0.001, n=308) and −0.80 (p<0.001, n=308) respectively (negative correlations are due to the fact that scoring conventions differ with high scores on the EQ-5D-5L indicating good health and high scores on the Ox-PAQ indicating poor health). A similar picture emerged when comparing results on the two measures with the EQ-5D VAS with the Ox-PAQ and SF-Ox-PAQ correlated with the VAS rho=−0.71 (p<0.001, n=307) and 0.70 (p<0.001, n=307) respectively.
Discussion
Single indices have been found to be useful summary scores of the overall impact of health conditions, whilst shorter form measures reduce respondent burden.21,22 The results reported here suggest that a single index can be meaningfully gained from the Ox-PAQ. Higher order factor analysis supports the derivation of a single index summary score for the measure. Reliability of the Summary Index was assessed using Cronbach’s alpha and found to be high indicating that the index created by summing the three domains is internally consistent and reproducible. The construct validity of the measure was assessed by comparing the results of the Ox-PAQ Summary Index with the EQ-5D-5L.
Data from the Ox-PAQ can be presented in profile form as well as summarised in the Ox-PAQ Summary Index. Thus, the impact of treatment on specific domains of well-being and functioning can be evaluated with the profile scores, whilst the overall impact of the disease on participation and activities, as measured by the Ox-PAQ, can be assessed using the Summary Index. Such an index has the potential for use in the evaluation of different treatments as interpretation of a single figure can often be less complex than that of a profile of scores. Furthermore, the adoption of a single index measure of outcome can reduce the number of statistical comparisons and consequently reduce the role of chance in testing hypotheses about health outcomes.
Regression analyses suggested a sub-set of items from the Ox-PAQ could create a Short Form Ox-PAQ that can provide the Summary Index. The operating characteristics of the two Ox-PAQ Summary Indices were evaluated by assessing the construct validity against the EQ-5D-5L Index and VAS. Virtually identical correlations were found for the Ox-PAQ Single Index and SF-Ox-PAQ Single Index against the EQ-5D-5L scores.
It is recognised that the methods of recruitment for the reported studies were self-selecting in nature, and the samples may not therefore be fully representative of the illness groups that participated. Additionally it is acknowledged that the samples recruited for electronic completion of the measures may not be entirely representative of their illness groups, as not all will have access to electronically administered measures or be computer literate.
In conclusion, in instances where a detailed profile of scores is required the SF-Ox-PAQ will not be the instrument of choice, but in instances where an overall index is required, or where the additional burden of the Ox-PAQ is unacceptable, the SF-Ox-PAQ represents an economical and informative instrument. Further studies will provide evidence of the psychometric properties in additional disease groups.
Copies of the Ox-PAQ, a User Manual and licences for its use can be obtained from Clinical Outcomes at Oxford University Innovation: https://innovation.ox.ac.uk/clinical-outcomes/.
Abbreviations
COPD, chronic obstructive pulmonary disease; EQ-5D-5L, Euroqol five dimension five level questionnaire; ICC, intra-class correlation ceofficient; KMO, Kaiser-Meyer-Olkin; MND, Motor Neurone Disease; MS, multiple sclerosis; Ox-PAQ, Oxford Participation and Activities Questionnaire; PD, Parkinson’s disease; SF-Ox-PAQ, Short-Form Oxford Participation and Activities Questionnaire.
Availability of data and material
The datasets analysed for the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
Ethical approval was granted by the Medical Sciences Inter Divisional Research Ethics Committee of the University of Oxford (refs: R44281/RE001 and MSD-IDREC-C1-2014-089). Informed consent to participate was obtained from all participants.
Acknowledgments
We would like to acknowledge the following organisations for their support in recruiting participants for this study: the British Lung Foundation, MND Association, MS Society and Parkinson’s UK. We would also like to acknowledge the continued support and assistance of Dr Mary Baker MBE, Immediate Past President, European Brain Council. Finally, we wish to thank the participants who so readily gave their time to take part in the study. Development and validation of the Ox-PAQ were funded by the European Brain Council.
Author contributions
All authors contributed to data analysis, drafting or revising the article, gave final approval of the version to be published, and agree to be accountable for all aspects of the work.
Disclosure
All authors are developers of the Ox-PAQ and will receive royalties from its use in commercial contexts. All authors have also undertaken consultancy work for Oxford University Innovation, the copyright holder of the Ox-PAQ. The authors report no other conflicts of interest in this work.
References
1. World Health Organisation. International Classification of Functioning, Disability and Health. Geneva: World Health Organisation; 2001.
2. Morley D, Dummett S, Kelly L, Dawson J, Fitzpatrick R, Jenkinson C. The Oxford Participation and Activities Questionnaire: study protocol. Patient Relat Outcome Meas. 2014;5:1–6.
3. Kelly L, Jenkinson C, Dummett S, Dawson J, Fitzpatrick R, Morley D. Development of the Oxford Participation and Activities Questionnaire: constructing an item pool. Patient Relat Outcome Meas. 2015;6:145–155. doi:10.2147/PROM.S82121
4. Kelly L, Dummett S, Dawson J, Fitzpatrick R, Jenkinson C, Morley D. Generating items for the Oxford Participation and Activities Questionnaire (Ox-PAQ). Qual Life Res. 2014;23(Suppl 1):81–82.
5. Morley D, Dummett S, Kelly L, Dawson J, Fitzpatrick R, Jenkinson C. Pretesting the Oxford Participation and Activities Questionnaire: results from an expert review. Mov Disord. 2015;30(Suppl 1):S419.
6. Morley D, Dummett S, Kelly L, Dawson J, Fitzpatrick R, Jenkinson C. Validation of the Oxford Participation and Activities Questionnaire. Patient Relat Outcome Meas. 2016;7:73–80. doi:10.2147/PROM.S96822
7. Kelly L, Dummett S, Dawson J, et al. Pretesting an e-based version of the Oxford Participation and Activities Questionnaire (Ox-PAQ). Value Health. 2016;19:A485. doi:10.1016/j.jval.2016.09.804
8. Morley D, Dummett S, Kelly L, Dawson J, Fitzpatrick R, Jenkinson C. Ox-PAQ User Manual. Oxford: Health Services Research Unit; 2016.
9. Food and Drug Administration, Department of Health and Human Sciences. Guidance to Industry. Patient Reported Outcome Measures. Use in Medical Product Development to Support Labelling Claims. Silver Spring, MD: Food and Drug Administration; 2009.
10. European Medicines Agency (EMA). Reflection paper on the regulatory guidance for the use of health-related quality of life (HRQL) measures in the evaluation of medicinal products. EMEA/CHMP/EWP139391/2004. 2004.
11. Muhlan H, Bullinger M, Power M, Schmidt S. Short forms of subjective quality of life assessments from cross-cultural studies for use in surveys with different populations. Clinical Psychol Psychother. 2008;15:142–153. doi:10.1002/cpp.573
12. Ware J, Kosinski M, Keller SD. A 12 item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34:220–233.
13. Jones G, Jenkinson C, Kennedy S, Development of the short form endometriosis health profile questionnaire: the EHP-5. Qual Life Res. 2004;13:705–713. doi:10.1023/B:QURE.0000021316.79349.af
14. Herdman M, Gudex C, Lloyd A, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–1736. doi:10.1007/s11136-011-9903-x
15. Qualtrics, 2005. Copyright Year: 2017. Provo, Utah, USA.
16. Bartlett MS. Tests of significance in factor analysis. Br J Math Stat Psychol. 1950;3(2):77–85. doi:10.1111/j.2044-8317.1950.tb00285.x
17. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334. doi:10.1007/BF02310555
18. Janssen MF, Pickard AS, Golicki D, et al. Measurement properties of the EQ-5D-5L compared to the EQ-5D-3L across eight patient groups: a multi-country study. Qual Life Res. 2013;22(7):1717–1727. doi:10.1007/s11136-012-0169-8
19. Keeley T, Al-Janabi H, Lorgelly P, Coast J. A qualitative assessment of the content validity of the ICECAP-A and EQ-5D-5L and their appropriateness for use in health research. PLoS One. 2013;8(12):e85287. doi:10.1371/journal.pone.0085287
20. Kim SH, Kim HJ, Lee SI, Jo MW. Comparing the psychometric properties of the EQ-5D-3L and EQ-5D-5L in cancer patients in Korea. Qual Life Res. 2012;21(6):1065–1073. doi:10.1007/s11136-011-0018-1
21. Peto V, Jenkinson C, Fitzpatrick R, Greenhall R. The development of a short measure of functioning and well being for individuals with Parkinson’s disease. Qual Life Res. 1995;4:241–248.
22. Jenkinson C, Fitzpatrick R, Peto V, Dummett S, Kelly L, Morley D. PDQ User Manual.
© 2019 The Author(s). This work is published and licensed by Dove Medical Press Limited. The
full terms of this license are available at https://www.dovepress.com/terms.php
and incorporate the Creative Commons Attribution
- Non Commercial (unported, v3.0) License.
By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted
without any further permission from Dove Medical Press Limited, provided the work is properly
attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.