J Patient Rep Outcomes. 2021 Oct 16;5(1):107. doi: 10.1186/s41687-021-00384-0.
Patient-reported outcome measures for clinical decision-making in outpatient follow-up: validity and reliability of a renal disease questionnaire.
Journal of patient-reported outcomes
Birgith Engelst Grove, Liv Marit Valen Schougaard, Per Ramløv Ivarsen, Derek Kyte, Niels Henrik Hjollund, Annette de Thurah
Affiliations
Affiliations
- AmbuFlex, Center for Patient-Reported Outcomes, Regional Hospital West Jutland, Herning, Denmark. [email protected].
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark. [email protected].
- AmbuFlex, Center for Patient-Reported Outcomes, Regional Hospital West Jutland, Herning, Denmark.
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark.
- Department of Renal Medicine, Aarhus University Hospital, Aarhus N, Denmark.
- School of Allied Health and Community, University of Worcester, Worcester, UK.
- Aarhus University, Aarhus, Denmark.
- AmbuFlex/WestChronic, Occupational Medicine, University Research Clinic, Aarhus University, Herning, Denmark.
- Department of Clinical Epidemiology, Aarhus University Hospital, Aarhus N, Denmark.
- Department of Rheumatology, Aarhus University Hospital, Aarhus N, Denmark.
PMID: 34655365
PMCID: PMC8520563 DOI: 10.1186/s41687-021-00384-0
Abstract
BACKGROUND: Patient-reported outcome measures are increasingly used by clinicians to support communication in telephone- or face-to-face consultations with patients. A renal disease questionnaire has been developed, but not sufficiently evaluated through clinimetrics in clinical setting. Hence, we aimed to evaluate the content validity, construct validity and the test-retest reliability of a renal disease questionnaire to be used for clinical decision-making.
METHODS: A content, construct validity and test-retest reliability study was conducted in 3 nephrology outpatient clinics in Central Denmark Region, Denmark. Content validity (face validity, comprehensibility and relevance) was assessed among 8 patients and 6 clinicians. Reliability was assessed by asking outpatients with chronic kidney disease to complete the questionnaire twice. Reliability was assessed by kappa statistics and agreement by percentage. Construct validity was determined using 4 a priori defined hypotheses and comparing 2 known groups.
RESULTS: Five new domains emerged, 6 items were rephrased and 3 items were removed following the content validity test. A total of 160 patients completed the questionnaire with median 8 days (IQR 2 days) between assessments. The test-retest reliability parameters of the single items in the questionnaire were substantial to almost perfect as all the observed weighted kappa values ranged from 0.61 to 0.91, 95% CI (0.34 to 0.95). In total, 61% of the single items showed almost perfect agreement. In total, 3 of the 4 hypotheses were accepted and 44% of the items showed satisfying known-group discriminative validity.
CONCLUSION: A renal disease questionnaire used for clinical decision-making in outpatient follow-up showed acceptable content validity and substantial to almost perfect reliability. Sufficient construct validity was not established. Incorporating the questionnaire into routine clinical practice may improve the evaluation of disease burden in patients with chronic kidney disease. We ask patients with chronic kidney disease (CKD) in Central Region Denmark to complete a questionnaire before each outpatient visit. The answers they provide are used to support communication with their health care provider. A questionnaire requires testing to ensure it can accurately capture important information about patient's symptoms and quality of life. When questionnaires are used to support communication between patients and health care professionals, they need to have good measurement properties. This means they need to be: (1) trustworthy, (2) relevant to a patient's health condition, (3) consistent and produce stable results every time. We explored the measurement properties of a questionnaire designed to be used in the face-to face outpatient visits for patients with CKD. We found that the questionnaire captured consistent and stable results. Using this questionnaire may help health care professionals to assess the patients´ burden of symptoms with a more patient-centered approach. Potentially, the use of the questionnaire will increase the patients´ ability to cope with their symptoms and strengthen patients´ involvement in the clinical decisions concerning their treatment.
© 2021. The Author(s).
Keywords: Ambulatory care; Patient reported outcome measures; Renal insufficiency; Reproducibility of results
References
- J Adv Nurs. 2003 Apr;42(1):57-63 - PubMed
- JAMA. 1995 Jan 4;273(1):59-65 - PubMed
- J Clin Epidemiol. 2010 Jul;63(7):737-45 - PubMed
- J Natl Cancer Inst. 1993 Mar 3;85(5):365-76 - PubMed
- JAMA. 2019 Jan 22;321(3):306-307 - PubMed
- Nephrol Dial Transplant. 2021 Apr 26;36(5):862-870 - PubMed
- J Clin Oncol. 2014 May 10;32(14):1480-501 - PubMed
- Qual Life Res. 2008 Mar;17(2):179-93 - PubMed
- Kidney Int. 2009 Nov;76(9):946-52 - PubMed
- Eur J Cancer. 2009 Feb;45(3):347-53 - PubMed
- J Patient Rep Outcomes. 2020 Jan 9;4(1):3 - PubMed
- Qual Life Res. 2002 May;11(3):193-205 - PubMed
- J Clin Epidemiol. 1998 Nov;51(11):1001-11 - PubMed
- J Comp Eff Res. 2016 Aug;5(5):507-19 - PubMed
- J Nephrol. 2008 Mar-Apr;21 Suppl 13:S84-91 - PubMed
- Nephron Clin Pract. 2007;105(1):c1-8 - PubMed
- Qual Life Res. 2012 Oct;21(8):1305-14 - PubMed
- J Patient Rep Outcomes. 2018 Sep 5;2:38 - PubMed
- Qual Life Res. 2010 May;19(4):539-49 - PubMed
- J Gerontol B Psychol Sci Soc Sci. 2009 Mar;64(2):212-21 - PubMed
- Nephrol Dial Transplant. 2021 Aug 27;36(9):1685-1693 - PubMed
- Qual Life Res. 1994 Oct;3(5):329-38 - PubMed
- Kidney Int. 2003 Jul;64(1):339-49 - PubMed
- JAMA. 2002 Dec 18;288(23):3027-34 - PubMed
- Br J Cancer. 2002 Jan 7;86(1):51-9 - PubMed
- Health Qual Life Outcomes. 2012 Jun 18;10:71 - PubMed
- Am J Epidemiol. 2011 Mar 15;173(6):676-82 - PubMed
- J Clin Oncol. 2004 Feb 15;22(4):714-24 - PubMed
- Psychother Psychosom. 2012;81(6):333-43 - PubMed
- J Clin Oncol. 2016 Feb 20;34(6):557-65 - PubMed
- J Chronic Dis. 1987;40(5):373-83 - PubMed
- Arthritis Care Res (Hoboken). 2018 Mar;70(3):353-360 - PubMed
- BMC Nephrol. 2012 Dec 13;13:170 - PubMed
- BMC Nephrol. 2017 Apr 3;18(1):119 - PubMed
- Am J Kidney Dis. 2013 Sep;62(3):541-8 - PubMed
- BMJ Qual Saf. 2014 Jun;23(6):508-18 - PubMed
- J Clin Epidemiol. 1998 Nov;51(11):991-9 - PubMed
- Qual Life Res. 2016 Mar;25(3):525-34 - PubMed
- Scand J Urol Nephrol. 2005;39(6):498-502 - PubMed
- Arthritis Care Res (Hoboken). 2020 Sep;72(9):1331-1338 - PubMed
- J Ren Care. 2013 Sep;39(3):140-50 - PubMed
- J Ren Care. 2015 Sep;41(3):146-55 - PubMed
- J Clin Epidemiol. 1998 Nov;51(11):1189-202 - PubMed
- West J Nurs Res. 2016 Aug;38(8):1067-82 - PubMed
- J Med Internet Res. 2019 Sep 30;21(9):e15856 - PubMed
- Clin J Am Soc Nephrol. 2007 Sep;2(5):919-25 - PubMed
- Nephrol Dial Transplant. 2010 Jan;25(1):160-6 - PubMed
- Lancet. 2017 Sep 2;390(10098):959-968 - PubMed
- BMC Res Notes. 2018 Jun 8;11(1):371 - PubMed
- Qual Life Res. 2019 Mar;28(3):567-592 - PubMed
- J Clin Epidemiol. 2007 Jan;60(1):34-42 - PubMed
- Qual Life Res. 2015 Jul;24(7):1707-18 - PubMed
- Fam Med. 2005 May;37(5):360-3 - PubMed
- Lancet. 2012 Jan 14;379(9811):165-80 - PubMed
- Interact J Med Res. 2014 Feb 11;3(1):e5 - PubMed
- PLoS One. 2017 Jun 21;12(6):e0179733 - PubMed
- Biometrics. 1977 Mar;33(1):159-74 - PubMed
- J Clin Epidemiol. 2011 Jan;64(1):96-106 - PubMed
- Acta Oncol. 2020 Apr;59(4):444-452 - PubMed
- Physiother Res Int. 2003;8(4):167-77 - PubMed
Publication Types
Grant support