Display options
Share it on

Res Nurs Health. 2021 Jun;44(3):571-580. doi: 10.1002/nur.22133. Epub 2021 Apr 06.

Methodological considerations for the design and implementation of a fully longitudinal mixed methods study.

Research in nursing & health

Karen L Schumacher, Vicki L Plano Clark, June Eilers, Naomi Kigondu, Carol Geary, Kevin Kupzyk, William M Lydiatt, Rudy P Lackner, Quan Ly

Affiliations

  1. School of Nursing, University of California San Francisco, San Francisco, California, USA.
  2. College of Nursing, University of Nebraska Medical Center, Omaha, Nebraska, USA.
  3. School of Education, University of Cincinnati, Cincinnati, Ohio, USA.
  4. Nebraska Methodist Health System, Omaha, Nebraska, USA.
  5. University of Nebraska Medical Center, College of Medicine, Nebraska, USA.

PMID: 33821492 DOI: 10.1002/nur.22133

Abstract

Growing interest is evident in longitudinal mixed methods research, particularly fully longitudinal mixed methods designs in which both quantitative and qualitative data are collected concurrently for the duration of the study. Fully longitudinal mixed methods designs are particularly relevant for research on dynamic phenomena because of their ability to illuminate both quantitative and qualitative dimensions of change in real time as the phenomenon of interest changes. However, these are complex research designs and their data-intense nature makes them potentially burdensome for study participants, challenging for research teams, and costly for funding agencies. Despite growing use, the methodological literature on fully longitudinal mixed methods research is sparse and little guidance is available for researchers considering this approach. We address this gap by describing our experience with the design and implementation of a fully longitudinal mixed methods study of a dynamic phenomenon, namely, family caregiving during cancer treatment. We describe important questions and key decisions confronted while developing the research proposal, proactive strategies for study implementation, and implementation realities encountered while the study was in progress. On the basis of insights gained through real-world experience, we offer three guiding principles for researchers undertaking such a study. First, align the study design with the nature of the dynamics in the phenomenon of interest. Second, plan from the start when and how the integration of the longitudinal quantitative and qualitative data will occur. Third, employ implementation strategies that take into account the practical aspects of repeated contacts with study participants for an extended period.

© 2021 Wiley Periodicals LLC.

Keywords: cancer; caregivers; longitudinal; mixed methods; research design

References

  1. Bamattre, R., Schowengerdt, B., Nikoi, A., & DeJaeghere (2019). Time matters: The potential and pitfalls of using mixed methods approaches in longitudinal program evaluation. International Journal of Social Research Methodology, 22(4), 335-349. https://doi.org/10.1080/13645579.2018.1553674 - PubMed
  2. Bazeley, P. (2018). Integrating analyses in mixed methods research. Sage Publications. - PubMed
  3. Benoit, C., Westfall, R., Treloar, A. E. B., Phillips, R., & Jansson, S. M. (2007). Social factors linked to postpartum depression. A mixed-methods longitudinal study. Journal of Mental Health, 16(6), 719-730. https://doi.org/10.1080/09638230701506846 - PubMed
  4. Bond, S. M., Schumacher, K., Sherrod, A., Dietrich, M. S., Wells, N., Lindau, R. H., & Murphy, B. A. (2016). Development of the Head and Neck Caregiving Task Inventory. European Journal of Oncology Nursing, 24, 29-38. https://doi.org/10.1016/j.ejon.2016.08.004 - PubMed
  5. Brannen, J., & O'Connell, R. (2015). Data analysis I: Overview of data analysis strategies. In S. Hesse-Biber, & R. B. Johnson (Eds.), The Oxford handbook of multimethod and mixed methods research inquiry (pp. 257-274). Oxford University Press. - PubMed
  6. Brant, J. M., Dudley, W. N., Beck, S., & Miaskowski, C. (2016). Evolution of the Dynamic Symptoms Model. Oncology Nursing Forum, 43(5), 651-654. https://doi.org/10.1188/16.ONF.651-654 - PubMed
  7. Caracelli, V. J., & Greene, J. C. (1993). Data analysis strategies for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 15(2), 195-207. https://doi.org/10.3102/01623737015002195 - PubMed
  8. Carey, P. J., Oberst, M. T., McCubbin, M. A., & Hughes, S. H. (1991). Appraisal and caregiving burden in family members caring for patients receiving chemotherapy. Oncology Nursing Forum, 18(8), 1341-1348. - PubMed
  9. Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., Cook, K., DeVellis, R., DeWalt, D., Fries, J. F., Gershon, R., Hahn, E. A., Lai, J. S., Pilkonis, P., Revicki, D., … Hays, R. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. Journal of Clinical Epidemiology, 63(11), 1179-1194. https://doi.org/10.1016/j.jclinepi.2010.04.011 - PubMed
  10. Collins, K. M. T., Onwuegbuzie, A. J., & Jiao, Q. G. (2007). A mixed methods investigation of mixed methods sampling designs in social and health science research. Journal of Mixed Methods Research, 1(3), 267-294. https://doi.org/10.1177/1558689807299526 - PubMed
  11. Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). SagePublications. - PubMed
  12. Creswell, J. W., Klassen, A. C., Plano Clark, V. L., & Smith, K. C. for the NIH Office of Behavioral and Social Sciences Research (2011). Best practices for mixed methods research in the health sciences. National Institutes of Health. https://obssr.od.nih.gov/training/mixed-methods-research - PubMed
  13. Dieckmann, N. F., Rosenkranz, S. J., Golden, S. E., Stoyles, S., Taylor-Young, P., & Hansen, L. (2020). Results from a prospective study of individuals' symptoms and patient activation after hepatitis C treatment. Research in Nursing & Health, 43(6), 662-672. https://doi.org/10.1002/nur.22086 - PubMed
  14. Fetters, M. D., Curry, L. A., & Creswell, J. W. (2013). Achieving integration in mixed methods designs-Principles and practices. Health Services Research, 48(6), 2134-2156. https://doi.org/10.1111/1475-6773.12117 - PubMed
  15. Fetters, M. D., & Freshwater, D. (2015). The 1+1=3 integration challenge. Journal of Mixed Methods Research, 9(2), 115-117. https://doi.org/10.1177/1558689815581222 - PubMed
  16. Fletcher, B. A. S., Miaskowski, C., Given, B., & Schumacher, K. (2012). The cancer family caregiving experience: An updated and expanded conceptual model. European Journal of Oncology Nursing, 16(4), 387-398. https://doi.org/10.1016/j.ejon.2011.09.001 - PubMed
  17. Garcia, S. F., Cella, D., Clauser, S. B., Flynn, K. E., Lad, T., Lai, J. S., Reeve, B. B., Wilder Smith, A., Stone, A. A., & Weinfurt, K. (2007). Standardizing patient-reported outcomes assessment in cancer clinical trials: A Patient-Reported Outcomes Measurement Information System initiative. Journal of Clinical Oncology, 25(32), 5106-5112. https://doi.org/10.1200/JCO.2007.12.2341 - PubMed
  18. Grady, P. A., & Rosenbaum, L. M. (2015). The science of caregiver health. Journal of Nursing Scholarship, 47(3), 197-199. https://doi.org/10.1111/jnu.12137 - PubMed
  19. Guetterman, T. C., Fetters, M. D., & Creswell, J. W. (2015). Integrating quantitative and qualitative results in health science mixed methods research through joint displays. Annals of Family Medicine, 13(6), 554-651. https://doi.org/10.1370/afm.1865 - PubMed
  20. Health Measures. (2021). Transforming how health is measured. https://www.healthmeasures.net/explore-measurement-systems/promis - PubMed
  21. Kim, Y., & Given, B. (2008). Quality of life of family caregivers of cancer survivors across the trajectory of the illness. Cancer, 112(11 Suppl), 2556-2568. https://doi.org/10.1002/cncr.23449 - PubMed
  22. Menard, S. (2002). Longitudinal research. Sage Publications. https://doi.org/10.4135/9781412984867 - PubMed
  23. Mitchell, E. S. (1986). Multiple triangulation: A methodology for nursing science. ANS: Advances in Nursing Science, 8(3), 18-26. https://doi.org/10.1097/00012272-198604000-00004 - PubMed
  24. Morse, J. M., & Niehaus, L. (2009). Mixed methods design: Principles and procedures. Left Coast Press. - PubMed
  25. Muthén, L. K., & Muthén, B. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling: A Multidisciplinary Journal, 9(4), 599-620. https://doi.org/10.1207/S15328007SEM0904_8 - PubMed
  26. Piil, K., Jakobsen, J., Christensen, K. B., Juhler, M., Guetterman, T. C., Fetters, M. A., & Jarden, M. (2018). Needs and preferences among patients with high-grade glioma and their caregivers-A longitudinal mixed methods study. European Journal of Cancer Care, 27(2), e12806. https://doi.org/10.1111/ecc.12806 - PubMed
  27. Plano Clark, V. L. (2019). Meaningful integration within mixed methods studies: Identifying why, what, when, and how. Contemporary Educational Psychology, 57, 106-111. https://doi.org/10.1016/j.cedpsych.2019.01.007 - PubMed
  28. Plano Clark, V. L., Anderson, N., Wertz, J., Zhou, Y., Schumacher, K., & Miaskowski, C. (2015). Conceptualizing longitudinal mixed methods designs: A methodological review of health sciences research. Journal of Mixed Methods Research, 9(4), 297-319. https://doi.org/10.1177/1558689814543563 - PubMed
  29. Plano Clark, V. L., Schumacher, K., West, C., Edrington, J., Dunn, L. B., Harzstark, A., Melisko, M., Rabow, M. W., Swift, P. S., & Miaskowski, C. (2013). Practices for embedding an interpretive qualitative approach within a randomized clinical trial. Journal of Mixed Methods Research, 7(3), 219-242. https://doi.org/10.1177/1558689812474372 - PubMed
  30. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Sage Publications. - PubMed
  31. Saldaña, J. (2003). Longitudinal qualitative research: Analyzing change over time. AltaMira Press. - PubMed
  32. Sandelowski, M. (2000). Combining qualitative and quantitative sampling, data collection, and analysis techniques in mixed-methods studies. Research in Nursing & Health, 23(3), 246-255. https://doi.org/10.1002/1098-240X(200006)23:3%3C246::AID-NUR9%3E3.0.CO;2-H - PubMed
  33. Schumacher, K., Plano Clark, V., Hertzog, M., & Lydiatt, W. (2012, June). A longitudinal, mixed methods study of preparedness for family caregiving during head and neck cancer treatment. Paper presented at the 8th Mixed Methods International Conference, University of Leeds, Leeds, UK. - PubMed
  34. Schumacher, K. L., Koresawa, S., West, C., Dodd, M., Paul, S. M., Tripathy, D., Koo, P., & Miaskowski, C. (2005). Qualitative research contribution to a randomized clinical trial. Research in Nursing & Health, 28(3), 268-280. https://doi.org/10.1002/nur.20080 - PubMed
  35. Schumacher, K. L., Koresawa, S., West, C., Hawkins, C., Johnson, C., Wais, E., Dodd, M., Paul, S. M., Tripathy, D., Koo, P., & Miaskowski, C. (2002). Putting cancer pain management regimens into practice at home. Journal of Pain and Symptom Management, 23(5), 369-382. https://doi.org/10.1016/s0885-3924(02)00385-8 - PubMed
  36. Schumacher, K. L., Plano Clark, V. L., Rabow, M. W., Paul, S. M., & Miaskowski, C. (2021). The experience of complex pain dynamics in oncology outpatients: A longitudinal qualitative analysis. Cancer Nursing, 44(2), 136-144. https://doi.org/10.1097/NCC.0000000000000747 - PubMed
  37. Schumacher, K. L., Plano Clark, V. L., West, C. M., Dodd, M. J., Rabow, M. W., & Miaskowski, C. (2014). Pain medication management processes used by oncology outpatients and family caregivers: Part I: Health systems contexts. Journal of Pain and Symptom Management, 48(5), 770-783. https://doi.org/10.1016/j.jpainsymman.2013.12.242 - PubMed
  38. Schumacher, K. L., West, C., Dodd, M., Paul, S. M., Tripathy, D., Koo, P., & Miaskowski, C. (2002). Pain management autobiographies and reluctance to use opioids for cancer pain management. Cancer Nursing, 25(2), 125-133. https://doi.org/10.1097/00002820-200204000-00009 - PubMed
  39. Sherman, D. W., McGuire, D. B., Free, D., & Cheon, J. Y. (2014). A pilot study of the experience of family caregivers of patients with advanced pancreatic cancer using a mixed methods approach. Journal of Pain and Symptom Management, 48(3), 385-399. https://doi.org/10.1016/j.jpainsymman.2013.09.006 - PubMed
  40. Teddlie, C., & Yu, F. (2007). Mixed methods sampling: A typology with examples. Journal of Mixed Methods Research, 1(1), 77-100. https://doi.org/10.1177/1558689806292430 - PubMed
  41. van Ness, P. H., Fried, T. R., & Gill, T. M. (2011). Mixed methods for the interpretation of longitudinal gerontologic data: Insights from philosophical hermeneutics. Journal of Mixed Methods Research, 5(4), 293-2022. https://doi.org/10.1177/1558689811412973 - PubMed
  42. Wister, A. V., Coatta, K. L., Schuurman, N., Lear, S. A., Rosin, M., & MacKey, D. (2016). A lifecourse model of multimorbidity resilience: Theoretical and research developments. International Journal of Aging and Human Development, 82(4), 290-313. https://doi.org/10.1177/0091415016641686 - PubMed
  43. Wyman, J. F., & Henly, S. J. (2011). Advancing nursing science through health trajectory research: An introduction. Nursing Research, 60(3 Suppl), S1-S4. https://doi.org/10.1097/NNR.0b013e31821b1480 - PubMed
  44. Yin, R. K. (2006). Mixed methods research: Are the methods genuinely integrated or merely parallel? Research in the Schools, 13(1), 41-47. - PubMed
  45. Zhang, P., & Liu, N. (2019). Longitudinal mixed methods in language teaching research. International Journal of Multiple Research Approaches, 11(2), 132-143. https://doi.org/10.29034/ijmra.v11n2a1 - PubMed

MeSH terms

Publication Types