- Open Access
Integrating Patient Reported Outcome Measures (PROMs) into routine nurse-led primary care for patients with multimorbidity: a feasibility and acceptability study
Health and Quality of Life Outcomes volume 19, Article number: 133 (2021)
The use of Patient Reported Outcome Measures (PROMS) in clinical practice has the potential to promote patient-centred care and improve patients’ quality of life. Individualized PROMs may be particularly helpful in identifying, prioritizing and monitoring health problems of patients with multimorbidity. We aimed to develop an intervention centred around PROMs feedback as part of Primary Care annual reviews for patients with multimorbidity and evaluate its feasibility and acceptability.
We developed a nurse-oriented intervention including (a) training of nurses on PROMs; (b) administration to patients with multimorbidity of individualized and standardized PROMS; and (c) feedback to both patients and nurses of PROMs scores and interpretation guidance. We then tailored the intervention to patients with two or more highly prevalent conditions (asthma, COPD, diabetes, heart failure, depression, and hip/knee osteoarthritis) and designed a non-controlled feasibility and acceptability evaluation in a convenience sample of primary care practices (5). PROMs were administered and scores fed back immediately ahead of scheduled annual reviews with nurses. Patients and nurses rated the acceptability of the intervention using with a brief survey including optional free comments. Thematic analysis of qualitative interviews with a sample of participating patients (10) and nurses (4) and of survey free comments was conducted for further in-depth evaluation of acceptability. Feasibility was estimated based on rates of participation and completion.
Out of 68 recruited patients (mean age 70; 47% female), 68 completed the PROMs (100%), received feedback (100%) and confirmed nurse awareness of their scores (100%). Most patients (83%) “agreed”/”strongly agreed” that the PROMs feedback had been useful, a view supported by nurses in 89% of reviews. Thematic analysis of rich qualitative data on PROMS administration, feedback and role in annual reviews indicated that both patients and nurses perceived the intervention as acceptable and promising, emphasizing its comprehensiveness and patient-centredness.
We have developed and tested an intervention focusing on routine PROM assessment of patients with multimorbidity in Primary Care. Preliminary findings support its feasibility and a high degree of acceptability from both patients and nurses. The next step is to conduct a full-scale trial for evaluating the effectiveness of the proposed intervention.
Patient Reported Outcome Measures (PROMs) elicit measurements of any aspects of health status directly from patients themselves . The use of PROMs in health care is a key approach for operationalizing patient-centred care , a core value of health systems. Conceptual dimensions of patient-centredness, as identified in a literature review conducted by Mead and Bower , include a biopsychological perspective and seeing the patient-as-a-person. PROMs address these dimensions by being responsive to the needs and preferences of individuals by incorporating social and psychological dimensions of health facilitating understanding of the individual’s experience of illness. Information on the outcome of care as perceived by patients themselves is essential for ensuring that the delivery and evaluation of care is respectful of and responsive to individual patient preferences, needs, and values. PROMs have traditionally been used most frequently in clinical settings for research purposes and the evaluation of the effectiveness of health interventions [4, 5]. They have been used more recently as part of quality improvement initiatives using generic and intervention specific PROMs, such as the NHS England PROMs programme  or the International Consortium for Health Outcomes Measurement (ICHOM) , both of which focus on evaluations at the health care provider level; or the Patient-Reported Indicator Surveys (PaRIS) initiative of the Organisation for Economic Co-operation and Development (OECD), which aims to elicit measurements at a country level . There is increasing recognition, however, of their potential use in routine clinical care [4, 5, 9] for supporting clinical decision making, monitoring of disease progression and response to treatment, eliciting patient preferences for specific outcomes, and aligning patients and professionals evaluation of health problems [5, 10]. The evidence is still not conclusive and additional research is needed for the identification of the most promising approaches to PROMs measurement and feedback .
The potential of using PROMs for supporting clinical management of patients presenting with more than one health condition, a circumstance defined as multimorbidity, is of particular interest  but has been not yet been explored. People with multimorbidity are increasingly the norm in Primary Care, who tend to be older than other patient groups , have increased use of healthcare services compared with other members of the population, yet face worse health outcomes [13, 14].
Current models of care for long term conditions in England, Wales and Northern Ireland rely on annual reviews. The purpose of such annual reviews is to ensure patients are taking the right medication and receiving the best possible care. Typically, there are separate reviews for each condition (frequently conducted by nurses) with little, if any, explicit integration of management across conditions [15, 16]. A variety of complex interventions have been developed in recent years to address this gap, but the evidence for their effectiveness is sparse . Current guidance for the clinical management of patients with multimorbidity proposes that in the current circumstances the focus of care should be on improving the quality of life of patients in a way that is responsive to their individual needs, preferences for treatments, health priorities, lifestyle and goals . Routine monitoring of patient-reported outcomes with PROMs would thereby facilitate the consistent evaluation of this aim.
Success in implementing PROMs in clinical practice requires careful coordination and planning [19, 20]. A framework for the implementation of PROMs in clinical practice has been recently proposed based on existing research and implementation of evidence . It considers the use of condition specific and generic standardized PROMs along with individualized measures, which explicitly focus evaluations on those areas that are most relevant to each patient, as identified by patients themselves . The framework, consistent with the biopsychosocial model , integrates monitoring of disease specific patient-centred outcomes with continuous evaluation of patient priorities and goals [5, 10, 20, 22] and proposes that feedback of PROMs results to patients would enhance their health care activation, a key component and determinant of success in the Chronic Care Model [12, 23, 24]. Findings of a subsequent realist synthesis on PROMs feedback in health care supports this perspective [2, 20, 25]. A PROMs based Primary Care review for patients with multimorbidity could potentially meet the objectives and processes of care proposed in current clinical guidance.
(a) To develop an intervention using real-time administration and feedback of PROMs for Primary Care patients with multimorbidity; (b) to assess the feasibility of its implementation in clinical practice; (c) to gain insight into it acceptability, and potential risks and benefits.
Development of intervention
We developed a nurse-oriented PROMs based patient-centred intervention aimed at people with multimorbidity in general practice focusing on goal setting, prioritization and monitoring. We followed Medical Research Council (MRC) guidance  in that the intervention was informed by theory [5, 27, 28] and evidence [29,30,31,32], the individual components were clearly described and were reproducible, and feasibility work was carried out to determine if the intervention could be implemented as intended, without undue risk, and if it was acceptable to patients and nurses.
Following a review of theory and evidence as well a large number of previous interventions , we designed a nurse-oriented intervention for primary care patients with multimorbidity (Fig. 1) which included the following components:
Nurse training Face to face training of nurses on the use of PROMs delivered by members of the research team in a one-hour interactive workshop format covering the following elements:
A general presentation explaining patient-reported outcome measures, their different uses in clinical practice, and positive outcomes derived from their use.
Explaining the characteristics of the PROMs that will be used in the intervention, including how to interpret the results.
An open floor to discuss any questions the nurses might have.
PROMs administration: Administration of three types of measures to Primary care patients with multiple long-term conditions immediately before combined annual reviews for all their relevant conditions:
PROMs feedback Provision to patients and their nurse of real-time structured feedback of PROMs scores and interpretation guidelines using personalized forms:
Patient feedback: a simple summary of the results (individual scores for each standardized instrument and list of health priorities from the individualized instrument)
Nurse feed-back: including the previous information as well as:
Interpretation of scores: direction and range of theoretical scores; mean scores in reference samples; and
Recommendations for the management of each clinical condition based on PROMs results based on best available clinical guidance
Annual review A nurse-led person-centred annual review of all the relevant chronic conditions as informed by PROMs results.
Evaluation of the feasibility and acceptability of the intervention
We designed a non-controlled intervention study to test the feasibility and acceptability of the intervention and to gather information for its further refinement. It was beyond the scope of this study to conduct a controlled evaluation of the effectiveness of the intervention.
For the feasibility study, the intervention was tailored specifically to patients with any combination of the following conditions: asthma, COPD, diabetes, heart failure, depression, and osteoarthritis of either the hip or the knee. We selected these highly prevalent conditions because of their different impacts on symptoms and functioning in the physical, mental and social domains of health, and distinct patterns of clinical progression.
Instruments were selected based on previous reviews of available instruments for measuring PROMs for these conditions [35,36,37,38,39,40]. Each of these selected instruments are well established, valid, reliable and widely used measures. In addition, for asthma and COPD additional measures included in the Quality and Outcomes Framework, a quality improvement initiative widely endorsed by Primary Care practices in the UK, were selected (Table 1).
Training, as well as patient and nurses’ feedback forms, were tailored accordingly (Appendix 1 and 2). The information was systematically retrieved from several different sources. Direction and range of scores were taken from the relevant manuals and original papers. Scores in relevant Primary Care UK samples were obtained from bespoke systematic searches of the literature in PubMed, ISI Web of Science and Google Scholar for each instrument . Recommendation for management of the clinical conditions utilizing PROMs scores was based on a systematic review of clinical practice guidelines and quality indicators in reference sources for clinical care in the UK. The National Institute for Health and Care Excellence (NICE) produces and disseminates clinical practice guidelines for the chronic diseases and hosts a repository of indicators of quality of care for the management of chronic conditions [30, 41].
The involvement of patients was vital to the study design. A group of people diagnosed with chronic conditions was specifically convened and supported by the Patient and Public Involvement team of the National Institute for Health Research Applied Research Collaboration South West Peninsula (NIHR PenARC). Feedback from the group helped to shape PROMs administration booklets, information sheets, and letters of invitation.
Five Primary Care practices in the South West of England were recruited between July 2015 and February 2016. This convenience sample, which enabled us to draw on practices both easily accessible and willing to participate in the study , aimed to maximize variation in terms of size and urban vs. rural locations. Our target was to recruit around 15 patients per practice, and 75 patients in total, who were due to attend a review, and to recruit all nurses conducting the reviews for specific PROMs training (outlined previously). No formal sample size calculation was performed. Given the variation in practice size, we wanted to establish if this target was feasible, especially in smaller, rural practices.
Searches of electronic records using Read codes identified eligible patients diagnosed with any combination of the proposed conditions and who were due for a review for any of those conditions in the subsequent six months. Exclusion criteria included inability to communicate in English and being under 18. A practice physician screened the list of eligible patients to assess suitability. Subsequently, patients were invited by mail to participate. Interested participants contacted the research team directly, who arranged to meet them at their practice immediately before their review.
After providing informed consent participating patients completed generic, condition specific and individualized PROMs in a personalized booklet, with assistance from the researcher if required, immediately ahead of scheduled annual reviews using paper forms. Personalized PROMs summaries were immediately provided to patients and nurses so that they could inform the annual review.
We evaluated feasibility by establishing: (1) the proportion of participants who completed the PROMs, including the individualized instrument; (2) the proportion of patients who completed the PROMS who received personalized feedback ahead of their review; and (3) the proportion of reviews for which the patient confirmed their nurse had received the personalized feedback ahead of their review.
We used mixed methods for evaluating the acceptability of the intervention. The combination of qualitative and quantitative viewpoints, data collection, and analysis enabled us to provide a balanced evaluation of the study. Data were collected in two stages: immediately after the review via brief surveys of participants and at a later date via qualitative interviews. After completing the PROMs review patients and nurses completed a feedback survey incorporating both standardized questions on the acceptability of the information and open-ended questions (Appendix 3 and Appendix 4). Data for Likert scale items were analysed using descriptive statistics for ordinal data, and open-ended questions were thematically grouped and synthesized. Ten patients and four nurses participated in face-to-face semi-structured interviews exploring the acceptability of the intervention, along with potential barriers and facilitators and risks associated with its implementation. Interviews were audio-recorded and typically took place one to two months after the original PROMs review took place. Qualitative analysis of verbatim transcriptions was conducted by two researchers according to the following steps: familiarization; agreement on thematic coding structure and descriptive labels; thematic coding with NVivo 11 ; production of NVivo reports for each theme; identification of line of argument in each report with One Sheet of Paper (OSOP) method ; and critical reassessment, including identification of negative cases or outliers, for example, any viewpoints at odds with the majority of the data which were nevertheless important to capture.
Evaluation of the feasibility of the intervention
Training was successfully provided to all the 12 participating nurses (100%). Out of 223 patients subsequently screened as eligible by the practices and invited by them via post, 75 expressed an interest in taking part by replying to the research team (33.6%). Arrangements were made with 68 patients (90.1%) for their participation while it was not possible to make further contact with the remaining seven. Participants were aged between 48 and 90, with a mean age of 70; and 47% were women. Forty-seven participants (69.1%) were diagnosed with 2 (out of 6) eligible conditions, 14 participants (20.6%) with three, and seven (10.3%) with four. The most common combinations of conditions were diabetes and osteoarthritis (13%), diabetes and COPD (12%), and diabetes and heart failure (7%).
All 68 patients (100%) attended the practice on the day of the review, all of them (100%) completed the relevant PROMs and all of them (100%) received personalized feedback. Patients also confirmed that the nurse was aware of their scores in all the consultations (100%). All nurses (100%) also received the personalized feedback, along with additional information including the raw scores and how to interpret them.
PROMs scores for standardized measures were similar to available published scores in Primary Care UK samples (Table 2). Common health priorities identified by participants in their responses on the individualized PGI included aspects of functioning such as mobility, walking and exercise. A number of psychosocial priorities were also identified encompassing aspects such as mental health, social life and playing with their grandchildren. Sensitive health issues, for example, erectile dysfunction were also highlighted.
Evaluation of the acceptability of the intervention
Nurses and patients completed evaluation questionnaires for 62 and 60 respectively of the 68 completed reviews (Appendix 5 and 6). 93% of patient respondents would not have preferred more detailed information and 92% “agreed”/”strongly agreed” that the information was easy to understand. Nurses “agreed”/”strongly agreed” that the information was easy to understand in 95% of visits of completed exit questionnaires. 90% of patient responses found the intervention helpful in prioritizing their health issues and 83% found the information helpful for the subsequent review (89% for nurses). 76% “agreed”/”strongly agreed” that they would like such information to be routinely included as part of their care.
Thematic analysis of the semi-structured one to one interviews (Tables 3 and 4) was supplemented by feedback in the open-ended responses elicited in the post-review evaluation questionnaires (Appendices 5 and 6).
(a) Experience of patients completing PROMs
Ease of administration
Interviews highlighted that patients did not have any major issues with completing the PROMs, with one respondent reflecting, the questionnaires were “easy to understand and accept.” One interviewee stressed that it was interesting to do and that they “enjoyed the challenge of finding the answers”. Patient free text comments highlighted the experience patients had in terms of completing the PROMs, positive and negative. Typical comments included “most impressed with system” and “thoroughly pleasant and intuitive”. However, while the majority of participants evaluated the experience of completing PROMs as positive, negative feedback was also received in the evaluation questionnaires. One patient described the process as “box ticking”, and another stated, “I don’t think this this was a proper use of NHS manpower.”
Potential alternative modes of administration (electronic)
There were mixed views on the subject of administration being completed electronically as an alternative, for example on a tablet device or computer, either in advance or in the surgery waiting room. In interviews, some participants were neutral about the method of administration (“don't bother me either way”) but one found the prospect of completing PROMs electronically without assistance unappealing “the personal contact in my view is essential.” One of the free-text comments on the patient evaluation form suggested that “some [of the process] could be undertaken online.”
(b) PROMs feedback
Ease of interpretation
A majority of patients (83%) found the PROMs summary helpful for the review. On the evaluation forms, a high percentage of patients agreed/strongly agreed that the information was easy to understand (95%). Only 7% of patients indicated they would have liked more detailed information in addition to the PROMs summary they received. This view was broadly supported in the patient interviews, with one interviewee highlighting “the simplicity of it is the benefit really” and another that “you don’t need to put three charts together you have a very clear picture.” However, one person suggested the addition of a “few more clinical bits”, such as blood tests, would enhance the document.
A majority of nurses (89%) found the PROMs summary helpful for the review. The benefit of the simplicity of the PROMs feedback was a recurring theme in the nurse interviews, as illustrated by the following two examples, “I found it very simple to look at” and “it was great. Nice and simple. I like simple…” The layout of the form was well-received (“good and clear”). Interviews also indicated that nurses found the supporting information (which patients did not receive) on interpreting the PROMs scores useful (see Appendix 2 for an example). In one case they said they referred to it “because it was helpful just to understand a little bit more about where the patient had graded themselves.”
Facilitating awareness and prioritization
Patient interviews indicated that the PROMs summary provided an accurate reflection of health and capabilities, “…it just puts down in black and white how I felt at the time.” One participant stressed that the summary encouraged awareness, relating how they discussed with their husband, “some of the aspects of my condition that I perhaps hadn’t considered before”.
In terms of prioritization, patients indicated that the PROMs summary provided a useful way of prioritizing health issues, as illustrated by both free-text comments on the exit survey (“useful in establishing priorities”) and in interviews (“[it] changed the priority from the outside view to my view”). Similarly, nurse interviews highlighted that the PROMs summary provided a way of prioritizing what was important to patients, “…making sure that we’re not missing the thing the person came into talk about.” Another mentioned that “I used their health priorities on your form as a starting point for the consultation”, instead of the usual clinical focus. This point was also stressed in the evaluation questionnaires, for example, “it was really nice to make the focus of the review the patient and not the tasks. I think we had a more meaningful discussion as a result.”
(c) PROMs as part of routine care
Patient interviews indicated the potential benefits of monitoring PROMs as a part of routine care. One interviewee reflected, “from my point of view it’s either going to highlight a problem or give you a reassurance that you know things are remaining good.” Another person expressed a view that it is a tool “which can be, should be, ought to be used.” The main barrier mentioned, concerning the PROMs intervention forming part of routine care, was about the availability of resources. For example, one patient questioned how useful it would be to their GP surgery, “because they’re all so busy and they’ve got so much else on their plates”.
Interviews with nurses indicated support for including PROMs as part of routine patient care. “some of them said it was the best review they’ve ever had, they felt they were listened to…” Potential benefits in terms of monitoring were highlighted, “if you’ve made a change to their treatment it’s really nice to have some quantifiable feedback to see how that compares to before they had the treatment.” The PROMs focus was viewed positively by another nurse, “From my point of view it was quite positive because I think the problems I was dealing with seemed to be well managed and that sort of came across.” However, one nurse wrote on their evaluation form “not really relevant in this case. They manage their illness well.”
We have developed a theory-informed, PROMs based, nurse-oriented intervention following the MRC framework. After tailoring it to patients with multimorbidity, we have obtained preliminary confirmation of the feasibility and acceptability of the intervention in a pilot study. We were able to successfully train all the nurses and all participating patients were able to complete PROMs, receive personalized feedback ahead of their scheduled review and confirmed that the nurses were aware of their scores. The majority of participating patients reported a positive experience about the process of completing PROMs, finding it intuitive, some enjoyed the challenge of reflecting on their health and finding answers, and no major issues were reported.
Strengths and limitations
We followed a model proposed in previous literature utilizing PROMs as a means of facilitating person-centred reviews [5, 10], taking into account the views of patients and professionals. In doing so we have incorporated available guidance on multimorbidity, in that the real-time collection and feedback of PROMs constitutes an important way to address the stated aim of being responsive to individual needs, preferences for treatments, health priorities, lifestyle and goals . By aligning our intervention with existing clinical processes (primary care patient reviews) and incorporating adequate training for nurses, we have addressed limitations associated with the past unsuccessful implementation of PROMs in Primary Care [5, 46, 47].
We also need to highlight some important limitations of our study. Firstly, we recruited 68 patients falling short of our goal of recruiting 75 (although we did receive 75 expressions of interest). The main reason for this was that in one small rural practice it was only possible to recruit 8 patients. While we were able to overrecruit from another, larger practice, this has provided us with useful information for the design of the evaluation of a subsequent effectiveness study. Secondly, we opted for a pen and paper version of the tools in consultation with a Primary Care professional. However, in the current environment, particularly in relation to the recent surge in the uptake of online solutions as part of the provision of routine primary care in response to the COVID pandemic, electronic administration should be considered. Finally, this feasibility and acceptability study was based on a small sample size and had a non-randomized design. Our aim was not to elicit evidence on the effectiveness of the proposed intervention, but rather to advance in the pathway to a randomized evaluation. Such a trial has been designed and is expected to be implemented soon.
Comparison of findings with previous literature
This study makes an original contribution to the literature as it is the first PROMs based intervention that has been specifically developed for people with multimorbidity. It is also novel in that it combines the use of three different types of PROMs: a standardized generic PROM, multiple standardized disease-specific PROMs and an individualized PROM. However, information on its effectiveness is still lacking which is something we aim to address in a future iteration of the intervention. This would add to a growing body of work demonstrating the benefits of PROMs in routine clinical practice. Systematic reviews on the impact of feeding back information to nurses have demonstrated a positive impact on processes of care, particularly on diagnosis, and increasingly positive impact on outcomes of care [11, 48]. A recent realist synthesis has linked feedback to improved patient-clinician communication and indicates that PROMs completion is not a neutral act of information retrieval but can change how patients think about their condition. Further, a Cochrane review is underway and will facilitate an updated synthesis of the available evidence .
Implications for research and practice
A minority of participants highlighted issues which we will aim to rectify in future work. The evaluation questionnaires raised concerns that the study was perceived as a box ticking exercise and not an effective use of NHS “manpower”. This is something we aim to address in developing an electronic version of the intervention including all of the administration, scoring and automated feedback.
The PROMs feedback had a high level of acceptability. A simple, easy to digest summary was seen as a key, although nurses appreciated being able to draw on supporting information if needed, and some patients expressed a preference to be given the option to access more detailed information which is something we will seek to take on board in future development work. A particular strength of the PROMs summary was that it was seen as helping patients prioritize which aspects of their health they wanted to focus on and that these priorities were in turn communicated to nurses by the summary. Both patients and nurses were on the whole keen for PROMs to be incorporated as part of routine clinical care. Patient monitoring was seen as a potential advantage of the intervention, however, a clinician raised doubts concerning the usefulness for one of their patients in that they were already well managed. On the one hand, it can be argued that it may not be possible to know if patients are well managed without formal appraisal of outcomes from the patient perspective. On the other hand, it may suggest that there may be scope in the evaluation of the effectiveness of the intervention (which was beyond the scope of the present study) for examining the differential impact in subgroups of patients defined by the level of their disease control.
This feasibility evaluation does not provide robust evidence for changing clinical practice but is of significant interest for research, as it is the first demonstration of the potential of PROMs feedback in this patient group, and in particular in exploring tailoring feed-back to patients. It also provides evidence for the potential of using standardized and individualized tools complementarily. In the future, we aim to build on this work to develop digitalized versions of the main components of the intervention with the potential to be administered on a larger scale. This would entail both replacing current administration and feedback with a state of the art multiplatform electronic system as well as developing an online training programme for nurses. Firstly, by developing an efficient and user-friendly electronic system to enable real-time electronic administration, scoring, interpretation and feedback of PROMs to participating patients and healthcare nurses, in a way which coincides with annual reviews, causing minimal disruption for participating patients and healthcare staff. Secondly, by putting together an online training package on the use PROMs in clinical practice, addressing rationale, evidence, and practicalities of everyday use, with a particular focus on the interpretation of scores of standardized measures and prioritization and goal setting of care based on individualized measures. We intend to implement a small scale randomized pilot of the new digitalized intervention, incorporating an assessment of feasibility and acceptability along with a preliminary evaluation of effectiveness, before moving ahead with a larger-scale randomized controlled trial.
This study has demonstrated that is it feasible to deliver a PROMs based intervention for patients with multiple chronic conditions, incorporating standardized and individualized measures, coinciding with existing Primary Care reviews, in a way that is acceptable to both patients and health nurses.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Mini Asthma Quality of Life Questionnaire
Clinical COPD questionnaire
Chronic Obstructive Pulmonary Disease
Diabetes Health Profile
Minnesota Living with Heart Failure Questionnaire
Medical Research Council
National Health Service
The National Institute for Health and Care Excellence
Oxford Hip Score
Oxford Knee Score
One Sheet of Paper
Patient Health Questionnaire
Patient Generated Index
Patient Reported Outcome Measure
Royal College of Physicians
Valderas JM, Alonso J. Patient reported outcome measures: a model-based classification system for research and clinical practice. Qual Life Res. 2008. https://0-doi-org.brum.beds.ac.uk/10.1007/s11136-008-9396-4.
Greenhalgh J, Gooding K, Gibbons E, Dalkin S, Wright J, Valderas J, et al. How do patient reported outcome measures (PROMs) support clinician-patient communication and patient care? A realist synthesis. J Patient Rep Outcomes. 2018;2:42.
Mead N, Bower P. Patient-centredness: a conceptual framework and review of the empirical literature. Soc Sci Med. 2000;51(7):1087–110.
Black N, Burke L, Forrest CB, Ravens Sieberer UH, Ahmed S, Valderas JM, et al. Patient-reported outcomes: pathways to better health, better services, and better societies. Qual Life Res. 2016;25:1103–12.
Porter I, Gonçalves-Bradley D, Ricci-Cabello I, Gibbons C, Gangannagaripalli J, Fitzpatrick R, et al. Framework and guidance for implementing patient-reported outcomes in clinical practice: evidence, challenges and opportunities. J Comp Eff Res. 2016;5(5):507–19.
England NHS. Summary of the evidence on performance of the patient activation measure (PAM). http://personcentredcare.health.org.uk/sites/default/files/resources/patientactivation-1.pdf.
Ackerman IN, Cavka B, Lippa J, Bucknill A. The feasibility of implementing the ICHOM Standard Set for Hip and Knee Osteoarthritis: a mixed-methods evaluation in public and private hospital settings. J Patient-Reported Outcomes. 2018;2(1):32. https://0-doi-org.brum.beds.ac.uk/10.1186/s41687-018-0062-5.
Organisation for Economic Co-operation and Development. Putting people at the centre of health care. PaRIS survey of Patients with Chronic Conditions. Paris: OECD Publishing; 2019.
Valderas JM, Alonso J, Guyatt GH. Measuring patient-reported outcomes: moving from clinical trials into clinical practice. Med J Aust. 2008;189(2):93–4.
Valderas JM. Getting impatient about person-centred health care. Eur J Gen Pr. 2013;19(3):141–2.
Valderas JM, Kotzeva A, Espallargues M, Guyatt G, Ferrans CE, Halyard MY, et al. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Qual Life Res. 2008;17(2):179–93.
Ham C. The ten characteristics of the high-performing chronic care system. Heal Econ Policy Law. 2010. https://0-doi-org.brum.beds.ac.uk/10.1017/S1744133109990120.
Violan C, Foguet-Boreu Q, Flores-Mateo G, Salisbury C, Blom J, Freitag M. Prevalence, determinants and patterns of multimorbidity in primary care: a systematic review of observational studies. PLoS ONE. 2014. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0102149.
Valderas JM, Starfield B, Sibbald B, Salisbury C, Roland M. Defining comorbidity: implications for understanding health and health services. Ann Fam Med. 2009;7(4):357–63.
Rijken M, Struckmann V, Van Ginneken E. ICARE4EU: the availability of integrated care programmes addressing multi-morbidity in 31 European countries. Eur J Public Health; 2014.
Healthtalk. Living with multiple problems. http://www.healthtalk.org/peoples-experiences/long-term-conditions/living-multiple-health-problems/topics.
Smith SM, Wallace E, O’Dowd T, Fortin M. Interventions for improving outcomes in patients with multimorbidity in primary care and community settings. Cochrane Database Syst Rev. 2016;3:CD006560.
Multimorbidity: clinical assessment and management [NICE Clinical Guideline NG56]. London: National Guidelines Centre on behalf of the National Institute for Health and Care Excellence (NICE); 2016.
Valderas JM, Fitzpatrick R, Roland M. Using health status to measure NHS performance: another step into the dark for the health reform in England. BMJ Qual Saf. 2012;21(4):352–3.
Greenhalgh J, Dalkin S, Gooding K, Gibbons E, Wright J, Meads D, et al. Functionality and feedback: a realist synthesis of the collation, interpretation and utilisation of patient-reported outcome measures data to improve patient care. Heal Serv Deliv Res. 2017;5(2):1–280.
Engel GL. The clinical application of the biopsychosocial model. Am J Psychiatry. 1980;137(5):535–44.
Valderas JM. Multimorbidity, not a health condition or complexity by another name. Eur J Gen Pr. 2015;21(4):213–4.
Hibbard J, Gilburt H. Supporting people to manage their health: an introduction to patient activation. The King’s Fund; 2014.
Dennis SM, Zwar N, Griffiths R, Roland M, Hasan I, Powell Davies G, et al. Chronic disease management in primary care: from evidence to policy. Med J Aust. 2008;188(8):53.
Greenhalgh J, Dalkin S, Gibbons E, Wright J, Valderas JM, Meads D, et al. How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis. J Health Serv Res Policy. 2018;23(1):57–65.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008. https://0-doi-org.brum.beds.ac.uk/10.1136/bmj.a1655.
Valderas JM, Gangannagaripalli J, Nolte E, Boyd CM, Roland M, Sarria-Santamera A, et al. Quality of care assessment for people with multimorbidity. J Intern Med. 2019;285(3):289–300.
Muth C, Blom JW, Smith SM, Johnell K, Gonzalez-Gonzalez AI, Nguyen TS, et al. Evidence supporting the best clinical management of patients with multimorbidity and polypharmacy: a systematic guideline review and expert consensus. J Intern Med. 2019;285(3):272–88.
Porter I, Valderas JM. Development of a feedback form for routine clinical use of PROs in primary care for patients with multimorbidity. Qual Life Res. 2015;24:181–2.
Porter I, Valderas JM. Use of PROs in clinical guidance for the management of chronic conditions in primary care in the United Kingdom. Qual Life Res. 2015;25:75–6.
Greenhalgh J, Gooding K, Gibbons E, Dalkin S, Wright J, Valderas J, et al. How do patient reported outcome measures (PROMs) support clinician-patient communication and patient care? A realist synthesis. J Patient-Reported Outcomes. 2018;2(1):42.
Goncalves BDC, Gibbons C, Ricci-Cabello I, Bobrovitz NJH, Gibbons EJ, Kotzeva A, et al. Routine provision of information on patient-reported outcome measures to healthcare providers and patients in clinical practice (Protocol) . Cochrane Database Syst Rev. 2015;(4): Art. No.: CD011589. https://0-doi-org.brum.beds.ac.uk/10.1002/14651858.CD011589.
Herdman M, Lloyd A, Janssen MF, Kind P, Parkin D, Bonsel G, Badia XGC. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36.
Ruta DA, Leng M, Russell IT, MacDonald LMGAM. A new approach to the measurement of quality of life: The patient generated index. Med Care. 1994;32:1109–26.
Davies N, Gibbons E, Fitzpatrick R. A structured review of patient-reported outcome measures for COPD: an update 2009. Oxford: University of Oxford; 2009.
Gibbons E, Fitzpatrick R. A structured review of patient-reported outcome measures for people with asthma: an update 2009. Oxford: University of Oxford; 2009.
Fitzpatrick R, Gibbons E, Mackintosh A. An overview of patient-reported outcome measures for people with anxiety and depression 2009. Oxford: University of Oxford; 2009.
Gibbons E, Fitzpatrick R. A structured review of patient-reported outcome measures for people with diabetes: an update 2009. Oxford: University of Oxforf; 2009.
Mackintosh A, Gibbons E, Fitzpatrick R. A structured review of patient-reported outcome measures for people with heart failure: an update 2009. Oxford: University of Oxford; 2009.
Fitzpatrick R, Bowling A, Gibbons E, Hayward K, Jenkinson C, Mackintosh A, et al. A structured review of patient-reported measures in relation to selected chronic conditions, perceptions of quality of care and carer impact. Oxford: University of Oxford; 2006.
Gangannagaripalli J, Porter I, Bramwell C, Evans J, Gonzalez JR, Valderas JM. Estimating minimum important difference (MID) for chronic disease-specific patient reported outcome measures (PROMs): a systematic review. Qual Life Res. 2016;25:42.
Teddlie C, Yu F. Mixed methods sampling: a typology with examples. Mix Methods Res. 2007;1(1):77–100.
NVivo qualitative data analysis Software. QSR Int Pty Ltd. 2015;Version 11.
Ziebland S, McPherson A. Making sense of qualitative data analysis: an introduction with illustrations from DIPEx (personal experiences of health and illness). Med Educ. 2006;40(5):405–14.
Kernick D, Chew-Graham CA, O’Flynn N. Clinical assessment and management of multimorbidity: NICE guideline. Br J Gen Pr. 2017;67(658):235–6.
Mitchell C, Dwyer R, Hagan T, Mathers N. Impact of the QOF and the NICE guideline in the diagnosis and management of depression: a qualitative study. Br J Gen Pr. 2011;61(586):279–89.
Toop L, The QOF. NICE, and depression: a clumsy mechanism that undermines clinical judgment. Br J Gen Pract. 2011;61(588):432–3.
Espallargues M, Valderas JM, Alonso J. Provision of feedback on perceived health status to health care professionals: a systematic review of its impact. Med Care. 2000;38:175–86.
Rabin R, de Charro F. EQ-5D: a measure of health status from the EuroQol Group. Ann Med. 2001;33(5):337–43.
Juniper EF, Guyatt GH, Cox FM, Ferrie PJ, King DR. Development and validation of the Mini Asthma Quality of Life Questionnaire. Eur Respir J. 1999;14:32–8.
Thomas M, Gruffydd-Jones K, Stonham C, Ward S, Macfarlane TV. Assessing asthma control in routine clinical practice: use of the Royal College of Physicians “3 questions.” Prim Care Respir J. 2009;18(2):83–8.
van der Molen T, Willemse BW, Schokker S, Ten Hacken NH, Postma DS, Juniper EF. Development, validity and responsiveness of the Clinical COPD Questionnaire. Heal Qual Life Outcomes. 2003;1(13):1–10.
Gough J. The pathological diagnosis of emphysema. Proc R Soc Med. 1952;45(9):576–7.
Kroenke K, Spitzer RL, Williams JBW. The PHQ-9—validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.
Meadows KA, Abrams C, Sandbaek A. Adaptation of the Diabetes Health Profile (DHP-1) for use with patients with Type 2 diabetes mellitus: psychometric evaluation and cross-cultural comparison. Diabet Med. 2000;17(8):572–80.
Supino PG, Borer JS, Franciosa JA, Preibisz JJ, Hochreiter C, Isom OW, et al. Acceptability and psychometric properties of the Minnesota Living With Heart Failure Questionnaire among patients undergoing heart valve surgery: validation and comparison with SF-36. J Card Fail. 2009;15(3):267–77.
Dawson J, Fitzpatrick R, Carr A, Murray D. Questionnaire on the perceptions of patients about total hip replacement. J Bone Jt Surg Br. 1996;78(2):185–90.
Dawson J, Fitzpatrick R, Murray D, Carr A. Questionnaire on the perceptions of patients about total knee replacement. J Bone Jt Surg Br. 1998;80(1):63–9.
We would like to thank the Patient and Public Involvement which helped us design the study as well as the patients and practice staff who participated.
The intervention described in this paper was developed by Professor Valderas as part of a National Institute for Health Research (NIHR) funded programme of work on the use of PROMs in the management of people with multimorbidity (Clinician Scientist Award NIHR/CS/010/024).
Ethics approval and consent to participate
Ethical approval was obtained from the National Research Ethics Service (NRES) Committee London (reference: 19/012015 15/LO/0148).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix 1: Patient summary of PROMs results for patients and nurses (sample)
Appendix 2: Feedback information for nurses for a patient with COPD (sample)
Appendix 3: Participant patient feedback survey
Appendix 4: Nurse feedback survey
Appendix 5: Themes in patient free text comments
|General evaluation about the process (e.g. generally pleased/happy to take part; thought it was comprehensive/efficient; positive researcher impact)||13||
“I thought it was excellent”|
“Most impressed with system”
“Thoroughly pleasant and intuitive”
|Patient-centred approach (e.g. holistic approach, feeling listened to)||5||
“I think it is vital to see patient as a whole person”|
“I felt listened to and responded to”
|Awareness of health issues||2||
“Probably made me more aware of my personal frailties”|
“Useful in establishing priorities”
|Suggestions for improving the process (e.g. querying, pointing out limitations/negative aspects)||5||
“Some could be undertaken online”|
“I don’t this this was a proper use of NHS manpower”
Appendix 6: Themes in nurse free-text comments
“It was nice to make the focus of the review the patient and not the tasks”|
“Allows holistic approach.”
|Facilitated discussion of patient priorities||7||“Prompted discussion of priorities”|
|Lacking relevance||5||“Not really relevant in this case. They manage their illness well”|
|Ease of use||2||“Patient needed assistance with answering questionnaire”|
|Patient awareness of their health||2||“Useful to show that patient is aware how well they have progressed”|
|Patient management||1||“Changed my approach”|
|Patient satisfaction (explicitly stated that the patient was satisfied with the review)||1||“Patient very impressed with the study”|
|General positive feedback||8||“Discussed health priorities with patient & patient found it helpful”|
|Neutral, generic and otherwise non-applicable comments||11||“This patient lives a normal life with his diseases”|
About this article
Cite this article
Porter, I., Davey, A., Gangannagaripalli, J. et al. Integrating Patient Reported Outcome Measures (PROMs) into routine nurse-led primary care for patients with multimorbidity: a feasibility and acceptability study. Health Qual Life Outcomes 19, 133 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12955-021-01748-2
- Primary health care
- Patient-Reported Outcome Measures (PROMs)