Skip to main content
Download PDF
Download ePub

Feasibility and acceptability of electronic EQ-5D-5L for routine measurement of HRQOL in patients with chronic musculoskeletal problems in Hong Kong primary care

Health and Quality of Life Outcomes volume 20, Article number: 137 (2022) Cite this article

Abstract

Background

Information on HRQOL can enhance patient diagnosis and management but it is rarely available in routine clinical practice. This mixed-method study evaluated the feasibility and acceptability of the electronic EQ-5D-5L measurement of HRQOL in patients with chronic musculoskeletal problems in primary care.

Methods

In three primary care clinics, 665 patients with musculoskeletal problems completed the electronic EQ-5D-5L and Visual Analogue Scale (e-EQ-5D-5L/VAS), and a questionnaire on socio-demographics, perceived ease of use (PEOU), and perceived usefulness (PU) at baseline and two follow-ups. Patient completion and response rates, and time to complete the e-EQ-5D-5L/VAS were measured. During the same consultations, 49 doctors reviewed the e-EQ-5D-5L/VAS reports and completed a clinician questionnaire on PEOU, PU, and time spent to address each report. Individual interviews along with focus group discussions were conducted on patients, doctors, and research assistants for further exploration.

Results

Mean completion time reduced from baseline to first and second follow-up (120.66, 83.99, and 105.22 s, respectively). Completion and response rates were high at each follow-up visit (> 99.8% and > 91.11%, respectively). Doctors needed less than 2 min to read the report but felt the time required to address the report was a significant barrier. Some patients had difficulties using e-platforms, in understanding or answering questions; but, PEOU improved with time (p < 0.001). Most patients found the e-platforms useful (> 85.3%). Clinicians agreed a great majority of the reports were easy to use (76.0–85.1%) and useful (69.2–72.0%), particularly aiding with a holistic view of the patient's musculoskeletal problem.

Conclusion

The e-EQ-5D-5L/VAS is a feasible and acceptable measurement of HRQOL of patients with chronic musculoskeletal problems in routine primary care in Hong Kong which can assist real-time management decisions.

Trial registration: NCT03609762.

Background

Health-related quality of life (HRQOL) is a common patient-reported outcome (PRO) assessing a person’s subjective judgment on how their health impacts them physiologically and psychologically [1]. Increasingly, research shows that using PRO in clinical practice can assist joint decision-making in the diagnostic and management processes [2] and benefit patient care [3,4,5,6,7]. However, incorporating these measurements into routine clinical practice comes with challenges in terms of the feasibility and users’ perceptions of the measurements [7]. Increased workload [8,9,10] and a limited time to collect, analyze and interpret data [11] have led to calls for more efficient methods in obtaining data in routine clinical practice [10, 12], such as via electronic data collection and reporting [10]. Apart from reducing workload, clinicians can have immediate access to the results and track HRQOL changes [3, 8].

The EQ-5D-5L is a popular HRQOL measure [13] that assesses the patients’ self-perceived health-related barriers in daily function, pain, and psychological distress with five items. It was originally developed by the EuroQol Group and has been adapted to many other populations including the Chinese population in Hong Kong [13,14,15]. Its greatest advantage is that it is short, easy-to-complete and provides information on both the HRQOL profile and health utility of the patient [13]. An electronic version (e-EQ-5D-5L) is available and has been used in many HRQOL outcome studies [16,17,18,19]. Our previous study confirmed the validity, reliability and responsiveness of the e-EQ-5D-5L in Chinese primary care patients in Hong Kong [20]. Research supports that e-EQ-5D-5L measures in clinical practice identify more HRQOL problems and result in more actions by clinicians to tackle them [21]. It also has the potential to track the changes in HRQOL of an individual patient in clinical practice.

However, the implementation of electronic health information systems can bring with it challenges related to feasibility and users’ acceptance of the technology [22]. Feasibility is concerned with the difficulty of applying instruments in a population [23]. Existing EQ-5D studies have used missing values, completion rates and time, response rates, and qualitative statements about completion as indicators of feasibility [23]. Past studies on EQ-5D [23, 24] and other electronic PRO measures [25, 26] cited satisfactory completion rates from 80 to 95%. Studies on EQ-5D response rates have shown inconsistent results with a Swedish study of arthroplasty patients showing that response rate to a web-based version (49%) was worse than that to a paper-based version (92%) [27], whereas a study on English residents showed a better response rate of 73% using a mobile-version than that (66%) of using paper-version [28]. However, the differences could be due to age, education levels, and health status. Acceptability is a multifaceted concept that represents the degree to which those providing or receiving a healthcare intervention consider it to be suitable, based on expected or actual cognitive and emotional responses to the intervention. It consists of seven component constructs: affective attitude, burden, perceived effectiveness, ethicality, intervention coherence, opportunity costs, and self-efficacy [29]. Earlier studies on acceptability of electronic HRQOL measures used different indictors of overall satisfaction, willingness to use and perceived usefulness, resulting in a wide variation in rates ranging from 66 to 83% [30, 31].

Users’ negative perceptions of a technology can hamper its acceptability and implementation. In 1989 and years afterwards, Davis and colleagues introduced the Technology Acceptance Model (TAM) which offers an approach for analyzing individuals’ perceptions of a new technology [32,33,34], which can be used as more standardized indictors of acceptability. The model essentially specifies two beliefs: perceived usefulness (PU), the feeling that technology would lead to improvement in task performance, and perceived ease of use (PEOU), the feeling that using the technology is effort-free. The model was empirically tested, and PU and PEOU were shown to be crucial considerations in technology acceptance and implementation [33,34,35]. The model has been applied to studies that assessed information technology in healthcare [36, 37], which showed encouraging results on acceptance of electronic HQOOL measures [38, 39].

To our knowledge, there has not been a study assessing the feasibility and acceptability of the e-EQ-5D-5L among Chinese patients in routine primary care. Electronic administration can be challenging for older patients who have low education levels [40] and are not familiar with computer technology [41]. The Chinese (Hong Kong) e-EQ-5D-5L is a valid, reliable, sensitive, and responsive measurement of HRQOL of Chinese patients with musculoskeletal problems in routine clinical practice [20]. This study aimed to evaluate the feasibility and acceptability of an electronic platform for timely, regular measurement and reporting of e-EQ-5D-5L HRQOL data in assessing patients with chronic knee and back (collectively referred to as musculoskeletal) problems in primary care. We hypothesized that doctors and patients would find the electronic platform feasible with a completion rate of 90% or above [23] and acceptable with perceived usefulness of 80% or above [30], and that feasibility and acceptability might improve with repeated use.

Methods

Study design

This was a mixed-method study. The first part was a prospective longitudinal cohort study where quantitative data from patients and doctors were collected at baseline and two follow-ups. The second part involved qualitative interviews of the patients, doctors, and research assistants (RAs) to further explore feasibility and acceptability. The study was approved by the Institutional Review Boards (IRB) of the HKU/Hospital Authority West Cluster (reference number: UW 18–270) and the Hospital Authority Kowloon Central/ Kowloon East Clusters (reference number: KC/KE-20-0070/ER-1),

Prospective longitudinal cohort study

Patient recruitment

This study is part of a larger single-blind cluster randomized controlled trial (RCT) to evaluate the effectiveness of measuring and reporting HRQOL in routine clinical practice and the protocol has been published [20]. All doctors from three public primary care clinics that implement routine measurement of HRQOL by an e-EQ-5D-5L were invited to participate and signed a consent form. Doctors were trained to interpret the e-EQ-5D-5L profile and visual analogue scale (VAS) scores (collectively referred to as e-EQ-5D-5L/VAS). All adults aged 18 years or above with symptomatic chronic knee and/or back problems visiting the clinics were invited to participate based on the RCT’s inclusion and exclusion criteria [20]. In brief, the inclusion criteria were adults aged 18 years or above; had a doctor-diagnosed symptomatic knee and/or back problem that was expected to last for one month or more; scheduled for at least one follow-up visit in the clinic within 12 months; had given written consent to participate in the study. The exclusion criteria were patients who had life expectancy less than 12 months (judged by the doctor), had current cancers undergoing active or palliative treatment, were too ill (physically or cognitively) to complete a questionnaire; were unable to communicate in Chinese; or did not give consent to participate in the study. All participating patients signed a written consent form. Each patient was assigned a unique QR code for access to the e-EQ-5D-5L survey platform to complete the Chinese e-EQ-5D-5L and EQ-VAS online with an iPad that was connected to a central server via the clinic public Wi-Fi. One item was presented per screen and the participant could choose to move to the next item after completion or to skip the item. The original 200 mm EQ-VAS was modified to 100 mm to fit into the computer screen. The detailed administration method of the e-EQ-5D-5L with screenshots is shown in the Additional file 1: Appendix 1. Trained research assistants (RAs) provided technical assistance and read out the questions to the respondents, if necessary. Upon completion, the report summarizing the EQ-5D dimensions, utility, and VAS scores was printed (Additional file 1: Appendix 2). Patients were given the report and passed it to their doctor during the consultation and were managed accordingly, then the doctor filled out information on the clinician report form regarding the patient’s condition and management, and a questionnaire on the doctor’s PEOU and PU of the EQ-5D-5L/VAS report. After that, patients completed an e-questionnaire on the PEOU, PU, and sociodemographic data administered by the RAs.

During each clinic follow-up, the participants repeated the e-EQ-5D-5L/VAS, and the PEOU and PU questionnaire. The patient’s longitudinal e-EQ-5D-5L/VAS report which showed the change in scores since his/her initial visit was given to the doctor, and both the doctor completed their PEOU and PU questionnaire after the consultation.

Data collection occurred between June 1, 2020 and December 31, 2021. In total, 49 doctors and 665 patients were recruited from three clinics.

Study Instruments.

Chinese (Hong Kong) e-EQ-5D-5L/VAS

The EQ-5D-5L comprises of five questions assessing five HRQOL dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression). Each question has five response options (from no problems to extreme problems) and is converted to a composite utility score from zero (death) to one (perfect health), with a scoring algorithm derived from a population-based valuation. A validated Chinese (Hong Kong) version of the EQ-5D-5L is available and the Hong Kong population-specific EQ-5D-5L value set has been developed [42]. VAS measures global health from zero (worse health) to 100 (best health). An online platform was developed by the team of author CO to administer the Chinese e-EQ-5D- 5L/VAS, to calculate the utility score, and to generate a report on the longitudinal EQ-5D-5L profile scores, utility scores, and VAS scores.

Patient PEOU and PU questionnaire

Patients’ perceptions of the e-EQ-5D-5L/VAS was assessed by using the 4-item PEOU and 4-item PU questionnaire, adapted from the Chinese PEOU and PU questionnaire validated by Yan et al. [36] (Additional file 1: Appendix 3). Each item was rated on a five-point Likert Scale (1. strongly disagree to 5. strongly agree). Summative PEOU and PU scores were calculated by adding the item scores, which had an Cronbach’s alpha of 0.90 and 0.89, respectively, supporting internal reliability [36].

Patient socio-demographic questionnaire

Data on socio-demographic characteristics of patients (age, sex, education level, marital status, and occupation) and clinical characteristics (number of chronic diseases, type of musculoskeletal disease, and duration of diagnosis) were collected.

Doctors’ PEOU and PU questionnaire

Doctors’ perceptions of the e-EQ-5D-5L/VAS report was assessed by using a 3-item PEOU and 2-item PU questionnaire (Additional file 1: Appendix 4). Each item was rated on a five-point Likert Scale (1. strongly disagree to 5. strongly agree) and summative scores were calculated.

Feasibility and acceptability outcome measures

The completion and response rates, and completion time, at baseline and follow-ups of the e-EQ-5D-5L/VAS were measured as indicators of feasibility among patients. The time for completion was recorded by the electronic platform. Feasibility for the doctors was measured by the doctor-reported “extra time” they spent on the consultation to review and address the patients’ reports. The PEOU and PU ratings by patients and doctors were used to indicate the acceptability of the technology.

Individual and focus group interviews

From October to December 2021, semi-structured individual interviews for patients and separate focus groups for five doctors and three RAs were adopted to triangulate data. Purposeful sampling of RAs, doctors and patients was done across the three clinics. Two doctors who had rated on the largest number of EQ-5D/VAS reports in each clinic, with a total of six, were invited to join a focus group interview, and five accepted. Among the seven RAs who had assisted the administration of the e-EQ-5D in the clinics, three who were still working in the study clinics (one in each clinic) at the time of the qualitative study participated in the focus group interview. Patients’ age, education and number of chronic diseases were varied. The patient interviews were carried out by two trained RAs. Authors (AN & KL) experienced in qualitative research moderated the focus group interviews.

Topic guides (Additional file 1: Appendix 5) were developed for the semi-structured individual interviews and focus groups. Patient interviews lasted for 10–15 min and were conducted privately in Cantonese. The interviewer wrote the responses verbatim. The RA and doctor focus group interviews were video-recorded over Zoom, lasted for approximately 30 min each, and were conducted in Cantonese and English, respectively.

Data analysis

Quantitative

Descriptive statistics were used to present the patient baseline characteristics, e-EQ-5D-5L/VAS completion rate and time, PEOU and PU ratings and summative scores, and doctor’s time. Response rate was calculated by dividing the number of patients who had repeated the e-EQ-5D-5L/VAS by the total number of patients who had attended the follow-up in the clinics.

Differences in the completion time of e-EQ-5D-5L by the patient and doctor’s time spent on interpreting e-EQ-5D-5L, and summative scores of PEOU and PU between baseline and the two follow-ups were tested by repeated measure ANOVA. The differences in PEOU (agree/strongly agree to all items) and PU (agree/strongly agree to at least one item) ratings across three time-points were tested by chi-square test. Multiple linear regression was carried out to evaluate whether the patients’ socio-demographics, clinical characteristics, baseline e-EQ-5D-5L utility score and VAS score predicted the PEOU and PU outcomes of patients and doctors. All statistics and figures were generated with the use of IBM SPSS Statistics 17. P-value of less than 0.05 was considered as statistically significant.

Qualitative

The transcripts of patient interviews and RA focus groups were transcribed and translated into English by two authors (JC and WC). The doctor focus group was transcribed verbatim by two RAs. The accuracy of the transcription and translation was checked independently by one of the authors (AN or KL). A thematic approach for the qualitative data analysis was used. The interview transcripts were independently coded by two authors (AN and KL). The reliability and validity of the analysis and interpretation were assessed by checking the coding consistency between the two sets. Inconsistencies were resolved by discussion between the two authors to reach an agreement on a common theme.

Results

Quantitative results

The study participant flow chart is shown in Fig. 1. Baseline characteristics of the patients are shown in Table 1. Mean patients’ age was 68.74 (SD = 10.18). 58.4% of the participants had primary school education or below and 65.7% had knee problems only. The mean baseline EQ-5D-5L utility and VAS scores were 0.66 (SD = 0.28) and 64.01 (SD = 18.20), respectively.

Fig. 1
figure 1

Study participant flow chart

Full size image
Table 1 Baseline characteristics of subjects (N = 665)
Full size table

Feasibility and acceptability results are shown in Table 2. The e-EQ-5D-5L/VAS completion rates, the primary outcome of feasibility, were 99.8% and 100.0% at baseline and follow-ups, respectively. The response rates at follow-ups were 90.0%-91.1%. The mean completion time by patients significantly decreased from baseline (120.66 ± 110.74 s) to first (83.99 ± 57.16 s) and second follow-ups (105.22 ± 82.93 s) (p < 0.001). There was a significant drop in the time the doctors needed to interpret and address the report by 0.36 min from baseline (2.02 ± 1.51 min) to follow-ups (p = 0.006).

Table 2 Feasibility and acceptability of e-EQ-5D-5L/VAS at baseline and follow-up
Full size table

The proportion of patient participants that agreed to all PEOU questions statistically improved over time from 37.2% to 47.1% (p < 0.001). The summative PEOU score improved by 0.96 over time with a bigger change between baseline (12.26 ± 3.82) and first follow-up (13.00 ± 3.57) (p < 0.001). The proportion of patients who agreed to at least one PU question was similar at baseline and follow-ups (85.3–86.9%). There was no statistical difference in PU summative scores over time. The doctors agreed to both PEOU questions for a great majority (76.2–85.1%) of the patients’ reports. The summative score for doctors’ PEOU significantly improved over time (p = 0.007). Doctors’ agreeing to at least one PU item was stable (69.2–72.0%). Conversely, the summative PU score significantly increased from baseline (10.89 ± 1.93) to first (11.14 ± 2.14) and second follow-ups (11.22 ± 2.07) (p = 0.022).

Table 3 shows the factors associated with patients' PEOU and PU scores at baseline. Multiple linear regression for patients showed that older age (β = − 0.230; p < 0.001) and having primary or below (β = − 0.453; p < 0.001) and secondary school education (β = − 0.158; p = 0.032) compared to tertiary education or above was related to lower baseline summative PEOU score. Being a labour worker was statistically related to better PEOU (β = 0.123; p = 0.008), but being unemployed/homemaker/retired was related to better PU scores (β = 0.137; p = 0.027) compared to being a professional or manager. Lower utility score was significantly correlated with higher PEOU scores (β = − 0.111; p = 0.005), whereas higher VAS score was associated with better PEOU (β = 0.089; p = 0.025) and PU scores (β = 0.090; p = 0.044). Table 4 shows the factors associated with doctors’ PEOU and PU scores. Patient being a clerical worker was related to better doctors’ PEOU (β = 0.104; p = 0.021) and PU (β = 0.132; p = 0.003) compared to being a professional or manager.

Table 3 Factors associated with patients’ PEOU and PU scores on the e-EQ-5D-5L/VAS at baseline
Full size table
Table 4 Factors associated with doctors’ PEOU and PU scores on the e-EQ-5D-5L/VAS report at baseline
Full size table

Qualitative results

The themes and subthemes of all the qualitative interviews and focus groups are shown in Tables 5 and 6. The characteristics of the participants in the qualitative study are shown in the Additional file 1: Table S1, and the key quotations by themes are shown in the Additional file 1: Tables S2 and S3 and Appendix 6.

Table 5 Themes and subthemes on feasibility and acceptability of the e-EQ-5D-5L/VAS synthesized from patient interviews and RA focus group
Full size table
Table 6 Themes and subthemes on feasibility and acceptability of the e-EQ-5D-5L/VAS synthesized from doctor focus groups
Full size table

Patients’ perspective

While some patients found the e-platform easy-to-use, some had problems using technology and self-administering the survey due to vision and literacy problems. The RAs attributed this due to advanced age. Therefore, some patients needed the RA’s assistance to comprehend the questions. While most patients easily answered the e-EQ-5D-5L/VAS questions, others felt that some terms and questions were unclear. Moreover, they expressed difficulty assessing their health on a level or specifying scores due to their fluctuating health conditions. Some had difficulty providing an exact score for the VAS, though they could often provide a range. The RAs also believed that few patients perceived some of the response options as “too severe” to be selected. Encouragingly, RAs and patients agreed that understanding of the questions improved after repeated use. Also, most patients felt that the e-EQ-5D-5L/VAS helped the doctors to understand their clinical situation, particularly their pain. A few patients thought doing the e-EQ-5D-5L/VAS helped the researchers and other patients indirectly and their own treatment. However, some were unsure about the PU and suggested that it was more useful to the doctors than for themselves. Other patients found it not useful because the e-EQ-5D-5L/VAS did not lead to treatment changes and sometimes the doctors did not look at the report. Reassuringly, patients felt the survey administration was quick and felt like chatting, and it saved time for doctors to know about their painful condition before the consultation. The RAs thought the completion time was short but sometimes they had difficulties with identification of the patients during the follow-up visits, network connection problem that would sometimes prolong the survey time, and limited time before the consultations because patients had to complete other tasks before seeing the doctor. Moreover, the RAs agreed that patient attitude affected the feasibility. Patients’ attitudes were initially positive, but with repeated administrations, some patients got annoyed or were reluctant to do it because they saw that their doctor did not review their report and therefore felt the survey was useless.

Doctors’ perspective

All doctors agreed that the report was clear and easy to interpret. However, some doctors did not know if the scores were specific to their musculoskeletal problem or were also reflective of other medical problems. The report helped doctors to understand and manage their patients better. Doctors used different parts of the report to help them to assess the impact on patients’ activities of daily living, to monitor the progression of the disease, and the report provides a gateway for discussion with patients who may not bring up the musculoskeletal problem or whose pain perception differed from the doctor’s. It helped to increase counseling for some patients and to select treatment. Doctors found the report less useful for patients who were forthcoming about their musculoskeletal problem, who did not have pain that day, or whose musculoskeletal problem was being followed by other healthcare providers. In addition, doctors commented that there were certain areas that the report was unable to address, such as patients' needs and expectations. Doctors thought that the report served as a quick reference and saved time because they knew about the pain condition early in the consultation. However, the biggest challenge was balancing the usefulness of the report and the additional time to address the result because most patients had other medical issues to be dealt with in the same consultation.

Discussion

This study aimed to assess the feasibility and acceptability of using the electronic platform to collect and report HRQOL measured by the Chinese e-EQ-5D-5L.

Patient’s perspective on feasibility

Quantitatively, feasibility was measured in three ways. Firstly, completion rates were greater than 99.8%. This is better than other EQ-5D studies done in elderlies where the completion rates were just above 90% [23] and exceeded our target of 90%. Secondly, the response rates on follow-up assessments were greater than 90%. Our results were comparable to those of the Swedish orthopedic registry, with a response rate of 86.1% at baseline and 90.2% at first follow-up [4]. The drop in our response rate was largely due to being unable to successfully find the patient to complete the e-EQ-5D-5L/VAS. Additionally, patients’ attitudes played a role as some were less willing to complete the surveys in subsequent visits because they did not think the survey could change their management or the doctor did not review their report. Thirdly, completing the e-EQ-5D-5L/VAS was quick with an average of less than two minutes, compared to less than five minutes for the paper e-EQ-5D-5L administered in elderlies [43]. The RAs commented that time would only be a barrier if the patient arrived late to their appointment as this would interfere with the patient’s time to perform pre-consultation activities.

Patients’ perceptions

Over 80% of patients perceived the e-EQ-5D-5L/VAS useful, which supported acceptability of HRQOL measurement in routine primary care. However, more than half of the patients did not perceive the e-EQ-5D-5L/VAS easy-to-use. The barriers for our patients to the formation of positive perceptions of e-EQ-5D-5L/VAS included being unfamiliar with technology, and having problems with vision, literacy, and understanding survey questions and responses. In the RA views, these problems were related to the old age. The study population was mostly senior (mean age of 68.74 years old), and we found age was associated with worse baseline PEOU scores. A study in Hong Kong studying the perceptions and acceptance of gerontechnology also found that age was associated with PEOU, but the effects of PU were mediated by other factors [44]. In Hong Kong, only 65% of persons aged over 65 had a smartphone and 62% have used the internet in the past year [41] which may be a reason for patients being unfamiliar with technology. Also, half of the patient participants had primary school education or below, and lower education was a factor associated with worse baseline PEOU scores. Poor literacy would not only affect their ability to read, but also to understand the questions. A systematic review showed that elderlies have more problems with interpretation of questions and understanding the VAS [23]. Quantitatively and qualitatively, our data showed that patient’s PEOU improved from baseline to follow-up which highlight that with repeated use, patients can learn to use technology. Similarly, a Canadian study showed participants were able to learn how to complete an e-HRQOL questionnaire, despite only 35% having a more than high school education [45]. Our study showed that those who are labour workers found the e-EQ-5D-5L/VAS easier to use and those who are retired, unemployed or homemakers found it more useful than professionals and managers, suggesting the report could enhance the communication on their health conditions with the doctor for these groups. Lastly, this study showed that patients with worse utility scores found it easier to use; however, patients who had higher VAS scores thought that it was easier to use and more useful. The discrepancy could be differences in what the utility score and VAS measure: VAS represents the patient perspective, whereas the utility score represents the society’s perspective.

Unfortunately, there is a paucity of studies assessing the acceptability of the EQ-5D. A UK qualitative study assessing asthmatic patients’ views on the EQ-5D-5L found negative perceptions of the tool as many of the domains were irrelevant to asthmatic patients. This present study is quite different and focuses on musculoskeletal problems which is easier to interpret using the EQ-5D.

Doctors’ perspective on feasibility of implementation

Although interpreting and addressing the e-EQ-5D-5L/VAS report was quick, usually taking less than two minutes, doctors felt that the time to fully address the results would be a barrier. The average length of a consultation in Hong Kong’s public clinic is approximately six minutes [46] and a majority of the patients have at least one other comorbidities that would need to be addressed at the same visit. While efforts are being made to increase consultation time in the public sector [47], the use of the e-EQ-5D-5L was felt to help to understand the patient’s pain in a shorter amount of time which may facilitate shorter length of the consultation. An additional two minutes to address musculoskeletal problems could save time from the need for a repeat consultation, which ultimately may reduce the doctors’ work burden.

Doctors’ perceptions

Research shows that the acceptance of HRQOL assessment by clinicians depend on the familiarity of the tool and what it measures [7]. We discovered that doctors found the e-EQ-5D-5L/VAS reports easy-to-use and useful. Encouragingly, PU and PEOU scores improved with repetition, implying that with time doctors become more familiar with interpreting and using the report. The PU rate did not reach our 80% target but is better than those found in another study [48]. In a QOL study of oncology patients, only in 42% of the visits did the physicians find the data clinically useful; but this could be related to the different QOL tool used, clinical setting, and clinical diagnosis [48]. The doctors in our study used different aspects of the report to learn about the impact on the patient’s life, to help to monitor the disease progression, and to provide a gateway for discussion. Our data show that the doctors’ PU was better for those who were clerical workers compared to professionals and managers and for those with more chronic diseases. We can hypothesize that clerical workers’ administrative roles may make it easier for doctors to communicate the report results for this group. Doctors agreed that the report saves time which may explain why they find it more useful for those with multiple chronic illnesses as they can better prioritize the problems. Studies on HRQOL measurements in real clinical practice also confirm that the additional information helped to enhance communication and to facilitate the management of patients [45].

Limitations

Firstly, the doctors’ data on PEOU and PU could be biased because specific doctors' perceptions of the e-EQ-5D-5L/VAS report could have biased the results as 665 patients were not equally allocated to the 49 doctors. Secondly, sampling of patients for the qualitative interviews may be skewed as those who would be more “annoyed” would likely not agree to be interviewed. Thirdly, in real clinical practice, existing staff would need to be trained to take the task of introducing the assessment to patients, which was a part of feasibility not assessed in this study. Fourthly, the findings were limited to the Chinese patients with knee or back problems, which may not be generalizable to non-Chinese populations and patients with other musculoskeletal problems.

Future direction to enhance implementation

Patients should come to a designated clinic area earlier than their scheduled follow-up time to complete the survey and to have a staff teach them how to use the device and explain the questions the first time. Adding an audio function to read out questions and record answers, and increasing the font size of the questions [49] may help patients with visual and literacy problems. Software upgrades that allow patients to mark on a line for the VAS question rather than indicating a numerical score may be easier for patients. Simplifying each page by having a meaningful title and using easy-to-understand icons have shown to be helpful [49]. To improve relevance, only patients whose musculoskeletal problems are under the clinic’s care and not other health care providers should complete the e-EQ-5D-5L/VAS.

Conclusion

We found the e-EQ-5D-5L/VAS a feasible and acceptable measurement of HRQOL of patients with chronic knee and back problems in routine primary care, providing real-time reporting and feedback on HRQOL to assist doctors’ management during the consultation. The acceptability by medical practitioners is crucial for the implementation of a new technology in real clinical practice. The doctors’ feedback on the EQ-5D-5L/VAS report is generally positive as a means to enhance the holistic understanding of patients’ condition and a quick reference to help prioritizing health problems that can potentially save time in the overall consultation. Over time, patients can learn to use the electronic surveys more easily and the doctors become more comfortable with interpreting HRQOL results, which can facilitate wider implementation. Patients and doctors use little time to complete and interpret the e-EQ-5D-5L/VAS, respectively. These study findings should encourage medical practitioners to apply e-EQ-5D-5L/VAS on the targeted patients for more patient-centred management. Nonetheless, the administration of the HRQOL survey can be made easier for patients with visual and literacy difficulties, and the lack of consultation time is an important barrier to be addressed.

Abbreviations

EQ-5D:

EuroQol-5-dimension

e-EQ-5D-5L:

Electronic five-level Euroqol 5 dimension

e-EQ-5D-5L/VAS:

Electronic five-level Euroqol 5 dimension and visual analog scale

HRQOL:

Health-related quality of life

RCT:

Randomized controlled trials

PEOU:

Perceived ease of use

PRO:

Patient-reported outcome

PU:

Perceived usefulness

TAM:

Technology acceptance model

VAS:

Visual analogue scale

References

  1. Bullinger M, Anderson R, Cella D, Aaronson N. Developing and evaluating cross-cultural instruments from minimum requirements to optimal models. Qual Life Res. 1993;2(6):451–9.

    Article  CAS  PubMed  Google Scholar 

  2. Porter I, Gonçalves-Bradley D, Ricci-Cabello I, Gibbons C, Gangannagaripalli J, Fitzpatrick R, Black N, Greenhalgh J, Valderas JM. Framework and guidance for implementing patient-reported outcomes in clinical practice: evidence, challenges and opportunities. J Comp Effect Res. 2016;5(5):507–19.

    Article  Google Scholar 

  3. Crane HM, Lober W, Webster E, Harrington RD, Crane PK, Davis TE, Kitahata MM. Routine collection of patient-reported outcomes in an HIV clinic setting: the first 100 patients. Curr HIV Res. 2007;5(1):109–18.

    Article  CAS  PubMed  Google Scholar 

  4. Rolfson O, Kärrholm J, Dahlberg L, Garellick G. Patient-reported outcomes in the Swedish hip arthroplasty register: results of a nationwide prospective observational study. J Bone Jt Surg Br. 2011;93(7):867–75.

    Article  CAS  Google Scholar 

  5. Forsberg HH, Nelson EC, Reid R, Grossman D, Mastanduno MP, Weiss LT, et al. Using patient-reported outcomes in routine practice: three novel use cases and implications. J Ambul Care Manage. 2015;38(2):188–95.

    Article  PubMed  Google Scholar 

  6. Lindgren J, Wretenberg P, Kärrholm J, Garellick G, Rolfson O. Patient-reported outcome is influenced by surgical approach in total hip replacement: a study of the Swedish hip arthroplasty register including 42 233 patients. Bone Jt J. 2014;96(5):590–6.

    Article  Google Scholar 

  7. Donaldson MS. Taking stock of health-related quality-of-life measurement in oncology practice in the United States. JNCI Monogr. 2004;2004(33):155–67.

    Article  Google Scholar 

  8. Boyce MB, Browne JP, Greenhalgh J. The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: a systematic review of qualitative research. BMJ Qual Saf. 2014;23(6):508–18.

    Article  PubMed  Google Scholar 

  9. Lavallee DC, Chenok KE, Love RM, Petersen C, Holve E, Segal CD, Franklin PD. Incorporating patient-reported outcomes into health care to engage patients and enhance care. Health Aff. 2016;35(4):575–82.

    Article  Google Scholar 

  10. Van Der Wees PJ, Van Der Nijhuis SMW, Ayanian JZ, Black N, Westert GP, Schneider EC. Integrating the use of patient-reported outcomes for both clinical practice and performance measurement: views of experts from 3 countries. Milbank Q. 2014;92(4):754–75.

    Article  Google Scholar 

  11. Turner GM, Litchfield I, Finnikin S, Aiyegbusi OL, Calvert M. General practitioners’ views on use of patient reported outcome measures in primary care: a cross-sectional survey and qualitative study. BMC Fam Pract. 2020;21(1):14.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Greenhalgh J. The applications of PROs in clinical practice: what are they, do they work, and why? Qual Life Res. 2009;18(1):115–23.

    Article  PubMed  Google Scholar 

  13. Rabin R, de Charro F. EQ-SD: a measure of health status from the EuroQol Group. Ann Med. 2001;33(5):337–43.

    Article  CAS  PubMed  Google Scholar 

  14. Yang Z, Busschbach J, Liu G, Luo N. EQ-5D-5L norms for the urban Chinese population in China. Health Qual Life Outcomes. 2018;16(1):210.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Wong EL-Y, Cheung AW-L, Wong AY-K, Xu RH, Ramos-Goñi JM, Rivero-Arias O. Normative profile of health-related quality of life for Hong Kong general population using preference-based instrument EQ-5D-5L. Value Health. 2019;2(8):916–24.

    Article  Google Scholar 

  16. Ping W, Zheng J, Niu X, Guo C, Zhang J, Yang H, Shi Y. Evaluation of health-related quality of life using EQ-5D in China during the COVID-19 pandemic. PLoS ONE. 2020;15(6):e0234850.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Luo N, Liu G, Li M, Guan H, Jin X, Rand-Hendriksen K. Estimating an EQ-5D-5L value set for China. Value Health. 2017;20(4):662–9.

    Article  PubMed  Google Scholar 

  18. Bagattini ÂM, Camey SA, Miguel SR, Andrade MV, de Souza Noronha KVM, Teixeira MADC, Lima AF, Santos M, Polanczyk CA, Cruz LN. Electronic version of the EQ-5D quality-of-life questionnaire: adaptation to a Brazilian population sample. Value Health Reg Issues. 2018;17:88–93.

    Article  PubMed  Google Scholar 

  19. Azzolina D, Minto C, Boschetto S, Martinato M, Bauce B, Iliceto S, Gregori D. Anchoring vignettes in EQ-5D-5L questionnaire: validation of a new instrument. Open Nurs J. 2017;11(1):144–56.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Lam CLK, Tse ETY, Wong CKH, Lam JSM, Chen SS, Bedford LE, Cheung JPY, Or CK, Kind P. A pilot study on the validity and psychometric properties of the electronic EQ-5D-5L in routine clinical practice. Health Qual Life Outcomes [Internet]. 2021. https://0-doi-org.brum.beds.ac.uk/10.1186/s12955-021-01898-3.

    Article  Google Scholar 

  21. Taenzer P, Bultz BD, Carlson LE, Speca M, DeGagne T, Olson K, Doll R, Rosberger Z. Impact of computerized quality of life screening on physician behaviour and patient satisfaction in lung cancer outpatients. Psychooncology. 2000;9(3):203–13.

    Article  CAS  PubMed  Google Scholar 

  22. Or C, Dohan M, Tan J. Understanding critical barriers to implementing a clinical information system in a nursing home through the lens of a socio-technical perspective. J Med Syst. 2014;38(9):1–10.

    Article  PubMed  Google Scholar 

  23. Marten O, Brand L, Greiner W. Feasibility of the EQ-5D in the elderly population: a systematic review of the literature. Qual Life Res. 2021;1–17.

  24. Schrag A, Selai C, Jahanshahi M, Quinn NP. The EQ-5D: a generic quality of life measure—is a useful instrument to measure quality of life in patients with Parkinson’s disease. J Neurol Neurosurg Psychiatry. 2000;69(1):67–73.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Hernar I. Using patient-reported outcome measures (PROMs) in clinical diabetes consultations: feasibility testing and piloting the DiaPROM trial among adults with type 1 diabetes. Bergen Open Res Arch. 2021;1:1–190.

    Google Scholar 

  26. Meirte J, Hellemans N, Anthonissen M, Denteneer L, Maertens K, Moortgat P, Van Daele U. Benefits and disadvantages of electronic patient-reported outcome measures: systematic review. JMIR Perioper Med. 2020;3(1):e15588.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Rolfson O. Patient-reported outcome measures and health-economic aspects of total hip arthroplasty. Department Of Orthopaedics, Institute of Clinical Sciences Gothenburg: Sahlgrenska Academy, University of Gothenburg. 2010:60.

  28. Mulhern B, O’Gorman H, Rotherham N, Brazier J. Comparing the measurement equivalence of EQ-5D-5L across different modes of administration. Health Qual Life Outcomes. 2015;13(1):1–9.

    Article  Google Scholar 

  29. Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):1–13.

    Article  Google Scholar 

  30. Mullen KH, Barry DL, Zierler BK. Online exclusive-computerized symptom and quality-of-life assessment for patients with cancer part II: acceptability and usability. Oncol Nurs Forum-Oncol Nurs Soc. 2004;31(5):896.

    Google Scholar 

  31. Abernethy AP, Herndon JE II, Wheeler JL, Day JM, Hood L, Patwardhan M, Shaw H, Lyerly HK. Feasibility and acceptability to patients of a longitudinal system for evaluating cancer-related symptoms and quality of life: pilot study of an e/Tablet data-collection system in academic oncology. J Pain Symptom Manage. 2009;37(6):1027–38.

    Article  PubMed  Google Scholar 

  32. Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 1989;319–40.

  33. Venkatesh V, Bala H. Technology acceptance model 3 and a research agenda on interventions. Decis Sci. 2008;39(2):273–315.

    Article  Google Scholar 

  34. Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manage Sci. 2000;46(2):186–204.

    Article  Google Scholar 

  35. Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: a comparison of two theoretical models. Manage Sci. 1989;35(8):982–1003.

    Article  Google Scholar 

  36. Yan M, Or C. A 12-week pilot study of acceptance of a computer-based chronic disease self-monitoring system among patients with type 2 diabetes mellitus and/or hypertension. Health Inf J. 2019;25(3):828–43.

    Article  Google Scholar 

  37. Or CK, Karsh B-T. A systematic review of patient acceptance of consumer health information technology. J Am Med Inform Assoc. 2009;16(4):550–60.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Buxton J, White M, Osoba D. Patients’ experiences using a computerized program with a touch-sensitive video monitor for the assessment of health-related quality of life. Qual Life Res. 1998;7(6):513–9.

    Article  CAS  PubMed  Google Scholar 

  39. Taenzer PA, Speca M, Atkinson MJ, Bultz BD, Page S, Harasym P, Davis JL. Computerized quality-of-life screening in an oncology clinic. Cancer Pract. 1997;5(3):168–75.

    CAS  PubMed  Google Scholar 

  40. Census and Statistics Department HKSARG. 2016 Population By-census: thematic report: older persons [Internet]. Hong Kong: Census and Statistics Department HKSARG; 2016 [cited 2022 Aug 25]. https://www.statistics.gov.hk/pub/B11201052016XXXXB0100.pdf.

  41. Census and Statistics Department HKSARG. Usage of information technology and the internet by Hong Kong residents, 2000–2019 [Internet]. Hong Kong: Census and Statistics Department HKSARG; 2020. https://www.statistics.gov.hk/pub/B72010FA2020XXXXB0100.pdf. Accessed 25 Aug 2022.

  42. Wong E, Yeoh E, Slaap B, Tam W, Cheung A, Wong A, Chan D. Validation and valuation of the preference-based healthindex using Eq-5d-5l in the Hong Kong population. Value Health. 2015;18(3):A27.

    Article  Google Scholar 

  43. Holland R, Smith RD, Harvey I, Swift L, Lenaghan E. Assessing quality of life in the elderly: a direct comparison of the EQ-5D and AQoL. Health Econ. 2004;13(8):793–805.

    Article  PubMed  Google Scholar 

  44. Chen K, Chan AHS. Gerontechnology acceptance by elderly Hong Kong Chinese: a senior technology acceptance model (STAM). Ergonomics. 2014;57(5):635–52.

    Article  PubMed  Google Scholar 

  45. Santana M-J, Feeny DH. Using the health utilities index in routine clinical care: process, feasibility, and acceptability. Patient: Patient-Cent Outcomes Res. 2009;2(3):159–67.

    Article  Google Scholar 

  46. The Government of the Hong Kong Special Administrative Region. LCQ7: consultation time of out-patient services of hospital authority [Internet]. Hong Kong: The Government of the Hong Kong Special Administrative Region; 2017. https://www.info.gov.hk/gia/general/201711/01/P2017110100484.htm. Accessed 25 Aug 2022.

  47. Food and Health Bureau, The Government of the Hong Kong Special Administrative Region. Report of the steering comittee on review of Hospital authority [Internet]. Hong Kong: Food and Health Bureau, The Government of the Hong Kong Special Administrative Region; 2015. https://www.healthbureau.gov.hk/download/committees/harsc/report/en_full_report.pdf. Accessed 25 Aug 2022.

  48. Wright E, Selby P, Crawford M, Gillibrand A, Johnston C, Perren T, Rush R, Smith A, Velikova G, Watson K. Feasibility and compliance of automated measurement of quality of life in oncology practice. J Clin Oncol. 2003;21(2):374–82.

    Article  CAS  PubMed  Google Scholar 

  49. Gao Q, Ebert D, Chen X, Ding Y. Design of a mobile social community platform for older Chinese people in urban areas. Human Fact Ergon Manuf Serv Ind. 2015;25(1):66–89.

    CAS  Google Scholar 

Download references

Acknowledgements

This study was supported by the General Research Fund (Ref No. 17100119), Hong Kong Research Grant Council. The authors thank EuroQol Group for the permission to use the full version of the EQ-5D-5L Web version for this designated research purposes. We would like to thank all the doctors who participated in this study: Dr. Chan Hau Ting, Dr. Chan Linda, Dr. Chan Ngai Ping, Dr. Chan Pui Wai, Dr. Chan Shan Chin, Dr. Chan Siu Yuen, Dr. Chan Yiu Shing, Dr. Chang Hsu Wei, Dr. Cheung Chi Hong, Dr. Fung Hoi Tik, Dr. Ho Wang Fung, Dr. Hui Yuk Ting, Dr. Iong Ka I, Dr. Kwan Chun Yin, Dr. Kwan Sze Sing, Dr. Kwok Chi Sum, Dr. Kwok Yee Ming, Dr. Lam Ka Wing, Dr. Lee Chi Leung, Dr. Lee Pui Wai, Dr. Lee Shek Hang, Dr. Leung Ka Cheong, Dr. Lim Martina, Dr. Ma Man Ki, Dr. Pang Sze Ching, Dr. Shiu Wing Ho, Dr. Sin Ming Cheun, Dr. Siu Pui Yi, Dr. Suen Victoria, Dr. Sze Lung Yam, Dr. Tang Wan Ki Sa, Prof. Lam Tai Pong, Dr. Tsang Pui Lim, Dr. Tsim Koon Lan, Dr. Wong Che Tik, Dr. Wong Chi Wai, Dr. Wong Hang Chin, Dr. Wong Tsang Kwok, Dr. Wu Sum Yi, Dr. Wu Xiao Qing, Dr. Yan Lai Wu, Dr. Yang Yin Ying, Dr. Yau Chi Yan, Dr. Yau Lai Mo, Dr. Yu Yee Tak and Dr. Yung Yin Ying. We would like to thank all the research assistants who helped with participant recruitment and data collection: Ms. Au Natalie, Ms. Chan Clara, Mr. Lai Anson, Ms. Lam Joyce, Ms. Pan Rainnie, Mr. Wong Simon and Ms. Zheng Alice.

Funding

Financial support for this study was provided by the General Research Fund (Ref No. 17100119), Hong Kong Research Grant Council. The funding agreement ensured the authors independence in designing the study, interpreting the data, writing, and publishing the report.

Author information

Authors and Affiliations

  1. Department of Family Medicine and Primary Care, The University of Hong Kong-Shenzhen Hospital, 1 Haiyuan 1st Rd, Futian District, Shenzhen, 518009, Guangdong Province, China

    Amy Pui Pui Ng, Emily Tsui Yee Tse & Cindy Lo Kuen Lam

  2. Department of Family Medicine and Primary Care, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, 3rd Floor, Ap Lei Chau Clinic, 161 Main Street, Ap Lei Chau, Hong Kong SAR, China

    Amy Pui Pui Ng, Kiki Sze Nga Liu, Will Ho Gi Cheng, Carlos King Ho Wong, John King Yiu Cheng, Joyce Sau Mei Lam, Emily Tsui Yee Tse & Cindy Lo Kuen Lam

  3. Department of Pharmacology and Pharmacy, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Pok Fu Lam, Hong Kong SAR, China

    Carlos King Ho Wong

  4. Laboratory of Data Discovery for Health (D²4H), Hong Kong Science and Technology Park, Hong Kong SAR, Sha Tin, China

    Carlos King Ho Wong

  5. Department of Industrial and Manufacturing Systems Engineering, Faculty of Engineering, The University of Hong Kong, Pok Fu Lam, Hong Kong SAR, China

    Calvin Kalun Or

Authors
  1. Amy Pui Pui Ng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kiki Sze Nga Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Will Ho Gi Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carlos King Ho Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. John King Yiu Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Joyce Sau Mei Lam
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Calvin Kalun Or
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Emily Tsui Yee Tse
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Cindy Lo Kuen Lam
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AN drafted the manuscript, reviewed the transcription of the qualitative data, analysed the qualitative data and assisted with the interpretation of the quantitative and qualitative results. CL and CO contributed to study design, acquisition of data and reviewed/edited the manuscript. JC, WC and CW contributed to statistical analysis, interpretation of results and reviewed the manuscript. JC and WC helped with being the observer in the qualitative interviews and helped with transcription. KL contributed as a moderator of a focus group, assisted with transcription and analysis of qualitative data and edited the manuscript. ET helped with interpretation of results and review of the manuscript. JL contributed to data collection and revision of the manuscript. All authors read and approved the final manuscript

Corresponding author

Correspondence to Cindy Lo Kuen Lam.

Ethics declarations

Ethical approval and consent to participate

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. (HKU/Hospital Authority Hong Kong West Cluster IRB reference number: UW 18-270, Hospital Authority Kowloon Central/ Kowloon East Cluster IRB reference number: KC/KE-20-0070/ER-1) Informed consent was obtained from all individual participants included in the study.

Consent for publication

Not applicable.

Availability of data and materials

The datasets used during the current study are available from the corresponding author on reasonable request.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

Supplementary Materials on e-EQ-5D-5L platform, study questionnaires, interview guides and qualitative interview subject characteristics.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ng, A.P.P., Liu, K.S.N., Cheng, W.H.G. et al. Feasibility and acceptability of electronic EQ-5D-5L for routine measurement of HRQOL in patients with chronic musculoskeletal problems in Hong Kong primary care. Health Qual Life Outcomes 20, 137 (2022). https://0-doi-org.brum.beds.ac.uk/10.1186/s12955-022-02047-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12955-022-02047-0

Keywords

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us