Drug Hypersensitivity Quality of Life Questionnaire: validation procedures and first results of the Portuguese version

Abstract

Background

Hypersensitivity reactions to drugs are unpredictable and can be very complex and severe, even life threatening. Assess its impact on patient’s health related quality of life (HRQoL) is crucial. The Drug Hypersensitivity Quality of Life Questionnaire (DrHy-Q) is the only validated disease-specific HRQoL questionnaire. We aimed to translate and cross-cultural validate the DrHy-Q to the Portuguese population. It was also our purpose to determine the impact of drug hypersensitivity on patients’ HRQoL.

Methods

The translation and cross-cultural adaptation of the DrHy-Q to Portuguese was performed according to standards. Reliability of the DrHy-Q Portuguese version was assessed in terms of internal consistency and test–retest reliability. Structural validity, divergent validity (with a generic health related QoLQ-PGWBI) and discriminant validity were also evaluated. Forty patients accepted to participate in the validation phase. The Portuguese version of the DrHy-Q was applied to 260 consecutively adult patients, studied in our Department for suspected drug hypersensitivity.

Results

The Portuguese DrHy-Q showed adequate internal consistency (Cronbach’s ɑ = 0.938), good test–retest reliability [ICC = 0.713 (95% CI 0.488–0.850] and one-dimensional structure. No significant correlation was found between the DrHy-Q and the PGWBI total scores (r = − 0.010, p = 0.957). Two hundred of patients completed the study: 78.5% female; mean age = 44 ± 15 years. Mean DrHy-Q score was 36.8 ± 12.6. Two clinical factors significantly predict DrHy-Q total score: clinical manifestations and number of suspected drugs. Patients with anaphylaxis (β = 11.005; 95% CI 5.523; 16.487), urticaria/angioedema (β = 7.770; 95% CI 2.600; 12.940) and other manifestations (β = 7.948; 95% CI 1.933; 13.962) are more likely to have higher DrHy-Q total score than patients with maculopapular exanthema. Patients with ≥ 2 suspected drugs are also more likely to have worse QoL (β = 7.927; 95% CI 3.687; 12.166).

Conclusion

The Portuguese version of DrHy-Q revealed adequate validity and reliability, indicating that it is appropriate to assess the impact of drug hypersensitivity on patients’ HRQoL, providing data for a better comprehension and management of our patients. Moreover, our results highlight that the severity of the drug hypersensitivity reaction and the number of suspected drugs have impact on patient’s DrHy-QoL.

Background

Drug allergic reactions are adverse drug reactions mediated by immunological mechanisms. They are unpredictable and potentially severe, even life-threatening. In practice, when an immunological mechanism cannot be demonstrated, the term drug hypersensitivity is applied to adverse drug reactions that clinically resemble allergy. Drug hypersensitivity reactions (DHR) comprise 15% of all adverse drug reactions [1,2,3] and are responsible for significant morbidity and socio-economical costs [4]. Due to their unpredictable nature and potential severity, drug hypersensitivity may have an important impact on patients’ health-related quality of life (HRQoL). HRQoL is a central patient reported outcome defined as those aspects of self-perceived well-being that are related to or affected by the presence of disease or treatment [5].

The assessment of HRQoL becomes critical in routine clinical practice, research and regulatory processes, namely in allergic and other chronic diseases. It allows a broader understanding of the impact on patients of their diseases and therapies [6, 7], regardless any interpretation by physician or others [8]. However, HRQoL is rarely assessed in patients with DHR probably due to the lack of specific tools for this purpose [4, 9]. The only specific tool measuring HRQoL in this field is the Drug Hypersensitivity Quality of Life Questionnaire (DrHy-Q) developed and validated by an Italian group [6]. The DrHy-Q was derived from a 34 generation-phase items to a 15-items questionnaire. The purpose was to assess the specific burden of drug hypersensitivity from the patient’s perspective, specifically the impact of the drug hypersensitivity in the patient’s life from emotional, physical and social point of view. This questionnaire was shown to be suitable for assessing quality of life in patients that experienced a DHR and can be used alone or in combination with other patient-reported outcome questionnaires. Subsequently, the DrHy-Q was translated and validated in some cultural settings such as Spain [9, 10], Turkey [8], Netherlands [4] and Thailand [11], but not in Portugal or in the Portuguese language.

The main aim of this study was to translate and cross-cultural validate the original Italian version of the DrHy-Q to the Portuguese population. The secondary aims were to determine the impact of drug hypersensitivity on patients’ HRQoL and to compare the clinical features between patients with confirmed versus excluded drug hypersensitivity.

Methods

We used the only validated health related quality of life questionnaire in the field of drug allergy, the Drug Hypersensitivity Quality of Life Questionnaire (DrHy-Q). It is a 15-item tool, self-completed and evaluated on a five-point Likert scale [from 1 (not at all) to 5 (very much)]. Higher scores signify worse HRQoL [6].

Translation and cross-cultural adaptation of DrHy-Q

The translation and cross-cultural adaptation of this HRQoL to the Portuguese language was performed according to the standards for translation and cultural adaptation for Patient-Reported Outcomes (PROs) tools [7, 12, 13].

Forward translation

After obtaining authorization from the authors of the original instrument, the DrHy-Q [6] was translated to Portuguese language. This phase involved two local translators (Portuguese native speakers, familiar with the specific terminology and knowledgeable of the italian-speaking culture), a Portuguese HRQoL expert and a Portuguese Allergy specialist and included the following steps:

• Independently production of 2 forward versions of the questionnaire (original items, instructions and response choices), by each translator (Version 0a and Version 0b);

• Production of a single reconciled version by both translators and researchers, after discussion of the 2 forward versions (Version 1).

Backward translation

In this phase, the first reconciled forward version of the questionnaire (Version 1) was translated back into the source language by a local translator (native speaker of the target language and bilingual in source language) with no access to the original source version of the questionnaire. This backward translation, was sent to the authors in order to be compared with the original source version and detect any misunderstandings, mistranslations or inaccuracies. After the authors review and as result of this phase, a second version of the questionnaire was obtained (Version 2). Only 1 minor change was made from the first to the second version.

Pilot testing

In order to determine if the translated questionnaire is understood and the language simple and appropriate, the second version of the questionnaire was tested on a panel of 30 adult patients, through face to face interviews conducted by the same interviewer (Allergy specialist). Patients were inquired regarding any difficulty in understanding the questionnaire and their interpretation of all items was checked. This pretest phase showed that the questions were easily understandable and do not require explanation. Patients suggested only a minor change to item 2, in order to optimize the understanding. As a result of this phase, a third and final version of the translated questionnaire was produced (“Appendix”).

Validation procedures

The psychometric properties of the Portuguese version of the DrHy-Q were evaluated in accordance with current guidelines [14, 15]. Data was collected using a convenience sampling method [16]. A randomized group of 40 patients accepted to participate in this validation phase.

Reliability

Reliability refers to the consistency of the measure. Internal consistency and test–retest reliability were assessed.

The test–retest reliability of the DrHy-Q was evaluated by applying the questionnaire to the randomized group of 40 patients on two different occasions, one-week apart, without any intervention, personal or clinical significant changes. Questionnaires were sent by e-mail.

Validity

Validity is the degree to which an instrument measure what is intended to measure. The validity of the DrHy-Q was assessed with 3 different analyses: structural validity, divergent validity and discriminant validity.

Structural validity was assessed with exploratory factor analysis (EFA) [17]. The PGWBI instrument was chosen for the purpose of ascertaining divergent validity. It is expected a lack of correlations between PGWBI and HRQoL since theoretically they measure different constructs. The 40 randomized patients involved in the validation phase were also asked to complete the Portuguese validated version of the Psychological General Well-being Index (PGWBI) [18]. The PGWBI is a brief self-administered questionnaire with 22 items on a six-point Likert scale. Each item is scored from 0 to 5 points, leading to a total score between 0 and 110 points, with higher values indicating better well-being [19]. The PGWBI evaluates six mood states (anxiety, depressed mood, positive well-being, self-control, general health, and vitality) and has been extensively used as an indicator of HRQoL in patients with chronic conditions [6,7,8]. Discriminant validity, the instrument’s ability to differentiate between populations that are known or expected to differ [6], was evaluated by comparing DrHy-Q scores from patient groups with different clinical characteristics.

Drug diagnostic work-up

The drug hypersensitivity diagnostic work-up was performed according to international guidelines [1], in order to confirm or exclude the suspected drug hypersensitivity. The type and severity of reaction, the suspected drug and the availability of validated skin tests and in-vitro tests were considered. It included a validated questionnaire (the drug hypersensitivity questionnaire developed by European Network of Drug Allergy- ENDA) [20] and, depending on the previous referred factors, skin tests (prick, intradermal and/or patch) [21, 22], specific IgE and drug provocation test (DPT) [23].

The diagnosis of drug hypersensitivity was confirmed when skin tests were positive for validated concentrations or when specific provocation test with the suspected drug was positive. On the other hand, drug hypersensitivity diagnosis was excluded if all diagnostic procedures, including DPT with the suspected drug, were negative. Patients that did not complete the diagnostic work-up or that did not reach a conclusive diagnosis were excluded.

Study population

The final version of the translated questionnaire was applied, from July 2017 to December 2018, to 260 consecutively patients ≥ 18 years-old, studied in our Allergy Department for suspected drug hypersensitivity. The patients filled the questionnaire in their first visit to the day hospital.

Individuals that do not completed the DrHy-Q were excluded.

Social-demographic data were also collected.

Written informed consent was obtained by all individuals included in the study and the protocol was approved by the Hospital Ethics Committee (CE-66-2016).

Statistical analysis

Data were entered and analyzed using the Statistical Package for Social Sciences version 25 and statistical significance was defined as p < 0.05.

Variables were expressed as mean ± standard-deviation or relative and absolute frequencies. Categories with few cases were combined.

Internal consistency of the DrHy-Q was tested by Cronbach’s alpha coefficient. A value of ≥ 0.70 is considered adequate for group comparison, but a value of 0.90–0.95 is needed for clinical application [24,25,26].

The test–retest reliability of the DrHy-Q was evaluated by applying the questionnaire to the randomized group of 40 patients on two different occasions, as described above. The 2 score sets were analyzed by the t test for paired samples [26]. The intra-class correlation coefficient (ICC); a two-way mixed model, was also used to assess test–retest reliability [27]. This model indicates the proportion of variance that is due to between-subject variability relative to the sum of between-subject variability and measurement error. Criteria for ICC values were < 0.4 as poor, 0.4–0.59 as fair, 0.6–0.74 as good and > 0.75 as excellent reliability.

The Bland–Altman plot was also created to visualize the agreement between the questionnaire responses at the two time points (baseline and retest) [28].

The validity of the structure was tested using the EFA [17]. In order to evaluate the number of dimensions that emerged from the data EFA with maximum likelihood was performed. To determine the number of factors to be included eigenvalues > 1 and the scree plot were examined. Items with factor loadings below 0.40 were planned to be eliminated.

To assess divergent validity, the Pearson correlation was used to analyze the correlation between the DHRQoL and the PGWBI total and the 6 domain scores. Values of − 0.25 to 0 mean poor or no correlation; − 0.50 to − 0.25 = fair; − 0.75 to − 0.50 = moderate-to-good; − 1.0 to − 0.75 = good-to-excellent correlation.

Independent t-test or ANOVA were used to analyze differences between groups on DrHy-Q total score.

Additionally, a multiple linear regression model was designed using automatic linear modeling (ALM) [29] to evaluate which factors are associated with DrHy-Q total score. Automatic Linear Modeling is a modification and improvement of the traditional linear regression procedure, particularly in automatic variable selection and automatic data preparation [29] Multiple combinations and weighted importance are tested to determine the optimum and best-fit model possible [30]. This method also ranks predictors according to their degree of dependence from the less important to the most important.

Significant variables in the bivariate analysis were included in the model. The forward stepwise approach was used and Akaike Information Criterion Corrected (AICC) was selected as the variable entry/removal criterion. These analyses assess the discriminant validity of the DrHy-Q.

Results

Study population and Drug allergy work-up

Two hundred of patients completed the diagnostic work-up and fully filled the DrHy-Q, during the study period: 78.5% were female with a mean age of 44 ± 15 years, range [18–77]. All data in the Additional file 1.

There were more 60 patients studied during this period that were excluded: 6 patients did not fully complete the DrHy-Q; 29 did not complete the drug allergy diagnostic work-up or did not have a conclusive result and 25 patients missed the identification number in the DrHy-Q and could not be linked to the drug diagnostic work-up. These patients were not included in any analysis.

Antibiotics were the most commonly implicated drugs (168/220 patients, 84%), followed by Nonsteroidal Anti-inflammatory drugs-NSAID (44/200 patients; 22%). The main clinical presentations were maculopapular exanthema-MPE (39.5%), urticaria/angioedema (22.5%) and anaphylaxis (20%). Fifty-one percent of the reactions were immediate and 39.5% non-immediate.

After completing the drug allergy work-up 93 patients (46.5%) had the final diagnosis of confirmed drug allergy/hypersensitivity.

The likelihood of confirmed drug hypersensitivity versus a negative diagnostic work-up was significantly higher in the cases involving immediate reactions (66.3% vs 39%, p < 0.001), severe reactions (56.5% vs 1.5%, p < 0.001), anaphylaxis (40.0% vs 4%, p < 0.001), higher number of reactions (1.7% vs 1.3% p < 0.001), higher number of suspected drugs (1.5% vs 1.3% p = 0.006), NSAID (37.6% vs 8.4%, p < 0.001), general anesthetics (12.9 vs 2.8, p = 0.008) and an interval of time of ≤ 2 years between reaction and study (44.0% vs 25.0% p = 0.027).

Table 1 summarizes the socio-demographic and clinical characteristics of the patients and differences between patients with confirmed drug hypersensitivity and those with excluded drug hypersensitivity. There are some missing data mainly concerned to the socio-demographic characteristics.

Table 1 Socio-demographic and clinical characteristics of patients

Validation procedures

Thirty-one patients fully completed the questionnaires applied at the validation (83% were female with a mean age of 39 ± 12 years) (Additional file 2).

Reliability

The questionnaire’s global internal consistency was 0.938, adequate not only for group comparison but also for clinical application.

No significant differences were found between test and retest (p = 0.176) with a mean difference of 2.5 (9.9) and a correlation of 0.722 (p < 0.001). The single measure of ICC was 0.713 (95% CI 0.488–0.850) indicating good test–retest reliability. The Bland–Altman plot indicate no systematic bias (Fig. 1). Only one participant fell outside the expected limits of ± 2SD (− 17.1 to 22.0).

Fig. 1

The Bland–Altman plot: visualization of the questionnaire responses at the two time points (baseline and retest)

Validity

The DrHy-Q Portuguese revealed a one-dimensional structure that explained up to 54.5% of the total variance. Table 2 provides items’ factor loadings. All items had a factor loading above 0.40, therefore, none was excluded.

Table 2 Factor loading of each item in Portuguese version of DrHy-Q

Concerning divergent validity, no significant correlation was found between the DrHy-Q and the PGWBI total scores (r = − 0.010 p = 0.957). Only a fair and negative correlation was observed between DrHy-Q and the dimension general health of the PGWBI (r = − 0.490; p = 0.006), but no correlation with the other 5 dimensions (Table 3).

Table 3 Pearson’s correlation between the DrHy-Q and the PGWBI domains

DrHy-Q results

In the Table 4 are represented the results of the DrHy-Q, namely the total score according to social-demographic and clinical characteristics of patients. Mean DrHy-Q score was 36.8 ± 12.6 (with median 37.0; minimum: 14.0; maximum 68.0). The following factors were found to be significantly associated with higher DrHy-Q total score or impaired quality of life: older age; presence of co-morbidities; daily medication; absence of family history of drug allergy; clinical manifestations such as anaphylaxis, urticaria/angioedema or other manifestations; severe reactions; ≥ 2 drug reactions; ≥ 2 suspected drugs and allergy to ßL-antibiotics.

Table 4 DrHy-Q total scores by socio-demographic and clinical characteristics of patients

Comparing DrHy-Q scores of patients with confirmed drug allergy versus excluded drug allergy we observed significant higher values in the former group (40.5 ± 12.9 vs 33.4 ± 11.2, p < 0.001).

Significant variables in the bivariate analysis were included in the multiple linear regression model. Two clinical factors were identified to significantly predict DrHy-Q total score: clinical manifestations and number of suspected drugs.

Patients with anaphylaxis (β = 11.005; 95% CI 5.523; 16.487), urticaria/angioedema (β = 7.770; 95% CI 2.600; 12.940) and other manifestations (β = 7.948; 95% CI 1.933; 13.962) are more likely to have higher DrHy-Q total score than patients with MPE. Patients with two or more suspected drugs are more likely to have higher DrHy-Q total score (β = 7.927; 95% CI 3.687; 12.166), as shown in Table 5. These results support the discriminant validity of the DrHy-Q.

Table 5 Predictive factors of DrHy-Q total score

Discussion

This study showed that the Portuguese version of DrHy-Q is a reliable and valid instrument for assessing HRQoL in patients with drug hypersensitivity.

The statistical analyses confirmed that Portuguese version of the DrHy-Q met the standards for adequate internal consistency with a Cronbach’s alpha of 0.938 (Italian version 0.928) [6] along with a good test–retest reliability.

Factor analysis revealed a one-dimensional structure in line with the original Italian questionnaire⁵ and other translated versions [4, 8, 11].

As expected, a negative but no significant correlation was found between the DrHy-Q and the PGWBI total scores r = − 0.010 p = 0.957, since the DrHy-Q is a disease-specific questionnaire (higher scores indicating worse HRQoL) and the PGWBI is a generic quality-of-life questionnaire (higher scores indicating better well-being). Only a fair and negative correlation was observed between DrHy-Q and the dimension general health of the PGWBI (r = − 0.490; p = 0.006), but no statistically significant correlation with the other 5 dimensions. These results suggest that the Portuguese DrHy-Q not only measures specific aspects of HRQoL in patients with drug hypersensitivity not assessed with generic tools, but also partially captures general aspects of HRQoL. So, these results, with slight differences with the other studies [4, 6, 8, 10, 11], corroborate an adequate divergent validity. The Italian study [6] reported negative weak correlations and other studies negative fair correlations [4, 8, 11]. A negative significant correlation for the depressed mood dimension of the PGWBI questionnaire and the Spanish DrHy-Q (r = − 0.531; p = 0.016) was reported, but not with other dimensions [10].

The Portuguese DrHy-Q was able to discriminate patients according to some clinical aspects. Patients with anaphylaxis, urticaria/angioedema and other manifestations are more likely to have higher DrHy-Q total score than patients with MPE. Patients with two or more suspected drugs are also more likely to have higher DrHy-Q total score. These results are in accordance with other studies: Italian DrHy-Q also found worst HRQoL (higher scores) in patients with anaphylaxis than in patients with other milder reactions [6, 31] and the Dutch DrHy-Q was able to distinguish between patients with one and patients with more than one implicated drug [4]. The Turkish DrHy-Q could discriminate patients with ≥ 2 drug hypersensitivity reactions and patients with only one reaction, and also patients with drug-induced respiratory reactions and those without respiratory reactions [8]. The Thai DrHy-Q was able to distinguish patients with or without life-threatening severe adverse cutaneous reactions (SACRs), patients with reaction to either NSAID or ßL antibiotics, or both, and patients with one or multiple implicated drug classes [11]. Our study also showed an impaired HRQoL in patients with ≥ 2 drug hypersensitivity reactions and patients with allergy to ßL antibiotics, but this variable lost significance in multivariate model. As only 4 patients referred isolated respiratory symptoms they were included in the group of other manifestations. Patients with SCARs were not included since the severity of the reaction contraindicate the usual “in-vivo” allergy diagnostic procedures.

One of the strengths of the current study was the assessment of the potential role of socio-demographic and clinical data in the overall results DrHy-Q. We could observed how some clinical aspects of the DHR could influence the DrHy-Q scores.

Another interesting aspect of this study was the correlation between DrHy-Q scores and the final result of diagnostic work-up. Comparing DrHy-Q scores of patients with confirmed drug hypersensitivity versus excluded drug hypersensitivity we observed significant higher values in the former group. We must point out that the participants filled the questionnaire before any intervention, so they did not know any result of diagnostic work-up. These results were probably explained by the fact that some clinical variables associated with a higher likelihood of confirmed drug hypersensitivity were also associated with higher DrHy-Q scores.

The present study only included patients studied in the day hospital for suspected drug hypersensitivity and this is one limitation, as left out patients with severe adverse cutaneous reactions (SCARs), for instances. However, these are very rare drug hypersensitivity clinical presentations, particularly in our population.

Additionally, the majority of the patients included in this study had antibiotic and/or NSAID hypersensitivity, reflecting the global prevalence of the class of drugs involved in drug hypersensitivity, but limiting the possibility of assessing the impact of hypersensitivity to other class of drugs in patients’ HRQoL.

Finally, our study design did not allow us to explore the sensitivity of DrHy-Q to changes after interventions (e.g. causal diagnosis or desensitization). In future, we intend to assess the responsiveness of the DrHy-Q to interventions trough a larger and multicenter study.

Conclusions

The Portuguese version of DrHy-Q revealed adequate validity and reliability, indicating that it is appropriate to assess the impact of drug hypersensitivity on patients’ HRQoL, providing data for a better comprehension and management of our patients.

Moreover, our results highlight that the severity of the drug hypersensitivity reaction and the number of suspected drugs have impact on patient’s DrHy-QoL.

Appendix: Questionário

As reações alérgicas a medicamentos podem influenciar o bem-estar físico e psíquico da pessoa. Solicitamos que indique as dificuldades que tem devido a este problema

		Nenhumas	Poucas	Bastantes	Muitas	Muitíssimas
1	Como não posso tomar qualquer medicamento, qualquer doença me limita mais do que às outras pessoas	1	2	3	4	5
2	Tenho receio de que, durante uma situação urgente, me administrem um medicamento ao qual sou alérgico	1	2	3	4	5
3	Sinto-me assustado, devido ao meu problema de alergia a medicamentos	1	2	3	4	5
4	O problema de alergia a medicamentos afeta a minha vida	1	2	3	4	5
5	Gostaria de ter a opinião de um Imunoalergologista, antes de tomar um medicamento prescrito por outros especialistas	1	2	3	4	5
6	Mesmo um pequeno desconforto é um problema para mim	1	2	3	4	5
7	O fato de não poder tomar tranquilamente qualquer medicamento faz-me sentir diferente dos outros	1	2	3	4	5
8	Sinto-me ansioso, devido ao meu problema de alergia a medicamentos	1	2	3	4	5
9	Gostaria de ter a certeza de que, para cada doença, há um medicamento seguro para mim	1	2	3	4	5
10	Tenho receio de não conseguir lidar com a dor	1	2	3	4	5
11	Sinto-me angustiado, devido ao meu problema de alergia a medicamentos	1	2	3	4	5
12	Fico preocupado sempre que tomo um medicamento mesmo que seja diferente daqueles que me causaram reação alérgica	1	2	3	4	5
13	Desisti de atividades de lazer (desporto, férias, viagens) devido ao meu problema	1	2	3	4	5
14	Sinto-me com a moral em baixo, devido ao meu problema de alergia a medicamentos	1	2	3	4	5
15	A ideia de tomar um medicamento deixa-me ansioso	1	2	3	4	5