Skip to main content

Responsiveness and interpretability of commonly used outcome assessments of mobility capacity in older hospital patients with cognitive spectrum disorders

Abstract

Background

In older hospital patients with cognitive spectrum disorders (CSD), mobility should be monitored frequently with standardised and psychometrically sound measurement instruments. This study aimed to examine the responsiveness, minimal important change (MIC), floor effects and ceiling effects of commonly used outcome assessments of mobility capacity in older patients with dementia, delirium or other cognitive impairment.

Methods

In a cross-sectional study that included acute older hospital patients with CSD (study period: 02/2015–12/2015), the following mobility assessments were applied: de Morton Mobility Index (DEMMI), Hierarchical Assessment of Balance and Mobility (HABAM), Performance Oriented Mobility Assessment, Short Physical Performance Battery, 4-m gait speed test, 5-times chair rise test, 2-min walk test, Timed Up and Go test, Barthel Index mobility subscale, and Functional Ambulation Categories. These assessments were administered shorty after hospital admission (baseline) and repeated prior to discharge (follow-up). Global rating of mobility change scales and a clinical anchor of functional ambulation were used as external criteria to determine the area under the curve (AUC). Construct- and anchor-based approaches determined responsiveness. MIC values for each instrument were established from different anchor- and distribution-based approaches.

Results

Of the 63 participants (age range: 69–94 years) completing follow-up assessments with mild (Mini Mental State Examination: 19–24 points; 67%) and moderate (10–18 points; 33%) cognitive impairment, 25% were diagnosed with dementia alone, 13% with delirium alone, 11% with delirium superimposed on dementia and 51% with another cognitive impairment. The follow-up assessment was performed 10.8 ± 2.5 (range: 7–17) days on average after the baseline assessment. The DEMMI was the most responsive mobility assessment (all AUC > 0.7). For the other instruments, the data provided conflicting evidence of responsiveness, or evidence of no responsiveness. MIC values for each instrument varied depending on the method used for calculation. The DEMMI and HABAM were the only instruments without floor or ceiling effects.

Conclusions

Most outcome assessments of mobility capacity seem insufficiently responsive to change in older hospital patients with CSD. The significant floor effects of most instruments further limit the monitoring of mobility alterations over time in this population. The DEMMI was the only instrument that was able to distinguish clinically important changes from measurement error.

Trial registration

German Clinical Trials Register (DRKS00005591). Registered February 2, 2015.

Background

Cognitive spectrum disorders (CSD) is a term that encompasses diagnosed dementia, delirium, delirium superimposed on known dementia and other unspecified cognitive impairments [1]. Patients with CSD constitute a significant proportion of older hospital patients, and the number of people with dementia is expected to rise significantly within the next decades [2]. Today, the in-hospital prevalence of dementia is estimated to be between 13 and 63% [3], and as many as 50% of people older than 65 years of age who are admitted to hospitals present with delirium [4]. Reynish et al. [1] reported a 39% prevalence of CSD in older adults admitted to an emergency department.

Mobility is defined as ‘moving by changing body position or location or by transferring from one place to another, by carrying, moving or manipulating objects, by walking, running or climbing, and by using various forms of transportation’ [5]. Mobility capacity is a relevant indicator of the health status and the quality of life of older people [6]. In older hospital patients, however, mobility impairments are common and associated with a risk of additional loss of function [7]. Approximately 30–60% of older medical patients are not able to stand or walk without physical assistance at hospital admission [8,9,10]. Mobility decline is also considered an undesirable disease presentation that may facilitate risk stratification in older people admitted to hospitals [11].

The goal of mobility assessment is to guide interventions supporting mobility and, thus, to improve care [12]. Mobility should be assessed frequently and with standardised and psychometrically sound measurement instruments [11, 12], in terms of reliability, validity and responsiveness to change [13, 14]. To assign qualitative meaning to a measurement instrument’s quantitative scores or change in scores, aspects of interpretability such as minimal important change (MIC) values or floor and ceiling effects in a specific population are of special interest [14].

Reviews and recommendation statements have outlined many multi-component mobility capacity measures that are considered suitable for older hospital patients [12, 15,16,17], including the Hierarchical Assessment of Balance and Mobility (HABAM) [18], the Short Physical Performance Battery (SPPB) [19], Tinetti’s Performance Oriented Mobility Assessment (POMA) [20] and the de Morton Mobility Index (DEMMI) [21]. In clinical practice, (shorter) single-component measures of mobility are also used frequently [22, 23], such as timed short- and long-distance gait measures, timed chair rise tests and the Timed Up and Go test (TUG) [24]. However, there is no ‘gold standard’ or widely accepted consensus on a specific measurement instrument of mobility capacity for acute older medical patients in inpatient settings [12].

In clinical care and research, mobility measures are often used to monitor a patient’s individual progress or disease progression and to evaluate the effect of interventions, such as exercises [25]. For these objectives, a measurement instrument must be sufficiently responsive. Responsiveness to change, which is defined as ‘the ability of an outcome measure to detect change over time in the construct to be measured’ [14], is the measurement property that has been examined the least in older (hospitalized) individuals [15, 17], and especially in those with cognitive impairment [26,27,28]. Because of a lack of psychometric studies, McGough et al. [26] calculated effect sizes, as an indicator of responsiveness, from data reported in clinical trials on exercise interventions in older people with dementia. The authors [26] found that the 6-min walk test, the TUG, repeated chair stand tests and short-distance gait speed tests were the most frequently used outcome measures of mobility capacity. These measurement instruments demonstrated a small, medium or large effect in at least 50% of exercise intervention studies [26]. However, these results provide only limited evidence of responsiveness, since the assessment of responsiveness on the basis of effect size is considered invalid [13, 29, 30]. Effect size indices were developed as standardised measures of the magnitude of the effect of an intervention or another event that happened over time; therefore, expressing the magnitude of change relative to the standard deviation (SD) [13]. Thus, ‘a high magnitude of change gives little indication of the ability of the instrument to detect change over time on the construct to be measured’ [13]. In the absence of high-quality psychometric studies and systematic reviews, the responsiveness of commonly used measurement instruments of mobility capacity in older hospital patients with CSD is largely unknown.

For planning and evaluating healthcare interventions, valid information on the interpretability of a patient’s mobility test scores is crucial. The MIC, which is defined as ‘the smallest change in score in the construct to be measured which patients perceive as important’ [13, 14], is a key parameter of interpretability in clinical care. Knowledge of the MIC of a measurement instrument helps to interpret the relevance of measured changes. It also provides a metric for the planning of sample sizes in clinical trials based on the proportion of patients reaching the MIC or higher [31]. The MIC values of measurement instruments of mobility capacity in older hospital patients with CSD are largely unknown [26, 27].

In older hospital patients with CSD, the valid monitoring of mobility alterations is especially challenging; for example, complex test instructions and a high prevalence of functional limitations in this population [26, 32, 33] lead to significant floor effects of single-component measures, such as timed walk tests [8, 11, 34]. Although floor and ceiling effects can significantly affect the clinical value of mobility measures in older hospital patients with CSD, there is very limited evidence on these aspects of interpretability.

We have recently examined the psychometric properties of the DEMMI in older individuals with dementia, delirium, or other cognitive impairments, providing the first evidence that the DEMMI is a feasible, unidimensional and construct-valid measurement instrument of mobility in this population [35]. The DEMMI was also found to be free of floor and ceiling effects [35]. In a sub-analysis of the primary study, we have further analysed the test–retest reliability of the DEMMI and other commonly used mobility measures in older people with CSD [36]. The results indicated sufficient test–retest reliability for group-comparisons in all examined instruments, but limited use for individual monitoring of mobility over time due to the large measurement error in most of the instruments.

Since responsiveness and MIC of the DEMMI have not yet been analysed in older individuals with CSD, the main objective of the present study was to assess these measurement properties. Given the lack of evidence on responsiveness, MIC values, and floor and ceiling effects of mobility measures in older hospital patients with CSD, the secondary objective of the present study was to determine these measurement properties for several other commonly used measures of mobility capacity in this population based on the available data set.

Methods

Design and setting

Some methodical aspects of this study have already been reported elsewhere [35, 36]. The primary study [35] was approved by the Ethical Review Board of the University of Cologne (registration number 2014-05), conducted according to the ethical principles of the Declaration of Helsinki (2013), a priori registered in the German Clinical Trials Register (DRKS00005591) and performed in a geriatric hospital in Cologne, Germany (St. Marien-Hospital) [35, 36]. All participants provided written and ongoing informed consent, according to previously reported procedures. Recommendations of the STrengthening the Reporting of Observational studies in Epidemiology (STROBE) statement for cross-sectional studies were followed. Reporting was further informed by the criteria of the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) risk-of-bias checklist [37].

Participants with CSD included in the primary study (n = 153) [35] were assessed with a comprehensive set of mobility measures immediately after hospital admission (baseline sample). A sub-sample of the baseline participants repeated all baseline mobility measures [23, 35]. The present study reports the responsiveness and MIC values of commonly used measurement instruments of mobility capacity and physical functioning.

Participants

Participant were enrolled from February 4, 2015 to December 11, 2015 [35, 36]. During the study period, we defined 91 screening days, which were spread unsystematically [35]. All acute older inpatients consecutively admitted to the hospital on one of the screening days were screened for eligibility. A sample of 153 patients was included and constituted the baseline sample of the primary study [35, 36].

Patients were eligible if they were admitted to one of the acute geriatric wards of the hospital, ≥ 60 years old, and presented with a cognitive impairment, as indicated by a Mini-Mental State Examination (MMSE) score of ≤ 24 points [38]. The exclusion criteria included: documented contraindications for mobilisation, physician-directed partial weight-bearing of the lower extremity, isolation for infection, impending death, coma or severely impaired vigilance, acute major organ failure, blindness, deafness, severe dysphasia, a German-language barrier, or any acute psychiatric or medical/physical condition whereby mobility measurements could lead to a worsening of the patient’s state of health [35, 36].

For the follow-up assessment, participants were excluded if they (1) were discharged within 6 days after the baseline assessment, (2) refused a second assessment (3) or were in an unstable/critical medical condition.

Procedures

Eligible participants were examined within 7 days after hospital admission (baseline assessment). In a single baseline session, a comprehensive set of commonly used performance-based measurement instruments of mobility capacity was administered in a standardised order, starting with the least physically challenging tests. The procedure has been reported in detail previously [35, 36].

Participants were invited to participate in a follow-up session including the same set of measurement instruments used in the baseline assessment. The measurements were performed by the same rater, in the same order, and under the same conditions as in the baseline assessment.

The follow-up assessment was scheduled as close as possible to the patient’s hospital discharge and took place 7–21 days after the baseline assessment. A minimum of 7 days was chosen, since we expected a significant proportion of patients to experience changes in their mobility capacity over this period and still reassess a maximum number of participants before discharge [13]. Socio-demographic data was taken from the medical records and from hospital administrative data [35, 36].

Measurements

In this study [35, 36], 10 performance-based measures of the mobility capacity of older people were applied in the following order: DEMMI [21, 34], HABAM [39, 40], POMA [20], TUG [24], SPPB [19], 4-m gait speed test (as part of the SPPB), 5-times chair rise test (5xCRT; as part of the SPPB), 2-min walk test [41], Barthel Index mobility subscale [42], and Functional Ambulation Categories (FAC) [43].

We clustered all measurement instruments examined in this study according to the ICF mobility domain components captured by each instrument [36]. Accordingly, instruments are separated into single- and multi-component measures depending on the number of mobility domains included. Table 1 presents a clustered overview, including each instrument’s scale range [36]. The classification is the consensus of the authors, informed by the classifications reported by other authors [17, 44]. Additional file 1 provides a detailed description of the assessment procedures and all measurement instruments.

Table 1 Mobility domain components of each measurement instrument classified according to the ICF

Patient-reported global rating of change amount (P-GRC-A) scale

After the follow-up assessment, a short ICF definition of mobility was provided to the participants. Then, participants were asked if their mobility had improved, deteriorated or remained unchanged since the baseline assessment (hospital admission). If participants reported improvement, they were asked to estimate the amount of mobility change (improvement or deterioration) on a 5-point global rating of change (P-GRC-A) scale ranging from ‘a little bit’, ‘somewhat’, ‘moderately’, ‘much’ to ‘very much’ better (+ 1 to + 5). Participants who reported deterioration were given a corresponding scale (e.g. ‘a little bit’ to ‘very much’ worse; − 1 to − 5).

We used independent scales for participant improvement and deterioration due to their better feasibility with older participants. This approach is indeed consistent with an 11-point global rating of change scale (− 5 to + 5).

Patient-reported global rating of change importance (P-GRC-I) scale

Participants who reported any change in mobility were asked to estimate the importance of mobility change (improvement or deterioration) on a 6-point global rating of change scale (P-GRC-I), ranging from ‘unimportant’, ‘a little’, ‘somewhat’, ‘moderately’, ‘quite’ to ‘very’ important (0 to + 5). For example, a participant who estimated the amount of mobility change to be ‘moderate’ (P-GRC-A = + 3) could rate this change as only ‘a little important’ (P-GRC-I = + 1).

Therapist-reported global rating of change amount (T-GRC-A) scale

To assess a participant’s mobility change from a clinician’s point of view, assuming more objective estimations, the global rating of change scale procedure described above was performed by each participants’ responsible physiotherapist. In more detail, the physiotherapist was asked if he or she had examined or treated the patient on the days of the baseline and follow-up assessments. If this was not the case, the responsible occupational therapist was consulted. If neither the physiotherapist nor the occupational therapist had seen the participant on both days of the two study measures, the global rating of change scale was not assessable.

Therapists were asked if the mobility of the participant had improved, deteriorated or remained unchanged since the baseline assessment. The amount of improvement or deterioration was rated on an 11-point therapist-reported global rating of change (T-GRC-A) scale ranging from − 5 to + 5.

Therapist-reported global rating of change importance (T-GRC-I) scale

The same procedure as that for the P-GRC-I scale was followed by asking the therapist to estimate the importance of mobility change.

Statistical analysis

Data were analysed using SPSS 21.0 (IBM Corp.; Armonk, New York, USA) and Microsoft Excel 2016 (Microsoft Office; Redmond, Washington, USA). The sample characteristics are presented descriptively. Interval-based data were examined for normality with the Shapiro–Wilk test of normality and by visual inspection of the related histograms and P–P-plots. P < 0.05 indicated statistical significance.

Differences in clinical outcomes at baseline between participants included in this study and participants lost to follow-up were assessed using chi-square tests, t-tests, McNemar tests or Mann–Whitney U tests when appropriate.

The change scores (∆) of all mobility-related measurement instruments were calculated by subtracting the baseline scores from the follow-up scores. Participants who deteriorated according to the anchors were excluded from all analyses on responsiveness and MIC due to the small sample size.

Cohen’s effect size was calculated as the difference between two means divided by the pooled SD.

Measurement properties

Responsiveness

The responsiveness of the 10 mobility measures was assessed following a construct- and an anchor-based approach [14]. The sample size approximation of 150 participants for the baseline sample was based on sample size requirements for a Rasch analysis [35, 45]. For the follow-up measures, we tried to include as many participants as possible, but targeted at least 100 participants [46].

Responsiveness: construct approach

Responsiveness was assessed by following the methodological approach of hypotheses testing. Instrument change scores and P-GRC-A and T-GRC-A scores were used to a priori formulate hypotheses [13]. For each instrument listed in Table 1, 11 hypotheses were formulated (H1–H11):

H1–H9: For each instrument, a moderate correlation of ≥ 0.50 between the change scores of this instrument and the change scores of the other nine mobility instruments was expected. The strengths of the correlations were expected to be at least moderate (≥ 0.50), since change scores are accompanied by a high measurement error [13].

H10–H11: For each instrument, a correlation of ≥ 0.30 between the change scores of this instrument and the P-GRA-A and T-GRC-A scores was expected. The strengths of the correlations were expected to be at least weak (≥ 0.30), since global rating of change scales have critical validity and reliability [13, 47] and are known to be subject to recall bias [48]. Furthermore, global rating of change scales are known to be subjected to a high measurement error.

We applied one-tailed Pearson’s r (normally distributed change scores of interval measures) and Spearman’s rho (all other data) analyses, because the directions of the correlations were hypothesized a priori. For instruments in which lower scores represent better functioning (TUG and 5xCRT), a negative correlation was hypothesized. All correlations were reported unidirectionally to improve readability.

We decided against defining an a priori hypotheses percentage threshold (e.g. 75%), which would require confirmation in order for a measurement instrument to be considered valid or responsive [49, 50]. As stated by the COSMIN authors themselves, ‘there is no criterion to decide whether an instrument is valid or responsive. Assessing validity or responsiveness is a continuous process of accumulating evidence’ [30]. That is why we leave it to the reader to decide the percentage of confirmed hypotheses deemed acceptable.

Responsiveness: anchor-based approach

We used multiple independent patient-reported and clinical anchors to examine and confirm responsiveness [51]. A correlation threshold of ≥ 0.30 was set as an acceptable association between an anchor and an instrument’s change score [51].

The area under the receiver operating characteristic curve (AUC) for each external anchor was calculated. The AUC can be interpreted as the probability of correctly identifying an improved patient from randomly selected pairs of improved and unchanged patients [52]. An AUC ≥ 70% was considered satisfactory [13, 50].

Patient-reported anchor: P-GRC-A scale

The P-GRC-A scale was used as an external anchor for the responsiveness analysis. Participants who rated themselves as a ‘little bit better’ (+ 1), ‘not changed’ (0), or ‘a little bit worse’ (− 1) were labelled ‘unchanged’. Participants who indicated that they were at least ‘somewhat better’ (+ 2 or higher) were labelled ‘improved’.

Therapist-reported anchor: T-GRC-A scale

Participants whose amount of mobility change was rated by the therapist to be between − 1 and + 1 on the T-GRC-A scale were deemed ‘unchanged’. Participants with a score of + 2 or higher were deemed ‘improved’.

Clinical anchor: functional ambulation categories

The FAC is a rough scale that allows the level of ambulation to be rated according to six categories [43]. We considered a change from one FAC category to the next as a relevant change in mobility. Thus, the FAC anchor was defined as participants who improved their level of ambulation (FAC∆ ≥ 1 points; ‘improved’) versus patients who did not change according to the FAC (FAC∆ = 0 points; ‘unchanged’).

Minimal important change (MIC)

There is no consensus on the best method to determine MIC. Generally, a combination of anchor- and distribution-based approaches are recommended and used to reveal a range of values for the MIC [51, 53,54,55,56]. Thus, our aim was examining ‘multiple values from different approaches and hopefully converging on a small range of values (or one single value)’ [51]. However, as distribution-based indices provide no direct information on the MIC, these values were only used as supportive information for MIC estimates from anchor-based approaches [51].

MIC: anchor-based approach

The MIC was quantified by constructing receiver operating characteristic (ROC) curves [57]. The ROC curve is the result of using different cut-off points for change scores, each with a given sensitivity (sens) and specificity (spec). The optimal cut-off point (qf) can be used as the MIC value [55, 57, 58]. To estimate MIC thresholds by using cut-off points from ROC curves, different approaches have been proposed. Since no consensus exists, three MIC values (cut-off points) were calculated for each anchor:

  1. (1)

    The method described by Farrar et al. (2001) [59] used the point closest to the intersection of a − 45° tangent line: qf = min{|sens − spec|}.

  2. (2)

    Authors from the COSMIN group [57] have proposed to choose the point closest to the top-left corner of the ROC curve, which is assumed to represent the lowest overall misclassification and which is equal to the Youden index [60]: qf = min{2 − sens − spec}.

  3. (3)

    Froud et al. (2014) [58] proposed to first square the terms used by COSMIN, giving the following formula: qf = min{(1 − sens)2 + (1 − spec)2}.

Sensitivity and specificity were valued equally. A correlation threshold of a ‘nontrivial’ association (≥ 0.30) [51] was set as an acceptable association between an anchor and an instrument’s change score [51]. Since there is no consensus on a correlation threshold [55, 56, 58] (e.g. the COSMIN authors proposed a ‘substantial’ association without proposing a clear cut-off value [57]), and for the sake of completeness, we also reported MIC values if the rho correlation was < 0.3. However, we highlighted MIC values considered to be invalid according to recent beliefs [51].

A change deemed ‘a little better/worse’ (amount) is not explicitly important in any sense. That is why we used global rating of change scales of importance for the MIC analysis. The following external anchors were used to divide the sample into groups of participants who had experienced at least a minimal important change/improvement and participants who experienced an unimportant change/improvement or no change in mobility, according to the anchors.

Patient-reported anchor: P-GRC-I scale

Participants who reported no change at all (P-GRC-A = 0) or a change in their mobility of no importance (P-GRC-I = 0) were labelled as ‘not importantly improved’. Participants who rated any perceived improvement (P-GRC-A ≥ + 1) to be at least ‘a little important’ (P-GRC-I ≥ + 1) were labelled as ‘importantly improved’.

Therapist-reported anchor: T-GRC-I scale

For the T-GRC-I anchor, the same criteria as for the P-GRC-I anchor were used.

Clinical anchor: functional ambulation categories

To calculate the MIC according to the FAC, the same anchor as for the responsiveness analysis was used. Thus, participants with FAC∆ = 0 were considered ‘not importantly improved’, while participants with FAC∆ ≥ 1 were deemed ‘importantly improved’.

MIC: within-patient change score approach

Another anchor-based MIC value was determined as the mean change in the instrument change scores observed in the ‘small important improvement group’, which consisted of participants who rated any improvement as ‘a little’, ‘somewhat’, or ‘moderately’ important (+ 1 to + 3) on the P-GRC-I scale [51]. Another MIC was calculated using the same method with the T-GRC-I scale. These MIC scores were only considered valid if the ‘small important improvement group’ demonstrated mean changes that were larger than in the ‘not importantly improved’ groups [51] and in samples ≥ 10 participants.

MIC: distribution-based methods

Half of a standard deviation

Norman et al. [61] proposed the use of 0.5 SD of a sample’s baseline score as a MIC value. We used the SD of the baseline mean scores of the complete sample due to the larger sample size (n = 153).

Standard error of measurement

The standard error of measurement (SEM) was taken from the inter-day test–retest reliability analysis based on 65 stable participants of the study cohort who were re-assessed within 1 day [36]. The value of one SEM was taken as the MIC [55].

Floor and ceiling effects

For measures with a fixed scale range (DEMMI, HABAM, POMA, SPPB, Barthel Index mobility subscale and FAC), an absolute floor or ceiling effect was considered if > 15% of the participants scored the highest or lowest possible score, respectively [49].

For measures with a ratio unit (4-m gait speed test, 2-min walk test, 5xCRT and TUG), a floor effect was considered if > 15% were not able to perform this measure. An absolute ceiling effect was considered if > 15% of participants reached a score ‘faster/better’ than the normative value for older people (≥ 80 years) ± 1 SD or the upper/lower 95% confidence interval (CI) of the normative value, respectively. We used normative values for women if authors reported sex-stratified values only. The following ceiling effect boarders were used: gait speed = 1.03 m/s (upper 95% CI [62]); 2-min walk test = 142.9 m (upper 95% CI [63]); 5xCRT = 10.7 s (lower 95% CI [64]); TUG = 7.6 s (normative value − 1 SD [65]).

When a patient scores close to one of the extremes, a real change (defined as the minimal detectable change, MDC) could cross that extreme. Patients who score within the MDC-range from one of the extremes can, thus, be regarded as being at either their floor or ceiling as well [66]. Therefore, we additionally calculated floor and ceiling effects related to the MDC-ranges for the extremes. MDC values with 95% confidence of each scale were taken from the reliability analyses based on the same cohort [36]. Admission floor and ceiling effects were calculated based on the baseline sample. Discharge floor and ceiling effects were not calculated due to the small number of participants assessed within 1 week prior to discharge.

Results

A total sample of 63 participants with CSD took part in the follow-up assessment (participant flow: Fig. 1; admission characteristics: Table 2). Study participants included in the follow-up sample (n = 63, 41%) did not differ from participants who did not perform a follow-up measure (n = 90, 59%) with respect to relevant baseline characteristics, such as age, gender or MMSE mean score (see additional results in Additional file 2). However, there were more reports of depression (30% vs 14%) and follow-up participants stayed significantly longer on the acute ward.

Fig. 1
figure1

Flow chart of study participants (MMSE Mini-Mental State Examination)

Table 2 Characteristics of participants at baseline (n = 63)

A diagnosis of dementia alone was documented in 25% of participants. At baseline, delirium alone was present in 13% participants, 11% of participants had delirium superimposed on dementia and 51% of participants presented with cognitive impairment without documented dementia or delirium. At baseline, according to the MMSE assessment, 33% of participants had a moderate cognitive impairment and 67% had a mild cognitive impairment.

The baseline assessment was performed in the very early phase following hospital admission, within 3 days on average and within 6 days at the most for every participant. The follow-up assessment was performed 10.8 ± 2.5 (range: 7–17) days on average after the baseline assessment and within 7 days prior to discharge for 41 (65%) participants.

Participant performance scores in the 10 mobility measures at baseline and follow-up are given in Table 3 together with respective change scores and effect sizes (small-to-moderate effects).

Table 3 Mobility outcome scores of the participants (n = 63)

At baseline, most participants (n = 45, 71%) were not able to walk or needed some kind of assistance for ambulation. This number decreased slightly at follow-up (n = 39, 62%). This resulted in a reduced number of participants available for the responsiveness and MIC analyses at follow-up, as some participants were not able to perform some single-component mobility measures (Table 3; for detailed results, see Additional file 2). The inability to perform these mobility measures was due to insufficient balance, walking, or transfer abilities, or a limited understanding of the test instructions.

The P-GRC-A, P-GRC-I, T-GRC-A, and T-GRC-I scale ratings were available from most patients and therapists, respectively. However, there was substantial disagreement on the amount of change (kappa = 0.47) and the importance of change (kappa = 0.35). Detailed values are presented in the tables in Additional file 2.

Responsiveness

Responsiveness: construct approach

Table 4 provides all correlations between the change scores of each mobility instrument with the change scores of the other instrument scores, and with P-GRC-A and T-GRC-A scale scores. The instruments with the most confirmed hypotheses were the DEMMI (55%) and the FAC (55%), followed by the SPPB (45%), 5xCRT (45%) and the Barthel Index mobility subscale (45%).

Table 4 Responsiveness: correlations between change scores of mobility measures with change scores of other mobility measures and with global rating of change scales (n = 63)

Responsiveness: anchor-based approach

The results of anchor-based responsiveness are given in Table 5. The DEMMI was the only instrument with a sufficiently large AUC for all three anchors. The POMA and the 5xCRT had two AUCs ≥ 70% each. The SPPB, 2-min walk test and Barthel Index mobility subscale each showed a sufficiently large AUC with one out of three anchors. The change scores of the HABAM, 4-m gait speed test, TUG, and FAC did not correlate ≥ 0.3 with any anchor or the AUC was under the critical value of 70%.

Table 5 Responsiveness of the 10 measurement instruments of mobility (n = 63)

Minimal important change (MIC)

For some instruments, the rho correlation between the change scores and the anchor was below the threshold of 0.3 and, therefore, considered invalid (Table 6). Furthermore, there were only four participants in the patient-reported ‘small important improvement group’ (P-GRC-I), so no MIC could be established according to this method.

Table 6 Minimal important change values of the 10 measurement instruments of mobility (n = 63)

MIC results of the 10 mobility measures are given in Table 6. MIC values for instruments with rho < 0.3 are reported in this table for the sake of completeness, but these MIC values are considered invalid according to recent beliefs [51]. These values are not illustrated in Figs. 2, 3, 4, 5 and 6, which illustrate MIC values of those measurement instruments with at least five of 10 possible valid anchor-based MIC values (DEMMI, POMA, SPPB, Barthel Index mobility subscale and 5xCRT).

Fig. 2
figure2

Minimal important change (MIC) values of the de Morton Mobility Index (DEMMI)

Fig. 3
figure3

Minimal important change (MIC) values of the Performance-Oriented Mobility Assessment (POMA)

Fig. 4
figure4

Minimal important change (MIC) values of the Short Physical Performance Battery (SPPB)

Fig. 5
figure5

Minimal important change (MIC) values of the Barthel Index mobility subscale

Fig. 6
figure6

Minimal important change (MIC) values of the 5-times chair rise test (5xCRT)

Floor and ceiling effects

Absolute and MDC-related floor and ceiling effects at baseline (admission) for all mobility measures are given in the table in Additional file 2 and illustrated in Fig. 7.

Fig. 7
figure7

Floor and ceiling effects of mobility measurements at baseline (n = 153). Vertical red dotted lines represent the cut-off value of > 15% for floor and ceiling effects, as proposed by Terwee et al. 2007 [49]

Discussion

This is the first study on the responsiveness and interpretability of commonly used measures of mobility in older hospital patients with CSD. The study provides evidence of limited responsiveness for all instruments based on a construct approach. Based on an anchor-based approach, the DEMMI was the only instrument with evidence of sufficient responsiveness and for all other instruments, our analyses provide evidence of limited or insufficient responsiveness. Large floor effects were observed in most instruments. The DEMMI and the HABAM were the only instruments without MDC-related floor and ceiling effects.

Responsiveness

The DEMMI was the only instrument with an AUC ≥ 0.7 for all three anchors, indicating sufficient responsiveness according to this approach. For five instruments (POMA, 5xCRT, SPPB, 2-min walk test and the Barthel Index mobility subscale) there is conflicting evidence, since these instruments had sufficiently large AUCs in one or two out of three anchors. For the HABAM, 4-m gait speed test, TUG and FAC, there is evidence of no responsiveness, since no AUC was ≥ 0.7, or the change scores did not correlate ≥ 0.3 with any anchor.

According to a construct approach, only two instruments (DEMMI and FAC) had > 50% of confirmed hypotheses (both 55%). No instrument had 75% or more hypotheses confirmed. This threshold has been proposed by the COSMIN group to indicate sufficient responsiveness of a measurement instrument [49, 50]. We recommend interpreting these results with caution, because including the non-responsive instruments (based on the anchor-based approach) as reference instruments in the analyses of responsiveness based on a construct approach might have significantly influenced these analyses.

The comparison of responsiveness approximations found in the present study with existing evidence is limited due to the small number of responsiveness studies performed with older adults with dementia or other cognitive impairments. None of the three psychometric reviews in this field [26, 27, 67] provide any evidence of responsiveness according to an adequate methodology (only effect sizes reported) [49, 50]. Van Iersel et al. [68] assessed the responsiveness of the TUG, the POMA and a short-distance gait speed measure in 85 frail older hospital patients, of whom 45% had dementia. The authors used effect size indices and ROC analyses to assess responsiveness, but did not report AUC values. They concluded that these measures were unsuitable as independent screening instruments for clinically relevant changes in mobility capacity due to the participants’ high intra-individual variability [68]. We are not aware of any other published studies on the responsiveness of mobility measures in older adults with CSD.

According to a recent systematic review on instruments used to evaluate the mobility capacity of older adults during hospitalization [17] and our own literature searches, the responsiveness of the DEMMI has been established with distribution-based methods only and judged as good to excellent [21, 34, 69]. For the HABAM, responsiveness has not been established so far. In the review [17], responsiveness was judged as excellent for the SPPB [70, 71], good for the TUG [72], fair for the POMA [33], poor to good for the 6-min walk test [73, 74], and fair for gait speed tests [75]. However, most of these studies were performed in non-hospital settings and/or only used methods to assess responsiveness on the basis of effect sizes or other inadequate methods [33, 70, 71, 74, 75]. Thus, results must be interpreted with caution. The comparability of our findings is limited to older hospital patients with CSD.

Minimal important change

We used anchor-based methods to establish MIC values, with distribution-based MICs as supporting information [51]. We aimed to examine multiple values from different approaches in order to converge on one single value or a small range of values [51].

Anchor-based MIC values for the DEMMI (Fig. 2) range from 3.5 to 13.5, with 9/10 (90%) MIC values ≤ 8.5 points. Thus, we consider a MIC of 9 DEMMI points a robust value, which is 9% of the total DEMMI scale range and close to the MIC of 10 points reported in the DEMMI development study based on a sample of acute older medical patients [21].

We also tried to derive MIC values for the other 9 instruments. A description, based on our study findings, is reported in the Additional file 3. If possible, we also compare our findings to MIC estimations reported in other studies on geriatric patients, taking into account that MIC values are population- and context-specific [58]. The proposed MIC values for each instrument are listed in Table 7.

Table 7 Relation between measurement error and minimal important change values of each instrument

Relating measurement error to the MIC

A measurement instrument should be able to distinguish clinically important change from measurement error. In Table 7, the MIC values from this trial are related to the MDC values with 90% confidence established in the same cohort [36]. According to the COSMIN criteria [50], the DEMMI is the only instrument for which the measurement property ‘measurement error’ can be judged as good, since the measurement error is smaller than the MIC.

Floor and ceiling effects

The clinical value and interpretability of the POMA, SPPB, FAC, 4-m gait speed test, 5xCRT, 2-min walk test and TUG seems considerably limited due to the large MDC-related floor effects, which are evident in 36% (FAC) to 82% (5xCRT) of patients with CSD upon hospital admission. Comparable estimations have been reported for measures of gait and balance that require the patient to stand or walk [8, 11, 32, 34, 35, 76, 77].

Our study underlines that ceiling effects of mobility measures are very unlikely in acute older medical patients with CSD upon hospital admission due to high levels of multimorbidity, frailty and functional impairment.

Strengths and limitations

This study provides a comprehensive assessment of responsiveness and aspects of interpretability of a broad set of commonly used single- and multi-component performance-based mobility measures in geriatric care. Results allow a head-to-head comparison of these instruments. The selection of instruments was based on psychometric evidence, clinical feasibility, prevalence in the scientific literature and our own awareness [15, 17, 26, 27, 67, 78,79,80]. Our study includes the most frequently applied instruments in individuals with dementia, such as the TUG, SPPB and 4-m gait speed test [26, 27].

The consecutive baseline sample of 153 participants seems sufficiently large for sound analyses of floor and ceiling effects. The size of the follow-up sample (n = 63) can be judged as good according to the COSMIN criteria [14, 46], and baseline characteristics of those participants who did complete a follow-up assessment did not differ from those who did not.

Sampling bias may exist in the data, since the selection of study participants with CSD was based on routine MMSE data [35, 36]. It is possible that we might have missed some potentially eligible patients, because we initially excluded 122 (21%) patients without MMSE assessment. This was caused by organisational constraints, refusal, and vigilance issues, among others. It is not unusual that individuals with CSD refuse cognitive assessment [81, 82]. Thus, we assume that within the group of excluded individuals, there is a significant number of people with (severe) dementia and/or delirium. Further misclassification may be based on participants with intact cognition and depression who scored low on the MMSE [83]. A more detailed, instant and frequent psychiatric review of study participants would have helped to better select and describe the study sample. Further studies should include a more representative sample of patients with a more heterogeneous level of cognitive impairment.

Results of responsiveness are strongly influenced by the validity of the applied methods. A major strength of this study is that we used recommended construct- and anchor-based approaches to establish responsiveness, which are considered more appropriate than responsiveness estimations based on effect size indices [13, 14]. However, the validity of the anchors may be limited. Although global rating of change scales have high face validity [13], the reliability and validity of such retrospective measures of change has been questioned [84, 85]. The trustworthiness of the patient-reported anchor might especially be limited in patients with CSD, of whom many suffer from memory complaints. We also observed that some patients had difficulty in distinguishing between the concepts of amount and importance of change. Although we provided and accurately explained a broad definition of the concept of mobility, we had the impression that some participants only expressed their impression of change in walking and ambulation. The therapist-reported global rating of change scales may be biased by inaccurate recall of the participants’ baseline mobility capacity in a busy hospital with a large number of different patients. These considerations are underpinned by the low agreement between the patient- and therapist-reported global rating of change scores of ƙ = 0.47 and ƙ = 0.35 for the global rating of mobility change scales of amount and importance, respectively.

Implications

The present results are in agreement with our previous findings, indicating that the DEMMI has sufficient measurement properties in terms of feasibility, validity, reliability and responsiveness in older hospital patients with cognitive impairment [35, 36].

Furthermore, the DEMMI was the only instrument that was able to distinguish clinically important change from measurement error in this population. This result has high clinical importance. A healthcare professional who monitors alterations in the mobility capacity of an older patient with CSD must be confident that an observed (meaningful) change in mobility is a true change and not based on measurement error.

Clinicians and researchers can use the MIC values established in this study to plan and evaluate healthcare interventions, for shared decision-making processes, goal setting with patients and relatives, and the planning of sample sizes in clinical trials. However, these MIC values need to be further proven by high-quality, large-scale studies.

For mobility measures that cannot be performed by patients due to functional or cognitive impairments, longitudinal monitoring of mobility is very difficult or impossible. With instruments such as short- and long-distance walk tests, the TUG and chair rise tests, no change scores can be obtained if baseline values or hospital admission test scores are missing. Thus, it is impossible to identify patients who deteriorate or worsen in a mobility capacity by means of these instruments or by any other instrument with large floor effects, such as the POMA, SPPB and FAC. This is of high clinical importance, since mobility measures can be used to identify older patients at high-risk of adverse outcomes. Hubbard et al. [11] reported a relative risk of death for older hospital patients who deteriorated during the first 48 h of admission of 17.1 (95% CI 4.9–60.3) compared to patients whose mobility capacity stabilized or improved. Mobility measures with floor effects seem unsuitable to identify these high-risk patients.

More studies assessing the responsiveness and interpretability of mobility measures in older hospital patients with and without CSD are urgently needed. Furthermore, consensus-based agreement on appropriate methods to determine MIC values is necessary to support authors of psychometric studies in establishing evidence-based MIC values of health-related outcome measures in older people.

Conclusions

In conclusion, this study provides more evidence for the DEMMI to be a psychometrically sound measurement instrument of mobility in older hospital patients with CSD. The DEMMI has some crucial advantages in comparison to other commonly used instruments, especially concerning its sufficient responsiveness and scale widths. The DEMMI was the only instrument that was able to distinguish clinically important changes from measurement error and has the potential to become the standard measurement instrument of mobility capacity in older hospital patients with CSD.

Availability of data and materials

The datasets used and analysed in the current study are available from the corresponding author upon reasonable request.

Abbreviations

5xCRT:

5-Times chair rise test

AUC:

Area under the receiver operating characteristic curve

CI:

Confidence interval

COSMIN:

COnsensus-based Standards for the selection of health Measurement Instruments

CSD:

Cognitive spectrum disorders

DEMMI:

De Morton Mobility Index

FAC:

Functional Ambulation Categories

HABAM:

Hierarchical Assessment of Balance and Mobility

MDC:

Minimal detectable change

MIC:

Minimal important change

MMSE:

Mini-Mental State Examination

P-GRC-A:

Patient-reported global rating of change amount scale

P-GRC-I:

Patient-reported global rating of change importance scale

POMA:

Performance Oriented Mobility Assessment

SEM:

Standard error of measurement

SD:

Standard deviation

SPPB:

Short Physical Performance Battery

T-GRC-A:

Therapist-reported global rating of change amount scale

T-GRC-I:

Therapist-reported global rating of change importance scale

TUG:

Timed Up and Go test

References

  1. 1.

    Reynish EL, Hapca SM, de Souza N, Cvoro V, Donnan PT, Guthrie B. Epidemiology and outcomes of people with dementia, delirium, and unspecified cognitive impairment in the general hospital: prospective cohort study of 10,014 admissions. BMC Med. 2017;15:140. https://0-doi-org.brum.beds.ac.uk/10.1186/s12916-017-0899-0.

    Article  PubMed  PubMed Central  Google Scholar 

  2. 2.

    Prince M, Bryce R, Albanese E, Wimo A, Ribeiro W, Ferri CP. The global prevalence of dementia: a systematic review and metaanalysis. Alzheimers Dement. 2013;9(63–75):e2. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jalz.2012.11.007.

    Article  Google Scholar 

  3. 3.

    Mukadam N, Sampson EL. A systematic review of the prevalence, associations and outcomes of dementia in older general hospital inpatients. Int Psychogeriatr. 2011;23:344–55. https://0-doi-org.brum.beds.ac.uk/10.1017/S1041610210001717.

    Article  PubMed  Google Scholar 

  4. 4.

    Fong TG, Davis D, Growdon ME, Albuquerque A, Inouye SK. The interface between delirium and dementia in elderly adults. Lancet Neurol. 2015;14:823–32. https://0-doi-org.brum.beds.ac.uk/10.1016/S1474-4422(15)00101-5.

    Article  PubMed  PubMed Central  Google Scholar 

  5. 5.

    World Health Organization. International classification of functioning, disability and health: ICF. Geneva: World Health Organization; 2001.

    Google Scholar 

  6. 6.

    Brown CJ, Flood KL. Mobility limitation in the older patient: a clinical review. JAMA. 2013;310:1168–77. https://0-doi-org.brum.beds.ac.uk/10.1001/jama.2013.276566.

    CAS  Article  PubMed  Google Scholar 

  7. 7.

    Brown CJ, Redden DT, Flood KL, Allman RM. The underrecognized epidemic of low mobility during hospitalization of older adults. J Am Geriatr Soc. 2009;57:1660–5. https://0-doi-org.brum.beds.ac.uk/10.1111/j.1532-5415.2009.02393.x.

    Article  PubMed  Google Scholar 

  8. 8.

    Fisher S, Ottenbacher KJ, Goodwin JS, Graham JE, Ostir GV. Short physical performance battery in hospitalized older adults. Aging Clin Exp Res. 2009;21:445–52.

    Article  Google Scholar 

  9. 9.

    Ostir GV, Im B, Ottenbacher KJ, Fisher SR, Barr E, Hebel JR, Guralnik JM. Gait speed and dismobility in older adults. Arch Phys Med Rehabil. 2015;96:1641–5. https://0-doi-org.brum.beds.ac.uk/10.1016/j.apmr.2015.05.017.

    Article  PubMed  Google Scholar 

  10. 10.

    Stier-Jarmer M, Grill E, Müller M, Strobl R, Quittan M, Stucki G. Validation of the comprehensive ICF Core Set for patients in geriatric post-acute rehabilitation facilities. J Rehabil Med. 2011;43:102–12. https://0-doi-org.brum.beds.ac.uk/10.2340/16501977-0617.

    Article  PubMed  Google Scholar 

  11. 11.

    Hubbard RE, Eeles EMP, Rockwood MRH, Fallah N, Ross E, Mitnitski A, Rockwood K. Assessing balance and mobility to track illness and recovery in older inpatients. J Gen Intern Med. 2011;26:1471–8. https://0-doi-org.brum.beds.ac.uk/10.1007/s11606-011-1821-7.

    Article  PubMed  PubMed Central  Google Scholar 

  12. 12.

    Wald HL, Ramaswamy R, Perskin MH, Roberts L, Bogaisky M, Suen W, Mikhailovich A. The case for mobility assessment in hospitalized older adults: American Geriatrics Society white paper executive summary. J Am Geriatr Soc. 2019;67:11–6. https://0-doi-org.brum.beds.ac.uk/10.1111/jgs.15595.

    Article  PubMed  Google Scholar 

  13. 13.

    de Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurement in medicine: a practical guide. Cambridge: Cambridge University Press; 2011.

    Book  Google Scholar 

  14. 14.

    Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63:737–45. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jclinepi.2010.02.006.

    Article  PubMed  Google Scholar 

  15. 15.

    de Morton NA, Berlowitz DJ, Keating JL. A systematic review of mobility instruments and their measurement properties for older acute medical patients. Health Qual Life Outcomes. 2008;6:44. https://0-doi-org.brum.beds.ac.uk/10.1186/1477-7525-6-44.

    Article  PubMed  PubMed Central  Google Scholar 

  16. 16.

    Jamour M, Becker C, Bachmann S, De B, Gruneberg C, Heckmann J, et al. Recommendation of an assessment protocol to describe geriatric inpatient rehabilitation of lower limb mobility based on ICF. An interdisciplinary consensus process: Bericht eines interdisziplinaren Konsensusprozesses. Z Gerontol Geriatr. 2011;44:429–36. https://0-doi-org.brum.beds.ac.uk/10.1007/s00391-011-0267-1.

    CAS  Article  PubMed  Google Scholar 

  17. 17.

    Soares Menezes KVR, Auger C, de Souza Menezes WR, Guerra RO. Instruments to evaluate mobility capacity of older adults during hospitalization: a systematic review. Arch Gerontol Geriatr. 2017;72:67–79. https://0-doi-org.brum.beds.ac.uk/10.1016/j.archger.2017.05.009.

    Article  PubMed  Google Scholar 

  18. 18.

    MacKnight C, Rockwood K. A hierarchical assessment of balance and mobility. Age Ageing. 1995;24:126–30.

    CAS  Article  Google Scholar 

  19. 19.

    Guralnik JM, Simonsick EM, Ferrucci L, Glynn RJ, Berkman LF, Blazer DG, et al. A short physical performance battery assessing lower extremity function: association with self-reported disability and prediction of mortality and nursing home admission. J Gerontol. 1994;49:85–94.

    Article  Google Scholar 

  20. 20.

    Tinetti ME. Performance-oriented assessment of mobility problems in elderly patients. J Am Geriatr Soc. 1986;34:119–26.

    CAS  Article  Google Scholar 

  21. 21.

    de Morton NA, Davidson M, Keating JL. The de Morton Mobility Index (DEMMI): an essential health index for an ageing world. Health Qual Life Outcomes. 2008;6:63. https://0-doi-org.brum.beds.ac.uk/10.1186/1477-7525-6-63.

    Article  PubMed  PubMed Central  Google Scholar 

  22. 22.

    Salbach NM, Guilcher SJT, Jaglal SB. Physical therapists’ perceptions and use of standardized assessments of walking ability post-stroke. J Rehabil Med. 2011;43:543–9. https://0-doi-org.brum.beds.ac.uk/10.2340/16501977-0820.

    Article  PubMed  Google Scholar 

  23. 23.

    Braun T, Rieckmann A, Weber F, Grüneberg C. Current use of measurement instruments by physiotherapists working in Germany: a cross-sectional online survey. BMC Health Serv Res. 2018;18:810. https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-018-3563-2.

    Article  PubMed  PubMed Central  Google Scholar 

  24. 24.

    Podsiadlo D, Richardson S. The timed “Up & Go”: a test of basic functional mobility for frail elderly persons. J Am Geriatr Soc. 1991;39:142–8.

    CAS  Article  Google Scholar 

  25. 25.

    de Morton NA, Keating JL, Jeffs K. Exercise for acutely hospitalised older medical patients. Cochrane Database Syst Rev. 2007;2007:CD005955. https://0-doi-org.brum.beds.ac.uk/10.1002/14651858.CD005955.pub2.

    Article  Google Scholar 

  26. 26.

    McGough EL, Lin S-Y, Belza B, Becofsky KM, Jones DL, Liu M, et al. A scoping review of physical performance outcome measures used in exercise interventions for older adults with Alzheimer disease and related dementias. J Geriatr Phys Ther. 2017. https://0-doi-org.brum.beds.ac.uk/10.1519/JPT.0000000000000159.

    Article  Google Scholar 

  27. 27.

    Bossers WJR, van der Woude LHV, Boersma F, Scherder EJA, van Heuvelen MJG. Recommended measures for the assessment of cognitive and physical performance in older patients with dementia: a systematic review. Dement Geriatr Cogn Dis Extra. 2012;2:589–609. https://0-doi-org.brum.beds.ac.uk/10.1159/000345038.

    Article  PubMed  PubMed Central  Google Scholar 

  28. 28.

    Trautwein S, Maurus P, Barisch-Fritz B, Hadzic A, Woll A. Recommended motor assessments based on psychometric properties in individuals with dementia: a systematic review. Eur Rev Aging Phys Act. 2019;16:20. https://0-doi-org.brum.beds.ac.uk/10.1186/s11556-019-0228-z.

    Article  PubMed  PubMed Central  Google Scholar 

  29. 29.

    Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PMM. On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003;12:349–62.

    CAS  Article  Google Scholar 

  30. 30.

    Mokkink LB, Terwee CB, Knol DL, de Vet HC. The new COSMIN guidelines confront traditional concepts of responsiveness. Author’s response. BMC Med Res Methodol. 2011. https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2288-11-152.

    Article  Google Scholar 

  31. 31.

    Johnston BC, Ebrahim S, Carrasco-Labra A, Furukawa TA, Patrick DL, Crawford MW, et al. Minimally important difference estimates and methods: a protocol. BMJ Open. 2015;5:e007953. https://0-doi-org.brum.beds.ac.uk/10.1136/bmjopen-2015-007953.

    Article  PubMed  PubMed Central  Google Scholar 

  32. 32.

    Rockwood K, Awalt E, Carver D, MacKnight C. Feasibility and measurement properties of the functional reach and the timed up and go tests in the Canadian study of health and aging. J Gerontol A Biol Sci Med Sci. 2000;55:70–3.

    Article  Google Scholar 

  33. 33.

    Sterke CS, Huisman SL, van Beeck EF, Looman CWN, van der Cammen TJM. Is the Tinetti Performance Oriented Mobility Assessment (POMA) a feasible and valid predictor of short-term fall risk in nursing home residents with dementia? Int Psychogeriatr. 2010;22:254–63. https://0-doi-org.brum.beds.ac.uk/10.1017/S1041610209991347.

    Article  PubMed  Google Scholar 

  34. 34.

    Braun T, Schulz R-J, Hoffmann M, Reinke J, Tofaute L, Urner C, et al. German version of the de Morton Mobility Index. First clinical results from the process of the cross-cultural adaptation. Z Gerontol Geriatr. 2015;48:154–63. https://0-doi-org.brum.beds.ac.uk/10.1007/s00391-014-0648-3.

    CAS  Article  PubMed  Google Scholar 

  35. 35.

    Braun T, Grüneberg C, Thiel C, Schulz R-J. Measuring mobility in older hospital patients with cognitive impairment using the de Morton Mobility Index. BMC Geriatr. 2018;18:100. https://0-doi-org.brum.beds.ac.uk/10.1186/s12877-018-0780-9.

    Article  PubMed  PubMed Central  Google Scholar 

  36. 36.

    Braun T, Thiel C, Schulz R-J, Grüneberg C. Reliability of mobility measures in older medical patients with cognitive impairment. BMC Geriatr. 2019;19:20. https://0-doi-org.brum.beds.ac.uk/10.1186/s12877-019-1036-z.

    Article  PubMed  PubMed Central  Google Scholar 

  37. 37.

    Mokkink LB, de Vet HCW, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, Terwee CB. COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27:1171–9. https://0-doi-org.brum.beds.ac.uk/10.1007/s11136-017-1765-4.

    CAS  Article  PubMed  Google Scholar 

  38. 38.

    Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189–98.

    CAS  Article  Google Scholar 

  39. 39.

    MacKnight C, Rockwood K. Rasch analysis of the hierarchical assessment of balance and mobility (HABAM). J Clin Epidemiol. 2000;53:1242–7.

    CAS  Article  Google Scholar 

  40. 40.

    Braun T, Rieckmann A, Grüneberg C, Marks D, Thiel C. Hierarchical assessment of balance and mobility—German translation and cross-cultural adaptation. Z Gerontol Geriatr. 2016;49:386–97. https://0-doi-org.brum.beds.ac.uk/10.1007/s00391-016-1026-0.

    Article  PubMed  Google Scholar 

  41. 41.

    Pin TW. Psychometric properties of 2-minute walk test: a systematic review. Arch Phys Med Rehabil. 2014;95:1759–75. https://0-doi-org.brum.beds.ac.uk/10.1016/j.apmr.2014.03.034.

    Article  PubMed  Google Scholar 

  42. 42.

    Mahoney FI, Barthel DW. Functional evaluation: the Barthel Index. Md State Med J. 1965;14:61–5.

    CAS  PubMed  Google Scholar 

  43. 43.

    Holden MK, Gill KM, Magliozzi MR, Nathan J, Piehl-Baker L. Clinical gait assessment in the neurologically impaired. Reliability and meaningfulness. Phys Ther. 1984;64:35–40.

    CAS  Article  Google Scholar 

  44. 44.

    Mudge S, Stott NS. Outcome measures to assess walking ability following stroke: a systematic review of the literature. Physiotherapy. 2007;93:189–200. https://0-doi-org.brum.beds.ac.uk/10.1016/j.physio.2006.12.010.

    Article  Google Scholar 

  45. 45.

    Linacre JM. Sample size and item calibration stability. Rasch Meas Trans. 1994;7:328.

    Google Scholar 

  46. 46.

    Terwee CB, Mokkink LB, Knol DL, Ostelo RWJG, Bouter LM, de Vet HCW. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21:651–7. https://0-doi-org.brum.beds.ac.uk/10.1007/s11136-011-9960-1.

    Article  PubMed  Google Scholar 

  47. 47.

    Guyatt GH, Osoba D, Wu AW, Wyrwich KW, Norman GR. Methods to explain the clinical significance of health status measures. Mayo Clin Proc. 2002;77:371–83. https://0-doi-org.brum.beds.ac.uk/10.1016/S0025-6196(11)61793-X.

    Article  PubMed  Google Scholar 

  48. 48.

    Schwarz N, Sudman S. Autobiographical memory and the validity of retrospective reports. Berlin: Springer; 2012.

    Google Scholar 

  49. 49.

    Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jclinepi.2006.03.012.

    Article  PubMed  Google Scholar 

  50. 50.

    Prinsen CAC, Mokkink LB, Bouter LM, Alonso J, Patrick DL, de Vet HCW, Terwee CB. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27:1147–57. https://0-doi-org.brum.beds.ac.uk/10.1007/s11136-018-1798-3.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  51. 51.

    Revicki D, Hays RD, Cella D, Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J Clin Epidemiol. 2008;61:102–9. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jclinepi.2007.03.012.

    Article  PubMed  Google Scholar 

  52. 52.

    Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36. https://0-doi-org.brum.beds.ac.uk/10.1148/radiology.143.1.7063747.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  53. 53.

    Copay AG, Subach BR, Glassman SD, Polly DW Jr, Schuler TC. Understanding the minimum clinically important difference: a review of concepts and methods. Spine J. 2007;7:541–6. https://0-doi-org.brum.beds.ac.uk/10.1016/j.spinee.2007.01.008.

    Article  PubMed  Google Scholar 

  54. 54.

    Crosby RD, Kolotkin RL, Williams GR. Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol. 2003;56:395–407.

    Article  Google Scholar 

  55. 55.

    King MT. A point of minimal important difference (MID): a critique of terminology and methods. Expert Rev Pharmacoecon Outcomes Res. 2011;11:171–84. https://0-doi-org.brum.beds.ac.uk/10.1586/erp.11.9.

    Article  PubMed  Google Scholar 

  56. 56.

    Ousmen A, Touraine C, Deliu N, Cottone F, Bonnetain F, Efficace F, et al. Distribution- and anchor-based methods to determine the minimally important difference on patient-reported outcome questionnaires in oncology: a structured review. Health Qual Life Outcomes. 2018;16:228. https://0-doi-org.brum.beds.ac.uk/10.1186/s12955-018-1055-z.

    Article  PubMed  PubMed Central  Google Scholar 

  57. 57.

    de Vet HC, Ostelo RWJG, Terwee CB, van der Roer N, Knol DL, Beckerman H, et al. Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach. Qual Life Res. 2007;16:131–42. https://0-doi-org.brum.beds.ac.uk/10.1007/s11136-006-9109-9.

    Article  PubMed  Google Scholar 

  58. 58.

    Froud R, Abel G. Using ROC curves to choose minimally important change thresholds when sensitivity and specificity are valued equally: the forgotten lesson of pythagoras. Theoretical considerations and an example application of change in health status. PLoS ONE. 2014;9:e114468. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0114468.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  59. 59.

    Farrar JT, Young JP Jr, LaMoreaux L, Werth JL, Poole RM. Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain. 2001;94:149–58.

    Article  Google Scholar 

  60. 60.

    Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3:32–5.

    CAS  Article  Google Scholar 

  61. 61.

    Norman GR, Sloan JA, Wyrwich KW. The truly remarkable universality of half a standard deviation: confirmation through another look. Expert Rev Pharmacoecon Outcomes Res. 2004;4:581–5. https://0-doi-org.brum.beds.ac.uk/10.1586/14737167.4.5.581.

    Article  PubMed  Google Scholar 

  62. 62.

    Bohannon RW, Williams AA. Normal walking speed: a descriptive meta-analysis. Physiotherapy. 2011;97:182–9. https://0-doi-org.brum.beds.ac.uk/10.1016/j.physio.2010.12.004.

    Article  PubMed  Google Scholar 

  63. 63.

    Bohannon RW, Wang Y-C, Gershon RC. Two-minute walk test performance by adults 18 to 85 years: normative values, reliability, and responsiveness. Arch Phys Med Rehabil. 2015;96:472–7. https://0-doi-org.brum.beds.ac.uk/10.1016/j.apmr.2014.10.006.

    Article  PubMed  Google Scholar 

  64. 64.

    Bohannon RW. Reference values for the five-repetition sit-to-stand test: a descriptive meta-analysis of data from elders. Percept Mot Skills. 2006;103:215–22. https://0-doi-org.brum.beds.ac.uk/10.2466/pms.103.1.215-222.

    Article  PubMed  Google Scholar 

  65. 65.

    Pondal M, del Ser T. Normative data and determinants for the timed “up and go” test in a population-based sample of elderly individuals without gait disturbances. J Geriatr Phys Ther. 2008;31:57–63.

    Article  Google Scholar 

  66. 66.

    van der Linde JA, van Kampen DA, van Beers LW, van Deurzen DF, Terwee CB, Willems WJ. The Oxford Shoulder Instability Score; validation in Dutch and first-time assessment of its smallest detectable change. J Orthop Surg Res. 2015;10:146. https://0-doi-org.brum.beds.ac.uk/10.1186/s13018-015-0286-5.

    Article  PubMed  PubMed Central  Google Scholar 

  67. 67.

    Ross CM. Application and interpretation of functional outcome measures for testing individuals with cognitive impairment. Top Geriatr Rehabil. 2018;34:13–35. https://0-doi-org.brum.beds.ac.uk/10.1097/TGR.0000000000000171.

    Article  Google Scholar 

  68. 68.

    van Iersel MB, Munneke M, Esselink RA, Benraad CE, Olde Rikkert MG. Gait velocity and the Timed-Up-and-Go test were sensitive to changes in mobility in frail elderly patients. J Clin Epidemiol. 2008;61:186–91. https://doi.org/10.1016/j.jclinepi.2007.04.016.

    Article  PubMed  Google Scholar 

  69. 69.

    de Morton NA, Nolan J, O’Brien M, Thomas S, Govier A, Sherwell K, et al. A head-to-head comparison of the de Morton Mobility Index (DEMMI) and Elderly Mobility Scale (EMS) in an older acute medical population. Disabil Rehabil. 2015;37:1881–7. https://0-doi-org.brum.beds.ac.uk/10.3109/09638288.2014.982832.

    Article  PubMed  Google Scholar 

  70. 70.

    Miller DK, Wolinsky FD, Andresen EM, Malmstrom TK, Miller JP. Adverse outcomes and correlates of change in the short physical performance battery over 36 months in the African American health project. J Gerontol A Biol Sci Med Sci. 2008;63:487–94. https://0-doi-org.brum.beds.ac.uk/10.1093/gerona/63.5.487.

    Article  PubMed  PubMed Central  Google Scholar 

  71. 71.

    Corsonello A, Lattanzio F, Pedone C, Garasto S, Laino I, Bustacchini S, et al. Prognostic significance of the short physical performance battery in older patients discharged from acute care hospitals. Rejuvenation Res. 2012;15:41–8. https://0-doi-org.brum.beds.ac.uk/10.1089/rej.2011.1215.

    Article  PubMed  PubMed Central  Google Scholar 

  72. 72.

    Yeung TSM, Wessel J, Stratford PW, MacDermid JC. The timed up and go test for use on an inpatient orthopaedic rehabilitation ward. J Orthop Sports Phys Ther. 2008;38:410–7. https://0-doi-org.brum.beds.ac.uk/10.2519/jospt.2008.2657.

  73. 73.

    Moriello C, Mayo NE, Feldman L, Carli F. Validating the six-minute walk test as a measure of recovery after elective colon resection surgery. Arch Phys Med Rehabil. 2008;89:1083–9. https://0-doi-org.brum.beds.ac.uk/10.1016/j.apmr.2007.11.031.

    Article  PubMed  Google Scholar 

  74. 74.

    Demers C, McKelvie RS, Negassa A, Yusuf S. Reliability, validity, and responsiveness of the six-minute walk test in patients with heart failure. Am Heart J. 2001;142:698–703. https://0-doi-org.brum.beds.ac.uk/10.1067/mhj.2001.118468.

    CAS  Article  PubMed  Google Scholar 

  75. 75.

    Salbach NM, Mayo NE, Higgins J, Ahmed S, Finch LE, Richards CL. Responsiveness and predictability of gait speed and other disability measures in acute stroke. Arch Phys Med Rehabil. 2001;82:1204–12. https://0-doi-org.brum.beds.ac.uk/10.1053/apmr.2001.24907.

    CAS  Article  PubMed  Google Scholar 

  76. 76.

    Dasenbrock L, Berg T, Lurz S, Beimforde E, Diekmann R, Sobotka F, Bauer JM. The De Morton Mobility Index for evaluation of early geriatric rehabilitation. Z Gerontol Geriatr. 2016;49:398–404. https://0-doi-org.brum.beds.ac.uk/10.1007/s00391-016-1061-x.

    CAS  Article  PubMed  Google Scholar 

  77. 77.

    Braun T, Grüneberg C, Coppers A, Tofaute L, Thiel C. Comparison of the de Morton Mobility Index and hierarchical assessment of balance and mobility in older acute medical patients. J Rehabil Med. 2018;50:292–301. https://0-doi-org.brum.beds.ac.uk/10.2340/16501977-2320.

    Article  PubMed  Google Scholar 

  78. 78.

    Davenport SJ, Paynter S, de Morton NA. What instruments have been used to assess the mobility of community-dwelling older adults? Phys Ther Rev. 2008;13:345–54. https://0-doi-org.brum.beds.ac.uk/10.1179/174328808X356429.

    Article  Google Scholar 

  79. 79.

    Pavasini R, Guralnik J, Brown JC, Di Bari M, Cesari M, Landi F, et al. Short physical performance battery and all-cause mortality: systematic review and meta-analysis. BMC Med. 2016;14:215. https://0-doi-org.brum.beds.ac.uk/10.1186/s12916-016-0763-7.

    Article  PubMed  PubMed Central  Google Scholar 

  80. 80.

    Chung J, Demiris G, Thompson HJ. Instruments to assess mobility limitation in community-dwelling older adults: a systematic review. J Aging Phys Act. 2015;23:298–313. https://0-doi-org.brum.beds.ac.uk/10.1123/japa.2013-0181.

    Article  PubMed  Google Scholar 

  81. 81.

    Boustani M, Perkins AJ, Fox C, Unverzagt F, Austrom MG, Fultz B, et al. Who refuses the diagnostic assessment for dementia in primary care? Int J Geriatr Psychiatry. 2006;21:556–63. https://0-doi-org.brum.beds.ac.uk/10.1002/gps.1524.

    Article  PubMed  Google Scholar 

  82. 82.

    Timmons S, Manning E, Barrett A, Brady NM, Browne V, O’Shea E, et al. Dementia in older people admitted to hospital: a regional multi-hospital observational study of prevalence, associations and case recognition. Age Ageing. 2015;44:993–9. https://doi.org/10.1093/ageing/afv131.

    Article  PubMed  PubMed Central  Google Scholar 

  83. 83.

    Downing LJ, Caprio TV, Lyness JM. Geriatric psychiatry review: differential diagnosis and treatment of the 3 D’s—delirium, dementia, and depression. Curr Psychiatry Rep. 2013;15:365. https://0-doi-org.brum.beds.ac.uk/10.1007/s11920-013-0365-4.

    Article  PubMed  Google Scholar 

  84. 84.

    Schmitt JS, Abbott JH. Patient global ratings of change did not adequately reflect change over time: a clinical cohort study. Phys Ther. 2014;94:534–42. https://0-doi-org.brum.beds.ac.uk/10.2522/ptj.20130162.

    Article  PubMed  Google Scholar 

  85. 85.

    Garrison C, Cook C. Clinimetrics corner: the Global Rating of Change Score (GRoC) poorly correlates with functional measures and is not temporally stable. J Man Manip Ther. 2012;20:178–81. https://0-doi-org.brum.beds.ac.uk/10.1179/1066981712Z.00000000022.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors thank all participants for their participation in this study. We further acknowledge the support of the physiotherapy, occupational therapy, nursing, and medical staff at the St. Marien-Hospital in Cologne.

Funding

Open Access funding enabled and organized by Projekt DEAL. This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

Author information

Affiliations

Authors

Contributions

Study concept and design: TB, RJS, CG. Acquisition of data: TB. Analysis of data: TB. Interpretation of data: TB, CT, CG. Drafting the manuscript: TB. Manuscript revision for important intellectual content: CT, RJS, CG. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Tobias Braun.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Ethical Review Board of the University of Cologne, Germany. Ongoing, written informed consent was provided by all participants. Guardian informed consent was approved if necessary.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Detailed description of the assessment procedures and all measurement instruments.

Additional file 2.

Additional results.

Additional file 3.

Detailed description and discussion of MIC values of 9 measurement instruments.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Braun, T., Thiel, C., Schulz, RJ. et al. Responsiveness and interpretability of commonly used outcome assessments of mobility capacity in older hospital patients with cognitive spectrum disorders. Health Qual Life Outcomes 19, 68 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12955-021-01690-3

Download citation

Keywords

  • Older people
  • Mobility limitation
  • Dementia
  • Cognitive impairment
  • Outcome assessment
  • Responsiveness
  • Minimal important change
  • Interpretability