Download as pdf or txt
Download as pdf or txt
You are on page 1of 10

QJM: An International Journal of Medicine, 2024, 117(1), 38–47

https://doi.org/10.1093/qjmed/hcad224
Advance Access Publication Date: 3 October 2023
Original Article

Downloaded from https://academic.oup.com/qjmed/article/117/1/38/7288193 by UERJ - Universidade do Estado do Rio de Janeiro user on 11 March 2024
Psychometric properties and observational data for
COVID-19 Yorkshire Rehabilitation Scale (C19-YRSm) for
post-COVID-19 syndrome
L. Kustura1, D. Bobek2, A. Poljic �anin3,4, S. Pavelin5, M. Buljuba� �
� Soda
sic 6 �
, J. Soda 7
, J. Aksentijevic �2,
K. Duka Glavor8,9, N. Naranc � Knez8, V. Viali10, A. Cukrov11, I. Todoric
�ic � Laidlaw12, N. Ipavec13, D. Vukorepa1,
I. Stipica14, K. Bakrac�15, B. Bo�
skovic�16, A. Mastelic�17, N. Rez � Muz
� ic �17, A. Markotic
�inic �17, Z. -Doga�
s18,19,
20,21 18,�
K. Dolic� �
and M. Rogic Vidakovic �
1
Department of Psychiatry, University Hospital of Split, Split, Croatia
2
Department of Physical and Rehabilitation Medicine with Rheumatology, Dubrava University Hospital, Zagreb, Croatia
3
Department of Physical Medicine and Rehabilitation with Rheumatology, University Hospital of Split, Split, Croatia
4
Department of Health Studies, University of Split, Split, Croatia
5
Department of Neurology, University Hospital of Split, Split, Croatia
6
Department of Pediatrics, University Hospital of Split, Split, Croatia
7
Department of Marine Electrical Engineering and Information Technologies, Signal Processing, Analysis, and Advanced Diagnostics Research and Education
Laboratory (SPAADREL), Faculty of Maritime Studies, University of Split, Split, Croatia
8
Department of Neurology, General Hospital Zadar, Zadar, Croatia
9
Department of Health Studies, University of Zadar, Zadar, Croatia
10
Family Medicine Vanja Viali, Split, Split-Dalmatia County, Croatia
11
Primary/Family Care Office, Slunj Community Health Centre, Slunj, Croatia
12
Department for Forensic Psychiatry, University Psychiatric Hospital Vrapc �e, Zagreb, Croatia
13
Department for Transfusion Medicine, University Hospital of Split, Split, Croatia
14
Department of Family Medicine, University of Split School of Medicine, Split, Croatia
15
Institute of Emergency Medicine, Split-Dalmatia County, Split, Croatia
16
Department of Otorhinolaryngology, Head and Neck surgery, University Hospital of Split, Split, Croatia
17
Department of Medical Chemistry and Biochemistry, University of Split School of Medicine, Split, Croatia
18
Department of Neuroscience, Laboratory for Human and Experimental Neurophysiology (LAHEN), School of Medicine, University of Split, Split, Croatia
19
Sleep Medicine Centre, University Hospital of Split, Split, Croatia
20
Department of Interventional and Diagnostic Radiology, University Hospital of Split, Split, Croatia
21
Department of Radiology, University of Split School of Medicine, Split, Croatia

�Address correspondence to Dr M. Rogic � Vidakovic�, Department of Neuroscience, Head of Laboratory for Human and Experimental Neurophysiology (LAHEN),

University of Split School of Medicine, Split, Croatia, Soltanska 2, 21000 Split, Croatia. email: maja.rogic@mefst.hr

Summary
Background: The recently developed modified COVID-19 (coronavirus of 2019) Yorkshire Rehabilitation Scale (C19-YRSm) captures com­
prehensive biopsychosocial components of WHO’s International Classification of Functioning, Disability, and Health related to the Long
Covid or post-COVID syndrome. The scale response categories on C19-YRSm were done post hoc on data collected from the original ver­
sion of C19-YRS.
Aim: To evaluate the C19-YRSm scale using reliability and validity measures.
Design: Prospective, observational study.
Methods: The study includes 369 patients (clinical group) and 426 subjects of the general population (control group) and captures their
post-COVID-19 symptoms. In addition, the reliability of C19-YRSm was estimated by Cronbach’s alpha coefficients of internal consistency
and inter-item correlations for subscales (‘Symptom severity, Functional disability, and Other symptoms’). Convergent validity was estab­
lished using correlations between C19-YRSm and Fatigue Severity Scale (FSS). The incremental validity of C19-YRSm was measured by in­
troducing a hierarchical regression model using the C19-YRSm ‘Overall health’ subscale and FSS as criterion variables.
Results: C19-YRSm subscales have excellent internal consistencies (Cronbach’s a value 0.81–0.96) and acceptable inter-item correlations
(r value 0.23–0.79). Hereafter, the convergent validity of the C19-YRSm is good due to significant correlations between C19-YRSm subscales
and FSS and C19-YRSm subscales. Finally, the hierarchical regression analysis supported consistent evidence for the incremental validity
of the C19-YRSm subscales.
Conclusion: C19-YRSm is a reliable and valid self-assessment scale for the assessment of post-COVID-19 syndrome.

Received: 14 June 2023. Revised (in revised form): 14 September 2023.


# The Author(s) 2023. Published by Oxford University Press on behalf of the Association of Physicians. All rights reserved.
For permissions, please email: journals.permissions@oup.com
L. Kustura et al. | 39

Introduction Convergent validity was established using correlations between


C19-YRSm and the Fatigue Severity Scale (FSS).28 The incremen­
During the COVID-19 (coronavirus of 2019) pandemic, 765 million
tal validity of C19-YRSm was measured using the C19-YRSm
people worldwide have been infected with severe acute respira­
Overall health subscale and FSS as criterion variables.
tory syndrome coronavirus 2, which caused the death of 7 million
people.1 Many individuals suffering from COVID-19 have
reported persistent symptoms or complications lasting beyond 4– Materials and methods

Downloaded from https://academic.oup.com/qjmed/article/117/1/38/7288193 by UERJ - Universidade do Estado do Rio de Janeiro user on 11 March 2024
12 and >12 weeks, which were termed as ongoing symptomatic
Study participants
COVID-19 or post-COVID-19 syndrome, respectively.2–4 Follow-
This prospective, observational study includes the patients (clini­
up studies of COVID-19 subjects indicated that 50–80% of
cal group) and the general population (control group) experienc­
patients who recovered from COVID-19 reported symptoms, such
as fatigue, headache, dyspnoea, anosmia, and memory difficul­ ing post-COVID-19 symptoms.
An online survey for reaching the control group of subjects
ties.3,5–10 Post-COVID-19 is regarded as a complex and multifac­
torial syndrome involving virus-specific pathophysiological was conducted from 13 February to 22 March 2023, and a total of
response leading to the elevation of interferons and inflamma­ 2762 participant responses were collected.
tory cytokines, lymphocyte activation and dysregulation and The patients in the clinical group were recruited from a
chronic myeloid cell activation.11,12 Patients themselves intro­ community-based post-COVID clinic within the Croatian’s capi­
duced the term ‘long COVID’, describing all the symptoms they tal city area (the City of Zagreb and Zagreb County) (Dubrava
could experience after suffering from COVID-19.13 COVID-19- University Hospital, Zagreb), Split-Dalmatia County (University
related symptomatology has been more pronounced in individu­ Hospital of Split) and Zadar County (General Hospital Zadar). An
als with severe disease. However, it has also been noticeable in online survey for the clinical group was conducted from 17
individuals with mild and moderate disease.5,14,15 Symptoms February to 1 April 2023, and a total of 432 patient responses
may be newly occurred following initial recovery from an acute were collected. The participants were excluded based on the fol­
COVID-19 episode or persist from the initial illness, with symp­ lowing criteria: technical error (i.e. duplicates), pregnant women,
toms fluctuation or relapse over time.4 a person under 18 years of age (minor), a person with psychiatric
It has been proposed that the wide range of post-COVID-19 disease, COVID-19 not confirmed with antigen or PCR tests and a
symptoms should be carefully interpreted as clinical symptom­ person infected with COVID-19 <3 months ago.
atology with the individual profiling of the immune In selecting accessible samples, a reduction sample strategy
system.3,9,16,17 The National Institute for Health and Care was applied to 2762 subjects from the control group. Since the
Excellence (NICE) called for developing and validating instru­ subject’s age is an important predictor of a patient’s overall
ments to assess post-COVID-19. Therefore, in October 2021, the health,29,30 and the variable may influence the significance of the
World Health Organization (WHO) developed a clinical case defi­ results, the control group sample was stratified by age. Subjects
nition of post-COVID-19 conditions by Delphi methodology, in­ were first stratified into two groups, under and over 50, and sub­
cluding 12 domains, available for use in all settings.4,18 So far, jects under 50 were randomly excluded. After applying exclusion
several instruments have been developed for monitoring post- criteria and reduction sample strategy, a total number of 426 par­
COVID-19 symptoms, and their effect on life quality, including ticipants in the control group and 369 participants in the clinical
post-acute (long) COVID-19 quality of life (PAC-19QoL) instru­ group were included in the analysis. Figure 1 depicts the recruit­
ment,19 the Long COVID Symptom and Impact Tools for monitor­
ment diagram and exclusion criteria for both groups, with an ap­
ing the symptoms and impact of Long COVID,20 the Symptom
plication of the reduction sample strategy in the control group.
Burden Questionnaire for Long Covid (SBQ-LC),21 and the most
recently validated test called modified COVID-19 Yorkshire Study protocol and instrumentation
Rehabilitation Scale (C19-YRSm)22 for Long Covid or post-COVID- Both groups completed the online survey comprising two ques­
19 syndrome. tionnaires, the modified COVID-19 Yorkshire Rehabilitation Scale
The C19-YRSm scale has been developed as the first patient-
(C19-YRSm)22 assessing the post-COVID symptoms and FSS31
reported outcome measure for post-COVID-19 syndrome, captur­
capturing fatigue severity. The data were separately collected
ing all aspects of the 2001 WHO International Classification of
and accessible only to the researchers. The participants evalu­
Functioning, Disability, and Health framework (ICF).4,18,22,23
ated their symptomatology on both scales in the last 7 days. If
Therefore, a condition-specific patient-reported C19-YRSm cap­
participants had COVID-19 more than once, the questions about
tures the common symptoms, functional disability and overall
symptoms referred to their last COVID-19. Additionally, demo­
health of patients with post-COVID-19. The C19-YRSm is recom­
graphic, disease-related, and COVID-19-related variables were
mended by NICE and National Health Service (NHS) England
collected. Demographic information included the following vari­
service guidance for post-COVID-19.22,24,25 However, the scale
ables: age, sex, height, weight, body mass index (BMI), educa­
C19-YRSm response categories were done post hoc on data
collected from the original version of C19-YRS,26,27 omitting the tional level, working status, comorbidity and medication history.
psychometric properties of prospectively collected data on the The COVID-19-related questions included: the number of times a
new scale C19-YRSm.22 person had COVID-19 asymptomatic or symptomatic (once,
Therefore, this prospective cross-sectional study aimed to test twice, three times and more than three times); the last time the
the psychometric properties of C19-YRSm using reliability statis­ person got COVID-19 asymptomatic or symptomatic (<1 month
tics, convergent, concurrent and incremental validity measures ago; 1–3 months ago; 3–6 months ago; 6–12 months ago; 12–
in a sample of patients (clinical group) and subjects of the gen­ 24 months ago; and >24 months ago); the severity of the COVID-
eral population (control group). The reliability of C19-YRSm was 19 (asymptomatic, symptomatic, severe clinical picture—
estimated by Cronbach’s alpha coefficients of internal consis­ ‘temperature above 39 degrees Celsius, breathing difficulties,
tency and inter-item correlations for C19-YRSm subscales hospital admission’); and confirmation of COVID-19 disease by a
(Symptom severity, Functional disability and Other symptoms). positive antigen or PCR test.
40 | QJM: An International Journal of Medicine, 2024, Vol. 117, No. 1

Downloaded from https://academic.oup.com/qjmed/article/117/1/38/7288193 by UERJ - Universidade do Estado do Rio de Janeiro user on 11 March 2024

Figure 1. Recruitment diagram, exclusion criteria and stratification strategy for clinical and control group. Clinical group (upper view), and control
group (lower view).

The modified COVID-19 Yorkshire Rehabilitation Scale community patients revealed three clinical severity phenotypes
(C19-YRSm) (mild, moderate and severe) for individual symptoms and func­
The original COVID-19 Yorkshire Rehabilitation Scale (C19- tional disability.32 Since dysfunctional scale response categories
YRS)26 was developed as a 22-item patient-reported outcome were observed by preliminary Rasch analysis of the original
measure that grades the severity of symptoms, functional dis­ version of C19-YRS, the scale was modified. This new modified
ability, overall health and additional symptoms on an 11-point version, C19-YRSm, differed from the original by changing the
numerical rating scales. The psychometric properties were deter­ 11-point Likert scale with a 4-point scale (0–3).22 The C19-YRSm
mined in a sample of 187 patients with post-COVID, showing consists of 17 items divided into four subscales concerned with
good reliability overall (Cronbach’s alpha 0.891) and for individ­ the ‘severity of symptoms, functional limitation, other symp­
ual subscales.27 Preliminary testing of the C19-YRS in 370 toms’ and ‘overall health’. The symptom severity subscale
L. Kustura et al. | 41

consists of 10 items (Questions 1–10) (Score 0–30). The functional scale has been validated in patients recovering from COVID-19.37
disability subscale consists of five items (Questions 11–15) (Score Concurrent validity of C19-YRSm subscales was assessed by
0–15). The other symptoms subscale represents Question 16 comparing the control and clinical groups. The incremental va­
(Score 0–25), and the fourth subscale, termed the overall health, lidity of C19-YRSm subscales was assessed by the hierarchical re­
represents Question 17 (Score 0–10). Zero scores represent symp­ gression model using the subscale ‘Overall health’ and FSS as
toms not present, Score 1 represents a mild problem (not affect­ criterion variables. Age, sex, BMI and chronic disease were in­
ing daily life), Score 2 moderate problem (affecting daily life to a cluded in the first step, while the scores on C19-YRSm subscales

Downloaded from https://academic.oup.com/qjmed/article/117/1/38/7288193 by UERJ - Universidade do Estado do Rio de Janeiro user on 11 March 2024
certain extent) and Score 3 represents a severe problem (life-dis­ were added in the second step.
turbing problem or affecting all aspects of daily life). The patients
can also indicate their other symptoms not listed under the sub­ Statistical analyses
scale ‘Other symptoms’. Parameters of skewness, kurtosis and normality test (Kolmogorov–
Smirnov test) indicated deviations from a normal distribution for
Permission to use the C19-YRSm and translation and C19-YRSm subscales and the FSS scale. Further, the Mann–
cultural adaptation of the C19-YRSm Whitney U test (Z) and Student’s t-test were used for ordinal and
The authors of the study obtained an academic/research licence continuous variables. Univariate analysis was performed using the
from the University of Leeds IP LIMITED, a company registered in Chi-square test (v2) for categorical variables. Also, correlation anal­
England and Wales with company registration number 4582496, yses were conducted using Pearson’s r coefficient (r, rpb) and
whose registered office is The Company Secretariat, 11.75 E C Spearman rank-order correlation (q).
Stoner Building, University of Leeds, Leeds, West Yorkshire LS2 Descriptive statistics of relevant participants’ characteristics
9JT, England (‘Leeds’) for the use of the Product (as defined in this and applied scales were summarized by N, percentage, mean and
Licence). The authors obtained permission to proceed with the standard deviations, median and interquartile range. Psychometric
translation and will send a copy of the translated version to the properties were examined by estimating internal consistency, inter-
University of Leeds and the validation certificate behind the item correlations, convergent, concurrent and incremental validity
translation upon the publication of this work. of the C19-YRSm subscales. The general Regression Models module
The C19-YRSm was translated into Croatian following existing was applied. In all calculations, a P-value of <0.05 was considered
recommendations, methodological approaches and guidelines in statistically significant. Data analysis was performed using the
translating, adapting and cross-validating instruments.33 Two Statistica 12 software.
authors of this study (M.R.V. and L.K.), and one independent
Professor of the Croatian language (Professor Daria Matijevic �), all
native Croatian speakers, translated the C19-YRSm question­
Results
naire from English to Croatian. Next, the English language profes­ Demographic, disease-related data, and
sor (D.B.) compared translated versions of C19-YRSm in Croatian C19-YRSm and FSS results
and produced the final version of the questionnaires. Another in­ Table 1 shows the characteristics of 426 subjects in the control
dependent English language professor (University of Split) who group and 369 patients in the clinical group. The Supplementary
had no insight into the original English version translated the last Material contains other relevant demographic information on
Croatian version of the questionnaires back into English, com­ the county of living, education, working status, comorbidities
pleting the final adaptation of the Croatian version of C19-YRSm and medication. In total, 75.35% of subjects in the control group
used in the proposed study. and 53.92% of patients in the clinical group were female. The
subjects in the control group were between 20 and 79 years old
Fatigue Severity Scale with a mean age of 56.50 (±8.17) years, and in the clinical group
The FSS30 is a nine-item self-report questionnaire used to assess range was 21–90 years with a mean age of 57.84 (±14.65). No sig­
fatigue during the past week. The grading for each item ranges nificant difference was found in age (t(793) ¼ −1.61; P ¼ 0.11) be­
from 1 to 7, where 1 indicates complete disagreement and 7 indi­ tween the two groups of subjects. Participants in the clinical
cates strong agreement. The scoring is calculated by adding up all group had significantly more chronic diseases (v2¼42.38;
the answers and dividing them by nine (average value). A cut-off P < 0.001) and used more medication (v2¼44.21; P < 0.001) than
score of �4 and �5 for clinically relevant fatigue was used.34–36 subjects in the control group (Supplementary Tables S1 and S2).
Psychometric properties of the FSS scale were previously con­ Moreover, patients in the clinical group had significantly more
ducted in the Croatian population of patients with multiple sclero­ severe COVID-19 (v2¼218.7; P < 0.001) (Table 1). Most subjects
sis disease (N ¼ 179) and healthy control subjects (N ¼ 999).28 The from the clinical group got over COVID-19 over 12 months ago
Croatian version of the FSS has excellent internal consistency and more than 24 months ago, while subjects in the control
(Cronbach’s a value 0.93) and unidimensional structure estimated group got over COVID-19 more than 6 months ago and
by factor analysis. The concurrent validity of the FSS is satisfac­ <24 months ago. No significant difference was found in the num­
tory due to the significant differences between people with multi­ ber of COVID-19 infections between groups of subjects (v2¼2.83;
ple sclerosis and control subjects (P < 0.05). P ¼ 0.09). Most of the subjects from both groups have gotten over
COVID-19 once. However, in the clinical group of subjects, signifi­
Tests of reliability and validity cantly lower ‘Overall health’ (Z¼−2.17; P ¼ 0.02); and more ‘Other
The reliability of the C19-YRSm questionnaire was estimated by symptoms’ (Z¼−2.00; P ¼ 0.04) was found in subjects that have
Cronbach’s alpha (a) coefficients of internal consistency and gotten over COVID-19 two or more times (Table 1).
inter-item correlations for each subscale (‘Symptom severity, Table 1 shows the median values of the C19-YRSm scale for
Functional symptoms, and Other symptoms’). Overall, health both groups. Significantly higher ‘Symptom severity’ (Z¼−10.15;
was considered as a separate generic question of health status. P < 0.001), ‘Functional disability’ (Z¼−7.96; P < 0.001) and ‘Other
The correlation metric between C19-YRSm subscales and FSS symptoms’ (Z¼−2.48; P < 0.05) are found for the clinical group
scale demonstrated convergent validity. Fatigue is a common compared to the control. Moreover, ‘Overall health’ was signifi­
symptom in people recovering from COVID-19. Recently, the FSS cantly lower for clinical group subjects (Z ¼ 7.13; P < 0.001).
42 | QJM: An International Journal of Medicine, 2024, Vol. 117, No. 1

Table 1. Characteristics of study participants in control and clinical group

Control (N ¼ 426) Clinical (N ¼ 369)

Age, years (mean±SD) 56.50 ± 8.17 57.84 ± 14.65


Age (range) 20–79 21–90
Female (n,%) 321, 75.35 199, 53.92
Height, cm (mean±SD) 172.44 ± 8.87 170.90 ± 8.93

Downloaded from https://academic.oup.com/qjmed/article/117/1/38/7288193 by UERJ - Universidade do Estado do Rio de Janeiro user on 11 March 2024
Weight, kg (mean±SD) 77.65 ± 14.77 85.85 ± 18.10
BMI, kg/m2 (mean±SD) 26.06 ± 4.36 29.36 ± 5.63
Chronic disease, yes (n,%) 222, 52.11 275, 75.52
Medication intake, yes (n,%) 207, 48.59 265, 71.82
Severity of the last COVID19 (n,%)
Asymptomatic 38, 8.92 12, 3.25
Mild to moderate symptoms 368, 86.38 171, 46.34
Severe clinical picture 19, 4.46 186, 50.41
Number of COVID-19 infections (n,%)
1 285, 66.90 275, 74.52
2 or more 140, 33.10a 94, 25.48
Time—COVID-19 (n,%)
>3 months, and <6 months 51, 11.97 28, 7.58
>6 months, and <12 months 144, 33.80 45, 12.19
>12 months, and <24 months 190, 44.60 163, 44.17
>24 months 36, 8.45 133, 36.04
C19-YRS (median (IQR))
Symptom severity 6.0 (14.0) 17.0 (18.0)
Functional disability 0.0 (2.0) 2.0 (5.0)
Other symptoms 1.0 (3.0) 1.0 (4.0)
Overall health 7.0 (3.0) 6.0 (3.0)
Listed symptoms not counted in other symptoms subscale (n,%) 21, 4.92 119, 32.25
Fatigue severity scale (FSS) 3.0 (3.0) 5.0 (2.0)

SD, standard deviation; BMI, body mass index; IQR, inter quartile range; C19-YRS, COVID-19 Yorkshire Rehabilitation Scale; n, number; %, percentage.
‘Time-COVID-19’ refers to the last time subject got over COVID-19.
a
One subject did not provide answer on the number of COVID-19 infections.

Figure 2 presents the median values of C19-YRSm subscales for Convergent validity
the control and clinical groups, and Figure 3 shows the ‘Other A significant correlation was found across subscales ‘Symptom
symptoms’ prevalence between the clinical and control groups. severity’ subscale, ‘Functional disability’ and ‘Other symptoms’
In addition, it can be observed that the participants in the clin­ (r ¼ 0.81; P<0.001; r ¼ 0.58; P<0.001; r ¼ 0.49; P<0.001), indicating
ical group listed significantly more symptoms that were not men­ that C19-YRSm has a coherent internal structure. Moreover, the
tioned in the ‘Other symptoms’ subscale (v2¼101.40; P < 0.001). ‘Overall health’ subscale is negatively correlated with the follow­
Also, there was a significant difference in the number of Other ing subscales ‘Symptom severity’, ‘Functional disability’ and
symptoms (Z ¼ 2.94; P < 0.01) between women and men, with ‘Other symptoms’, respectively (r¼−0.58; P<0.001; r¼−0.49;
women having more symptoms. The most common symptoms in P<0.001; r¼−0.34; P<0.001).
women were weakness, movement problems, coordination prob­ FSS scale has weak to moderate correlations with the signifi­
lems in limbs and hair loss, while in men, the most common cant P-values (Table 3) with ‘Symptom severity’ (r ¼ 0.62),
symptoms were fever and weakness, movement problems or co­ ‘Functional disability’ (r ¼ 0.58) and ‘Other symptoms’ (r ¼ 0.40),
ordination problems in limbs (Figure 4). and a moderate negative correlation was found between FSS and
A significant difference was calculated for the FSS scale be­ ‘Overall health’ (r¼−0.49). Correlations of C19-YRSm subscales
tween the clinical and control groups (Z¼−9.98; P < 0.001), with with FSS indicate construct validity evidence. However, C19-
higher FSS scores in the clinical group (Table 1). YRSm subscales have a weak correlation with other variables like
age, sex, BMI, the severity of COVID-19 and chronic disease.

Concurrent validity
Psychometric properties of the C19-YRS in
The C19-YRSm subscales (‘Symptom severity, Functional disabil­
clinical group
ity’ and ‘Other symptoms’) mean values for the clinical group
Internal consistency
were significantly higher (Mann–Whitney U test—Z value in
The ‘Symptom severity’ subscale (a ¼ 0.96), ‘Functional disability’
Table 1) than for control subjects. Furthermore, mean values for
(a ¼ 0.89) and ‘Other symptoms’ (a ¼ 0.81) have high internal con­
C19-YRSm ‘Overall health’ in the clinical group were significantly
sistency values, meaning C19-YRS subscales have excellent reli­
lower than for the control group.
ability. Inter-item correlations (Table 2) indicate that all items on
each subscale correlate with the scale overall (rrange¼0.23–0.79). Incremental validity
Items in the ‘Other symptoms’ subscale with correlations under Table 4 represents the results of multiple hierarchical regression
0.2 (r < 0.2) are ‘Unintentional weight loss’ (r ¼ 0.16), ‘Skin rash/ analyses and the incremental validity of the C19-YRSm with
discoloration of the skin’ (r ¼ 0.03) and ‘Thoughts about harming ‘Overall health’ and FSS as criterion variables. For ‘Overall
yourself’ (r ¼ 0.11). It can be observed that these variables have health’, the first set of predictor variables (age, sex, BMI and
low or negligible correlations with the scale overall and thus may chronic disease), age, BMI and chronic disease had a significant b
be left out. coefficient accounting for 13% of the variance. Step 2, which
L. Kustura et al. | 43

Downloaded from https://academic.oup.com/qjmed/article/117/1/38/7288193 by UERJ - Universidade do Estado do Rio de Janeiro user on 11 March 2024
Figure 2. Median values of C19-YRSm subscales for control and clinical group. Median values, interquartile range (25–75%) and min. to max. values of
scores on symptom severity (upper left view), functional disability (upper right view), other symptoms (lower left view) and overall health (lower right
view) subscales are presented for control and clinical group. On y-axis median values, interquartile range (25–75%) and min. to max. values of scores
on symptom severity, functional disability, other symptoms and overall health subscales are presented. On x-axis results for clinical and control group
are shown.

Figure 3. Prevalence of C19-YRSm other symptoms in control (N ¼ 426) and clinical (369) group.

included three C19-YRSm subscales (‘Symptom severity, accounting for 11% of the variance. C19-YRSm subscales entered
Functional disability, and Other symptoms’), shows that these in the second step explain an additional 31% of the FSS variance.
subscales explain an additional 22% of overall health variance. It can be seen that ‘Symptom severity’ and ‘Functional disability’
Among these predictors, only ‘Symptom severity’ had significant subscale variables significantly contribute to explaining the FSS
negative b, meaning greater symptom severity correlates to lower as a criterion variable.
overall health (Table 4), which agrees with achieved correlations Results indicate C19-YRSm subscales of the ‘Symptom sever­
between subscales (Table 3). ity’ variable contribute to explaining ‘Overall health’ variance
For the FSS scale as a criterion variable, age, BMI and chronic (incremental validity) concerning age, BMI and chronic disease
disease included in the first step had a significant b coefficient, variables. Furthermore, C19-YRSm subscales of ‘Symptom
44 | QJM: An International Journal of Medicine, 2024, Vol. 117, No. 1

Downloaded from https://academic.oup.com/qjmed/article/117/1/38/7288193 by UERJ - Universidade do Estado do Rio de Janeiro user on 11 March 2024
Figure 4. Prevalence of C19-YRSm other symptoms in female (199) and male (N ¼ 170) subjects.

Table 2. Psychometric properties of the C19-YRSm subscales

Symptom severity (0–30) Functional disability (0–15) Other symptoms (0–25) Overall health (0–10)

Mean (SD) 19.31 (15.39) 3.35 (3.68) 2.41 (3.07) 5.50 (2.30)
Median (IQR) 17.0 (18.0) 2.0 (5.0) 1.0 (4.0) 6.0 (3.0)
Item mean-range 0.35–1.31 0.41–0.93 0.01–0.24
Item SD-range 0.67–0.99 0.76–0.98 0.09–0.43
Inter-item correlations 0.43–0.78 0.52–0.79 0.23–0.52
Cronbach’s a 0.96 0.89 0.81

Cronbach’s a (correlation coefficient)—measure of internal consistency. If equal or higher than 0.9, the internal consistency is excellent. If it is below 0.9 or equal or
higher than 0.8, the internal consistency is good.
SD, standard deviation; IQR, interquartile range.

Table 3. Correlations (significance) between C19-YRSm subscales and related variables

Symptom severity Functional symptoms Other symptoms Overall health

Symptom severity 0.81 (P<0.001) 0.58 (P<0.001) −0.55 (P<0.001)


Functional disability 0.49 (P<0.001) −0.49 (P<0.001)
Other symptoms −0.34 (P<0.001)
Overall health
FSS 0.62 (P< 0.001) 0.58 (P<0.001) 0.40 (P<0.001) −0.49 (P<0.001)
Severity of the last COVID19 0.22 (P < 0.001) 0.17 (P<0.01) 0.05 (P > 0.05) −0.21 (P<0.001)
Chronic disease (yes/no) 0.25 (P<0.001) 0.19 (P<0.001) 0.11 (P<0.05) −0.30 (P<0.001)
Age (years) 0.25 (P<0.001) 0.24 (P<0.001) 0.06 (P<0.001) −0.29 (P<0.001)
Sex (F/M) 0.06 (P > 0.05) 0.01(P > 0.05) 0.18 (P<0.05) −0.07 (P > 0.05)
BMI (kg/m2) 0.18 (P<0.001) 0.14 (P<0.05) −0.02 (P > 0.05) −0.23 (P<0.001)
The last time subject got over COVID-19 −0.11 (P<0.05) −0.17 (P<0.01) −0.14 (P < 0.05) −0.15 (P<0.05)

BMI, body mass index; F, female; M, male; FSS, fatigue severity scale.

Table 4. Multiple hierarchical regression analyses for the incremental validity of C19-YRSm

Overall health FSS

Step 1 b Step 2 b Step 1 b Step 2 b

Step 1 Age −0.16� −0.08 0.14� 0.04


Sex −0.03 −0.01 0.07 0.03
BMI −0.12� −0.08 0.12� 0.07
Chronic disease 0.19� 0.12� −0.19� −0.11�
R2 0.13 0.11
F (5363)¼11.08; P<0.001 F (5363)¼8.99; P<0.001
Step 2 Symptom severity −0.35� 0.36�
Functional disability −0.11 0.21�
Other symptoms −0.06 0.07
R2 0.35 0.42
F (8360)¼24.61; P < 0.001 F (8360)¼33.82; P < 0.001
DR2 0.22 0.31

B, standardized regression coefficient; R2, coefficient of determination; DR2, change in the coefficient of determination; � P < 0.05.
L. Kustura et al. | 45

severity’ and ‘Functional disability’ explain FSS concerning age, (a ¼ 0.891).27 Compared to previous studies46,49 that reported psy­
BMI and chronic disease. chometric characteristics for the original C19-YRS,27 this study
findings are the first to report an excellent internal consistency
(Cronbach’s a value 0.81–0.96) of C19-YRSm subscales.22
Discussion However, this study has the following limitations. Sivan et al.22
The C19-YRSm scale evaluates the severity of the symptoms, conducted Rasch analysis to test the psychometric properties of
functional disability and overall health in individuals with Long the original version of the C19-YRS scale,26 while in this study,

Downloaded from https://academic.oup.com/qjmed/article/117/1/38/7288193 by UERJ - Universidade do Estado do Rio de Janeiro user on 11 March 2024
Covid or post-COVID-19 syndrome. So far, the psychometric the classical psychometric analysis (reliability statistics, conver­
properties of the C19-YRSm22 were not tested due to modifica­ gent, concurrent and incremental validity measures) was applied
tions and post hoc analysis on the original C19-YRS scale.26,27 to test the psychometric properties of the C19-YRSm scale.50
Therefore, this study provides the psychometric results for the Further, longitudinal monitoring of patients with post-COVID-19
C19-YRSm scale using reliability statistics (internal consistency) symptomatology would be recommended utilizing the C19-YRSm
and concurrent, convergent, incremental validity measures. The scale, which was also discussed by Sivan et al.22 Finally, the C19-
reliability and validity testing were conducted on patients (clini­ YRSm scale could be compared to recently published post-COVID
cal group), while subjects from the general population (control score calculated based on-self reported symptoms as reported by
group) served to estimate the concurrent validity of C19-YRSm Bahmer et al.51 Therefore, considering the limitations, future
subscales. Comparing the C19-YRSm scores between the clinical studies might apply Rasch analysis to estimate the psychometric
and control group, the study confirmed the significantly higher properties of the C19-YRSm scale and to compare the results
subscales mean values for the clinical group. This study showed with the classical psychometric analysis results for C19-YRSm,
that C19-YRSm subscales (‘Symptom severity, Functional disabil­ as shown in this study.
ity, Other symptoms’) have excellent internal consistencies To conclude, psychometric properties of prospectively col­
(Cronbach’s a value 0.81–0.96) and acceptable inter-item correla­ lected data were undertaken on the C19-YRSm scale showing
tions (r value 0.23–0.79). According to study results, three items C19-YRSm to be a reliable and valid patient-reported outcome
from the C19-YRSm ‘Other symptoms’ subscale can be excluded measure that captures the common symptoms, functional dis­
(‘unintentional weight loss, skin rash/discoloration of skin’ and ability and overall health in post-Covid-19.
‘thoughts about harming yourself’). The convergent validity of
the C19-YRSm is good due to the significant correlations between
C19-YRSm subscales and between FSS. Furthermore, many previ­
Supplementary material
ous studies evaluating COVID-19 symptomatology reported Supplementary material is available at QJMED online.
fatigue as the common symptom in hospitalized and non-
hospitalized patients recovering from COVID-19.37–40 Also, the
FSS scale shows to be suitable for measuring fatigue in COVID-19 Acknowledgments
patients, confirmed by strong internal consistency (Cronbach’s a We wish to thank to all the participants and professionals in­
of 0.96) and construct validity.37 In the study of Naik et al.,37 the volved in providing care to individuals recovering from post-
mean ± SD FSS score was 4.4 ± 1.8 in the hospitalized and 5.2 ± 1.6 COVID-19.
in the non-hospitalized group, while in the presented study, the
FSS score was 5.0 ± 2.0 for the clinical group and 3.0 ± 3.0 for the
control group. Therefore, the FSS scores for the clinical group of
Author contributions
subjects are similar when comparing the results from Naik et Lea Kustura (Conceptualization [lead], Data curation [lead],
al.37 and the results of this study. This study findings on FSS in Formal analysis [equal], Investigation [lead], Project administra­
the clinical group are also consistent with the cut-off score of �4 tion [lead], Writing—review & editing [equal]), Nikolina Naranc � ic

and �5 for clinically relevant fatigue.34–36 Moreover, chronic dis­ Knez (Data curation [equal], Investigation [equal], Writing—re­
eases, the severity of COVID-19, higher BMI, older age and sex view & editing [equal]), Dubravka Bobek (Data curation [equal],
were reported as significant predictors of Long Covid or post- Investigation [equal], Writing—review & editing [equal]), Ana
COVID-19 syndrome.40–45 Lastly, hierarchical regression analysis �anin (Data curation [equal], Investigation [equal], Writing—
Poljic
showed consistent evidence for the incremental validity of the review & editing [equal]), Sanda Pavelin (Data curation [equal],
C19-YRSm subscale (‘Symptom severity’) with C19-YRSm Investigation [equal], Writing—review & editing [equal]), Maja
‘Overall health’ subscale, and incremental validity of the C19- Buljuba�sic �
� Soda (Data curation [equal], Investigation [equal],
YRSm subscale (‘Symptom severity, Functional disability’) with Writing—review & editing [equal]), Jo�sko Soda� (Data curation
FSS scale in association to age, BMI and chronic disease. [equal], Formal analysis [equal], Investigation [equal], Writing—
Furthermore, four studies46–49 have evaluated post-COVID � (Data curation [equal],
review & editing [equal]), Jan Aksentijevic
symptoms in subjects recovering from COVID-19 utilizing the Investigation [equal], Writing—review & editing [equal]), Klaudia
original version of the C19-YRS,26,27 with two studies reporting Duka Glavor (Data curation [equal], Investigation [equal],
valid results.46,49 Straudi et al.46 reported construct validity of Writing—review & editing [equal]), Vanja Viali (Data curation
C19-YRS26 in a cohort of 79 hospitalized COVID-19 patients after [equal], Investigation [equal], Writing—review & editing [equal]),
12- and 26-weeks post-infection showing C19-YRS moderate re­ Antonio Cukrov (Data curation [equal], Investigation [equal],
sponsiveness of the most represented deficits, with Cronbach’s Writing—review & editing [equal]), Ivana Todoric � Laidlaw (Data
alpha value (a ¼ 0.87) similar in Straudi et al.46 study with the curation [equal], Investigation [equal], Writing—review & editing
original C19-YRS version (a ¼ 0.891).27 Onwards, Partiprajak [equal]), Nina Ipavec (Data curation [equal], Investigation [equal],
et al.49 reported acceptable internal consistency and reliability of Writing—review & editing [equal]), Dora Vukorepa (Data curation
C19-YRSm22 in 337 Thai community members in Bangkok, [equal], Investigation [equal], Writing—review & editing [equal]),
Thailand. The Cronbach’s alpha value (a ¼ 0.723) in Partiprajak Ivona Stipica (Data curation [equal], Investigation [equal],
et al.49 study was lower than that of the original C19-YRS version Writing—review & editing [equal]), Karla Bakrac � (Data curation
46 | QJM: An International Journal of Medicine, 2024, Vol. 117, No. 1

[equal], Investigation [equal], Writing—review & editing [equal]), 10. Asadi-Pooya AA, Akbari A, Emami A, Lotfi M,
Braco Bo�skovic� (Supervision [equal], Writing—review & editing Rostamihosseinkhani M, Nemati H, et al. Long COVID syndrome-
[equal]), Angela Mastelic � (Data curation [equal], Investigation associated brain fog. J Med Virol 2022; 94:979–84.
[equal], Writing—review & editing [equal]), Nikolina Rez �
� ic 11. Merad M, Blish CA, Sallusto F, Iwasaki A. The immunology and
Muz � (Supervision [equal], Writing—review & editing [equal]),
�inic immunopathology of COVID-19. Science 2022; 375:1122–7.
Anita Markotic � (Supervision [equal], Writing—review & editing 12. Schultheiß C, Willscher E, Paschold L, Gottschick C, Klee B,
[equal]), Zoran D- oga�s (Supervision [equal], Writing—review & Henkes SS, et al. The IL-1b, IL-6, and TNF cytokine triad is associ­

Downloaded from https://academic.oup.com/qjmed/article/117/1/38/7288193 by UERJ - Universidade do Estado do Rio de Janeiro user on 11 March 2024
editing [equal]) and Kre�simir Dolic � (Supervision [equal], ated with post-acute sequelae of COVID-19. Cell Rep Med 2022;
Writing—review & editing [equal]) 3:100663.
13. Callard F, Perego E. How and why patients made Long Covid. Soc
Sci Med 2021; 268:113426.
Conflict of interest 14. Nehme M, Braillard O, Alcoba G, Aebischer Perone S,
None declared. Courvoisier D, Chappuis F, et al.; COVICARE TEAM. COVID-19
symptoms: longitudinal evolution and persistence in outpatient
settings. Ann Intern Med 2021; 174:723–5.
Ethics statement 15. Huang C, Huang L, Wang Y, Li X, Ren L, Gu X, et al. 6-month con­
All procedures performed in studies involving human partici­ sequences of COVID-19 in patients discharged from hospital: a
pants were in accordance with the ethical standards of the Ethics cohort study. Lancet 2021; 397:220–32.
Committee of the University of Split, School of Medicine, Croatia, 16. Dotan A, Shoenfeld Y. Post-COVID syndrome: the aftershock of
Class: 003-08/23-03/0015, No. 2181-198-03-04-23-0001 (approved SARS-CoV-2. Int J Infect Dis 2022; 114:233–5.
on January 2023) and the Ethics Committee of the University 17. Villar JC, Gumisiriza N, Abreu LG, Maude RJ, Colebunders R.
Hospital of Split, Croatia, Class: 500-03/22-01/204, No. 2181-147/ Defining post-COVID condition. Lancet Infect Dis 2022; 22:316–7.
01/06/M.S.-22-02 (approved on November 2022) and with the 18. World Health Organization. A Clinical Case Definition of Post
1964 Helsinki Declaration and its later amendments or compara­ COVID-19 Condition by a Delphi Consensus, 6 October 2021. https://
ble ethical standards. Before commencing the survey, partici­ www.who.int/publications/i/item/WHO-2019-nCoV-Post_COVID-
pants were informed about the study details. Participation was 19_condition-Clinical_case_definition-2021.1 (17 May 2023, date
last accessed).
voluntary and anonymous.
19. Jandhyala R. Design, validation and implementation of the
post-acute (long) COVID-19 quality of life (PAC-19QoL) instru­
Data availability ment. Health Qual Life Outcomes 2021; 19:229.
The dataset used and analysed during this study area available 20. Tran VT, Riveros C, Clepier B, Desvarieux M, Collet C, Yordanov
Y, et al. Development and validation of the long covid symptom
from the corresponding author on reasonable request.
and impact tools, a set of patient-reported instruments con­
structed from patients’ lived experience. Clin Infect Dis 2022;
References 74:278–87.
21. Hughes SE, Haroon S, Subramanian A, McMullan C, Aiyegbusi
01. World Health Organization. WHO Coronavirus Disease (COVID- OL, Turner GM, et al. Development and validation of the symp­
19) Dashboard. https://news.un.org/en/story/2023/05/1136367 (5 tom burden questionnaire for long covid (SBQ-LC): Rasch analy­
May 2023, date last accessed). sis. BMJ 2022; 377:e070230.
02. Venkatesan P. NICE guideline on long COVID. Lancet Respir Med 22. Sivan M, Preston N, Parkin A, Makower S, Gee J, Ross D, et al. The
2021; 9:129. modified COVID-19 Yorkshire Rehabilitation Scale (C19-YRSm)
03. Mehandru S, Merad M. Pathological sequelae of long-haul patient-reported outcome measure for Long Covid or Post-
COVID. Nat Immunol 2022; 23:194–202. COVID-19 syndrome. J Med Virol 2022; 94:4253–64.
04. Soriano JB, Murthy S, Marshall JC, Relan P, Diaz JV; WHO 23. Patel K, Straudi S, Yee Sien N, Fayed N, Melvin JL, Sivan M.
Clinical Case Definition Working Group on Post-COVID-19 Applying the WHO ICF framework to the outcome measures
Condition. A clinical case definition of post-COVID-19 condition used in the evaluation of long-term clinical outcomes in coro­
by a Delphi consensus. Lancet Infect Dis 2022; 22:e102–7. navirus outbreaks. Int J Environ Res Public Health 2020; 17:6476.
05. Carf�ı A, Bernabei R, Landi F; Gemelli Against COVID-19 Post- 24. Sivan M, Greenhalgh T, Darbyshire JL, Mir G, O'Connor RJ,
Acute Care Study Group. Persistent symptoms in patients after Dawes H, et al.; LOCOMOTION consortium. LOng COvid
acute COVID-19. JAMA 2020; 324:603–5. Multidisciplinary consortium Optimising Treatments and
06. Puntmann VO, Carerj ML, Wieters I, Fahim M, Arendt C, servIces acrOss the NHS (LOCOMOTION): protocol for a mixed-
Hoffmann J. Outcomes of cardiovascular magnetic resonance methods study in the UK. BMJ Open 2022; 12:e063505.
imaging in patients recently recovered from coronavirus dis­ 25. National Institute for Health and Care Excellence (NICE),
ease 2019 (COVID-19). JAMA Cardiol 2020; 5:1265–73. Scottish Intercollegiate Guidelines Network (SIGN) and Royal
07. Mahmud R, Rahman MM, Rassel MA, Monayem FB, Sayeed College of General Practitioners (RCGP). COVID-19 Rapid
SKJB, Islam MS, et al. Post-COVID-19 syndrome among symp­ Guideline: Managing the Long-Term Effects of COVID-19. London,
tomatic COVID-19 patients: a prospective cohort study in a ter­ NICE, 2022. https://www.nice.org.uk/guidance/ng188/resources/
tiary care center of Bangladesh. PLoS One 2021; 16:e0249644. covid19-rapid-guideline-managing-the-longterm-effects-of-covid19-
08. Davis HE, Assaf GS, McCorkell L, Wei H, Low RJ, Re'em Y, et al. pdf-51035515742 (17 May 2023, date last accessed).
Characterizing long COVID in an international cohort: 7 months 26. Sivan M, Halpin S, Gee J, Makower S, Parkin A, Ross D, et al. The
of symptoms and their impact. EClinicalMedicine 2021; self-report version and digital format of the COVID-19
38:101019. Yorkshire Rehabilitation Scale (C19-YRS) for long covid or Post-
09. Monje M, Iwasaki A. The neurobiology of long COVID. Neuron COVID syndrome assessment and monitoring. Adv Clin Neurosci
2022; 110:3484–96. Rehabil 2021; 20:1–5.
L. Kustura et al. | 47

27. O'Connor RJ, Preston N, Parkin A, Makower S, Ross D, Gee J, et al. 40. Arjun MC, Singh AK, Pal D, Das K, Venkateshan AGM, Mishra B,
The COVID-19 Yorkshire Rehabilitation Scale (C19-YRS): appli­ et al. Characteristics and predictors of long COVID among diag­
cation and psychometric analysis in a post-COVID-19 syndrome nosed cases of COVID-19. PLoS One 2022; 17:e0278825.
cohort. J Med Virol 2022; 94:1027–34. 41. Chudzik M, Lewek J, Kapusta J, Banach M, Jankowski P, Bielecka-
28. Jerkovic� A, Prorokovic �
� A, Matijaca M, Curkovi � Katic
c � A, Ko�sta V, Dabrowa A. Predictors of long COVID in patients without
Mihalj M, et al. Validation of the fatigue severity scale in comorbidities: data from the polish Long-COVID cardiovascular
Croatian population of patients with multiple sclerosis disease: (PoLoCOV-CVD) study. J Clin Med 2022; 11:4980.

Downloaded from https://academic.oup.com/qjmed/article/117/1/38/7288193 by UERJ - Universidade do Estado do Rio de Janeiro user on 11 March 2024
factor structure, internal consistency, and correlates. Mult Scler 42. Kisiel MA, Janols H, Nordqvist T, Bergquist J, Hagfeldt S,
Relat Disord 2022; 58:103397. Malinovschi A, et al. Predictors of post-COVID-19 and the impact
29. Sudre CH, Murray B, Varsavsky T, Graham MS, Penfold RS, of persistent symptoms in non-hospitalized patients 12 months
Bowyer RC, et al. Attributes and predictors of long COVID. Nat after COVID-19, with a focus on work ability. Ups J Med Sci 2022;
Med 2021; 27:626–31. 127:e8794. doi: 10.48101/ujms.v127.8794.
30. An S, Ahn C, Moon S, Sim EJ, Park SK. Individualized biological 43. Vasilevskaya A, Mushtaque A, Tsang MY, Alwazan B, Herridge
age as a predictor of disease: Korean Genome and Epidemiology M, Cheung AM, et al. Sex and age affect acute and persisting
Study (KoGES) cohort. J Pers Med 2022; 12:505. COVID-19 illness. Sci Rep 2023; 13:6029.
31. Krupp LB, Alvarez LA, LaRocca NG, Scheinberg LC. Fatigue in 44. Montenegro P, Moral I, Puy A, Cordero E, Chantada N, Cuixart L,
multiple sclerosis. Arch Neurol 1988; 45:435–7. et al. Prevalence of post COVID-19 condition in primary care: a
32. Sivan M, Parkin A, Makower S, Greenwood DC. Post-COVID syn­ cross sectional study. Int J Environ Res Public Health 2022; 19:1836.
drome symptoms, functional disability, and clinical severity 45. Duggal P, Penson T, Manley HN, Vergara C, Munday RM,
phenotypes in hospitalized and nonhospitalized individuals: a Duchen D, et al. Post-sequelae symptoms and comorbidities af­
cross-sectional evaluation from a community COVID rehabilita­ ter COVID-19. J Med Virol 2022; 94:2060–6.
tion service. J Med Virol 2022; 94:1419–27. 46. Straudi S, Manfredini F, Baroni A, Milani G, Fregna G,
33. Sousa VD, Rojjanasrirat W. Translation, adaptation and valida­ Schincaglia N, et al. Construct validity and responsiveness of
tion of instruments or scales for use in cross-cultural health the COVID-19 Yorkshire Rehabilitation Scale (C19-YRS) in a co­
care research: a clear and user-friendly guideline. J Eval Clin hort of Italian hospitalized COVID-19 patients. Int J Environ Res
Pract 2011; 17:268–74. Public Health 2022; 19:6696.
34. Lerdal A, Celius EG, Krupp L, Dahl AA. A prospective study of 47. Ayuso Garc�ıa B, Besteiro Balado Y, Pe �rez Lo� pez A, Romay Lema
patterns of fatigue in multiple sclerosis. Eur J Neurol 2007; E, Marcha � n-Lo � Rodr�ıguez Alvarez
� pez A, � A, et al. Assessment of
14:1338–43. Post-COVID symptoms using the C19-YRS tool in a cohort of
35. Armutlu K, Korkmaz NC, Keser I, Sumbuloglu V, Akbiyik DI, patients from the first pandemic wave in Northwestern Spain.
Guney Z, et al. The validity and reliability of the fatigue severity Telemed J E Health 2023; 29:278–83.
scale in Turkish multiple sclerosis patients. Int J Rehabil Res 48. Al Hsaon MA, Amel Abdalrahim Sulaiman AA. Assessment of
2007; 30:81–5. persistence symptoms in recovered COVID-19 patients by
36. Valko PO, Bassetti CL, Bloch KE, Held U, Baumann CR. Yorkshire Rehabilitation Scale (C19-YRS): a cross-sectional
Validation of the fatigue severity scale in a Swiss cohort. Sleep study from Qassim region, Saudi Arabia. OJPM 2022; 12:155–74.
2008; 31:1601–7. 49. Partiprajak S, Krongthaeo S, Piaseu N, Wongsathikun J,
37. Naik H, Shao S, Tran KC, Wong AW, Russell JA, Khor E, et al. Kongsuwan A. The Thai version of the COVID-19 Yorkshire
Evaluating fatigue in patients recovering from COVID-19: vali­ Rehabilitation Scale: a valid instrument for the psychometric
dation of the fatigue severity scale and single item screening assessment of the community members in Bangkok, Thailand.
questions. Health Qual Life Outcomes 2022; 20:170. BMC Public Health 2023; 23:663.
38. Calabria M, Garc�ıa-Sa � nchez C, Grunden N, Pons C, Arroyo JA, 50. Boateng GO, Neilands TB, Frongillo EA, Melgar-Quin ~ onez HR,
Go� mez-Anson B, et al. Post-COVID-19 fatigue: the contribution Young SL. Best practices for developing and validating scales for
of cognitive and neuropsychiatric symptoms. J Neurol 2022; health, social, and behavioral research: a primer. Front Public
269:3990–9. Health 2018; 6:149.
39. Tabacof L, Tosto-Mancuso J, Wood J, Cortes M, Kontorovich A, 51. Bahmer T, Borzikowsky C, Lieb W, Horn A, Krist L, Fricke J, et al.;
McCarthy D, et al. Post-acute COVID-19 syndrome negatively NAPKON study group. Severity, predictors and clinical corre­
impacts physical function, cognitive function, health-related lates of Post-COVID syndrome (PCS) in Germany: a prospective,
quality of life, and participation. Am J Phys Med Rehabil 2022; multi-centre, population-based cohort study. EClinicalMedicine
101:48–52. 2022; 51:101549.

You might also like