Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

Scandinavian Journal of Psychology, 2018, 59, 311–318 DOI: 10.1111/sjop.

12437

Personality and Social Psychology


What is told when the story is retold? Consistency of victimization
reports in psychiatric patients
CRISTINA S. MESQUITA ^
and ANGELA C. MAIA
University of Minho, Braga, Portugal

^ C. (2018). What is told when the story is retold? Consistency of victimization reports in psychiatric patients. Scandinavian
Mesquita, C. S. & Maia, A.
Journal of Psychology, 59, 311–318.

The use of retrospective self-reports is a major methodological concern when ascertaining the occurrence of victimization experiences, with additional
concerns when assessing psychiatric patients. The test for consistency can overcome some of these concerns, increasing the confidence in the information
reported. Our aim was twofold: (1) to know the consistency of victimization reports; and (2) to test the role of changes on emotional distress in predicting
report discrepancies, in a sample of 34 adult psychiatric patients. Participants were assessed twice, with a year interval. Sexual abuse was the experience
that presented the higher level of consistency for childhood victimization, while assault with a weapon had the higher consistency level for adolescent and
adult victimization. We found that increases on emotional distress predicted report discrepancies, and more specifically, increases in the report of
victimization. Our results displayed acceptable consistency levels, suggesting some stability in the reporting of victimization over time. Considering that
inconsistencies tended either to increases and decreases in the reporting of victimization, it would be important to consider the impact of such experiences
when intervening with psychiatric patients.
Key words: Consistency, retrospective self-report, interpersonal victimization, psychiatric patients, emotional distress.
Cristina S. Mesquita, School of Psychology, University of Minho, Portugal, Campus de Gualtar, 4710-057 Braga, Portugal. E-mail: mesquitacristina@
hotmail.com

INTRODUCTION than official records as a methodology to assess victimization, as


both methodologies may provide valuable information. A
Reliability is a major concern when using retrospective self-reports consistent report does not equal an accurate report; nevertheless,
to assess victimization. The main reasons for this concern are the stability of these reports allows for a higher confidence in the
related with memory accuracy, for one hand, and the willingness information provided. Inconsistent reports can be defined as the
to disclose a history of victimization on the other hand (Fisher, failure to report the same experience(s) in different moments in
Craig, Fearon et al., 2011; Hardt & Rutter, 2004; Hepp, Gamma, time. Discrepant reports can either lead to omissions – with a
Milos et al., 2006; Kendal-Tackett & Becker-Blease, 2004; reduction in the number of reported experiences, compared to
Langeland, Smit, Rerckelbach, deVries, Hoogendorn & Draijes, previous reports – or commissions – with an increased number of
2015; Mckinney, Harris & Caetano, 2004; Paivio, 2001). Several victimizations being reported, compared to previous assessments
studies have shown that reports of emotionally arousing events, as (Dube, Williamson, Thompson, Felitti & Anda, 2004; van Giezen
interpersonal victimization, are more precise, stable and accurate et al., 2005).
(Byrne, Hyman & Scott, 2001; Paivio, 2001; Peace & Porter, Self-reports’ consistency can be influenced by several factors,
2004; Spinhoven, Bamelis, Haringsma, Molendijk & Arntz, 2012; including clinical factors that refer to specificities in the
van Giezen, Arensman, Spinhoven & Wotters, 2005). However, functioning of individuals with psychiatric symptoms/disorders
even these experiences may be subjected to errors, bias distortion (Alexander, Quas, Goodman et al., 2005; Dube et al., 2004;
and natural decay of the memory (Fisher et al., 2011; Hardt & Elliot & Briere, 1997; Epstein & Bottoms, 1998; Goldberg &
Rutter, 2004; Kremers, van Giezen, van der Does, van Dyck & Freyd, 2008; Kremers et al., 2007; Mckinney et al., 2004; Paivio,
Spinhoven, 2007; van Giezen et al., 2005) with failed or 2001; van Giezen et al., 2005). Some authors argue that reports
incomplete recovery (Mechanic, Resick & Griffin, 1998). of psychiatric patients are more prone to inconsistencies due to
The comparison of self-reports of victimization with official psychopathological symptoms that affect memory and language,
records of their occurrence, either from child protective services, cognition distortion (Paivio, 2001), delusions, hallucinations,
police, or medical records, is the preferential method to assess substance abuse and pharmacotherapy (Goodman, Thompson,
reliability, providing an accurate measure of victimization. Yet, Weinfurt et al., 1999). Also, it has been suggested that psychiatric
frequently this strategy is compromised by the inexistence, patients may overestimate their experiences of victimization in
incompleteness or unavailability of these records, jeopardizing order to justify their current symptoms (Alexander et al., 2005;
this methodological option. In face of the impossibility to use Fisher et al., 2011; Kremers et al., 2007). In their study with 69
official records as a measure of reliability, the study of college students, Lalande and Bonanno (2011) found that levels
consistency allows us to assess the stability of victimization self- of distress felt during a victimization episode can enhance the
reports over time. As stated by Shaffer, Huston and Egeland memory for that event, especially if the person is experiencing
(2008), retrospective self-reports are not necessarily less suitable emotional distress during recall.

© 2018 Scandinavian Psychological Associations and John Wiley & Sons Ltd
14679450, 2018, 3, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/sjop.12437 by Cochrane Portugal, Wiley Online Library on [10/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
^ C. Maia
312 C. S. Mesquita and A. Scand J Psychol 59 (2018)

It is well known that psychiatric patients report high levels of “consistency” and “accuracy” were not clearly distinguished and
interpersonal victimization; studies have shown an association were used interchangeably, along with a lack of definition of
between victimization and the subsequent development of report consistency, and finally, few studies explored the nature of
emotional distress and psychiatric disorders in adulthood (Cougle, inconsistencies, with most studies failing to report omissions and
Resnick & Kilpatric, 2009; Goodman, Salyers, Mueser et al., commissions.
2001; Horwitz, Widom, McLaughlin & White 2001; McFarlane, In an attempt to overcome some of the limitations encountered in
Schrader, Bookless & Browne, 2006; Mueser, Salyers, Rosenberg this field, we define two aims for our study. Our first aim was to
et al., 2004). Therefore, it is important to assess the consistency know the consistency of victimization reports of adult psychiatric
of victimization reports in this population: as stated previously, patients, assessed twice with a 12 month interval. We assessed
self-reports are frequently the only available methodology to consistency for experiences occurred during childhood,
assess the prevalence of victimization. This knowledge has adolescence and adulthood. Consistency was defined as
implications for research, specifically in victimization surveys; at maintenance of the response pattern at time 2, compared to Time 1,
a clinical level, clarifying the role of victimization experiences in concerning the occurrence/non-occurrence of victimization. We
the emergence, maintenance and/or worsening of emotional detailed the nature of inconsistencies, attending to commissions and
distress, and at a legal level, as inconsistent reports may omissions at time 2, compared to reports at Time 1. Our second aim
jeopardize the role of psychiatric patients as witnesses (Peace & was to explore the role of changes on emotional distress in
Porter, 2004; van Giezen et al., 2005). predicting report discrepancies. We hypothesized that changes on
Studies with psychiatric patients have found mixed results, emotional distress would predict discrepancies; specifically, an
either indicating that victimization reports are consistent through increase in emotional distress would result in more commissions.
time, either pointing to opposite results. In their study of 229
adult psychiatric patients, Spinhoven and colleagues (2012)
intended to know the consistency for reports of sexual and METHODS
physical abuse. Participants were evaluated at Time 1, and one
year later, at Time 2. Results revealed good levels of consistency. Participants
Forty-nine participants (21.4%) were inconsistent; from these, 25 Participants were 34 psychiatric patients between ages 20 and 63
(10.9%) made omissions, and 24 (10.5%) made commissions. years (M = 47.18, SD = 10.38), from four Portuguese psychiatric
Fisher and colleagues (2011) also found results suggesting that hospitals (67.6% inpatients, 32.4% outpatients). Twenty two were
victimization reports are consistent. In their study with 30 adult female (64.7%), and 12 were male (35.3%). To be enrolled in this
psychiatric patients, assessed with a seven years interval, study, participants had to be receiving mental health care in a
consistency levels for sexual and physical abuse were moderate. public psychiatric hospital, as either an inpatient or an outpatient,
Four (13.6%) participants made commissions concerning sexual with a diagnosis of mental disorder according to DSM-IV.
abuse, and six (20%) made omissions concerning physical abuse. Participants were included regardless of the diagnosis they
A review from van Giezen and colleagues (2005) aimed to know presented. The exclusion criteria were not understanding
the level of consistency of reports of sexual and physical abuse. Portuguese language, mental retardation, and active psychotic
The authors found that all 37 studies had some degree of symptoms.
inconsistency: irrespective to the nature of the samples, children, At Time 1, two experienced researchers approached 131
adolescents, adults and adult psychiatric patients had discrepant participants. Of the 131 patients, 11 were not included in the
reports when reporting experiences of sexual and physical abuse. study. Six participants refused to participate, one participant felt
It has been suggested that there may be a trend to increase the too disturbed to proceed, and four had no identifiable
number of victimization reported over assessments. This may be psychopathology, leaving a final sample of 120 participants. From
due to underreport in initial assessments, and the effect of those 120, 10 (8.3%) participants refused to participate at Time 2.
rehearsal (Epstein & Bottoms, 2002; Ghetti, Goodman, Eisen, Qin We expected to integrate all the 110 remaining participants at
& Davis, 2002; Kremers et al., 2007; Kringsley, Gallagher, Time 2. At Time 2, we contacted these 110 participants, asking
Weathers, Kulter & Kaloupek, 2003; Odinot, Wolters & van about how they had been feeling, and reminding them of their
Giezen, 2013; Peace, Shudra, Forrester, Kasper, Harder & Porter, participation in a second assessment. From these 110 participants:
2014). 27 (22.5%) refused to participate after their previous consent; 36
The study of consistency of victimization reports in psychiatric (30%) had no longer valid phone numbers and could not be
patients has some limitations. Existing studies tend to focus on located; and 13 (10.9%) were very disturbed in the initial
depressed patients (Paivio, 2001) and patients with Posttraumatic conversation, leading to the decision of not proceeding with
Stress Disorder (Fisher et al., 2011; Goodman et al., 1999). At assessment. These patients were referred to their general
the same time, victimization experiences also tend to be limited to practitioner and/or psychiatrist, and were not included in the
sexual and physical abuse, especially those occurred in childhood study. Additional phone calls were made the following days in
(Fisher et al., 2011; Hardt & Rutter, 2004; van Giezen et al., order to ensure they were receiving the care needed. The final
2005), neglecting the study of consistency in other categories of sample comprised 34 participants, representing 28.3% of the
victimization, and for experiences occurred in other stages of the original sample. There were no statistical differences between the
lifecycle. In the previously mentioned review of van Giezen and final sample and the original sample considering sex, age, marital
colleagues (2005), results showed that there was a general lack of status, employment status, education level, level of victimization
studies of consistency of victimization reports; the terms and emotional distress.

© 2018 Scandinavian Psychological Associations and John Wiley & Sons Ltd
14679450, 2018, 3, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/sjop.12437 by Cochrane Portugal, Wiley Online Library on [10/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Scand J Psychol 59 (2018) Victimization reports in psychiatric patients 313

Procedure Interpersonal Victimization. Lifetime Trauma and Victimization


To conduct this study, we contacted 11 psychiatric hospitals from History (LTVH) is a checklist of victimization experiences, with
the North region of Portugal. Four of them consent to be enrolled nine items assessing verbal abuse, threat of physical abuse/
in the study. We sought approval from the National Commission assault, physical abuse/assault, sexual abuse, discrimination,
of Data Protection, and from the Ethics Committees of Psychiatric neglect and witnessing to victimization. For each experience,
Hospitals and obtained approval to assess inpatients and participants are asked about the occurrence of victimization
outpatients. After approval, patients were approached. For during childhood (0 to 11 years), adolescence (12 to 17 years)
inpatients, the chief nurse made the first contact with patients who or adulthood (18 and older). Items are dichotomous; a positive
met the inclusion criteria and introduced the researcher. response to any item was considered as indicative of the
Outpatients were approached on scheduled appointment days; presence of a given victimization experience.
their psychiatrist presented the researcher, who proceeded to
present the study. After this presentation, patients who agreed to
Statistical analyses
participate signed an informed consent. Patients were also asked if
they were willing to be contacted one year later. Those who Data were analyzed using descriptive statistics and frequencies of
agreed to be enrolled at Time 2 gave additional consent and socio-demographic data, emotional distress and victimization
provided a phone number, either a landline or a mobile phone. experiences. BSI Index Global Severity Index (GSI) for both
Participation was voluntary. Time 1 and Time 2 was obtained summing the score of all items,
Time 1 assessments were conducted in a quiet room in and dividing the result by the total number of answers. A
psychiatric hospitals, where the patients could feel comfortable compute analyses was made, subtracting Time 1 GSI from Time
and at ease. Confidentiality was ensured for all participants 2 GSI, creating a measure representing changes on emotional
enrolled. Data were collected between July of 2013 and January distress. A score of 0 illustrated a lack of change; a negative score
of 2014. Data for Time 2 were collected between July of 2014 represented an improvement on the mental status, and a positive
and January of 2015, with an interval of 12 months between score portrayed a worsening of the mental state.
assessments. The consent provided by the Ethics Committees did Each victimization experience was computed, subtracting Time
not allow us to schedule additional assessments in the psychiatric 1 score from Time 2 score, creating a measure of report
hospitals’ facilities. For that reason, Time 2 assessments were discrepancy. In this computed measure, a score of 0 represented a
made via telephone. Participants were contacted, asked follow-up consistent report. Scores of –1 reflected omissions, and scores of
questions about their current mental health state, if they 1 reflected commissions, both representing inconsistent reports.
remembered about the study they were enrolled in, and asked We also calculated the percentage of agreement between Time 1
about suitable dates for the assessment. On the scheduled days and Time 2 reports for each victimization experience.
participants answered the Brief Symptom Inventory (BSI) and Additionally, we created a Total Victimization score, both for
Lifetime Trauma and Victimization History (LTVH) checklist. Time 1 and Time 2, summing all victimization experiences for
Several follow-up phone calls were made to ensure the each participant. The Total Victimization score for Time 1 was
participants’ well-being. then subtracted from the Total Victimization score for Time 2,
creating a measure of report discrepancy.
Consistency was calculated using Cohen’s kappa. According to
Instruments Gisev, Bell and Chen (2013), Sim and Wright (2005), and the
Socio-demographic information. A socio-demographic question- guidelines recommended by Kottner, Audige, Brorson et al.
naire was created to collect information about sex, age, marital (2011), Cohen’s kappa is the appropriate statistical method to
status, employment status and socio-economic status. analyze agreement with nominal data. Results of Cohen’s kappa
were interpreted following Altman (1991): k < 0.20 – poor
Psychological Distress. Brief Symptom Inventory (BSI, agreement; k between 0.21 and 0.40 – fair agreement; k between
Derogatis, 1982, Portuguese version from Canavarro, 1999) is an 0.41 and 0.60 – moderate agreement; k between 0.61 and 0.80 –
instrument with 53 items that assesses the presence of good agreement; k > 0.81 – very good agreement.
psychological distress within the previous seven days in a five Using Pearson and bisserial correlations, we tested for
point scale. It evaluates nine symptom dimensions, allowing us to associations between emotional distress and victimization report,
calculate three indexes that constitute brief evaluations of and emotional distress and commissions and omissions. Using a
emotional distress: the Global Severity Index (GSI), the Positive linear regression, we tested the role of changes in emotional
Symptoms Total (PST) and the Positive Symptom Distress Index distress in predicting changes on reports, commission and
(PSDI). For the purpose of this study, GSI was used to represent omission. Changes on emotional distress (GSI Time 2 – GSI
emotional distress. This index reflects a combined score that Time 1) were entered as predictor, with discrepancies on
weighs the intensity of the distress experienced and the number of victimization report (Total Victimization Time 2 – Total
symptoms checked, and it is obtained summing the score of all Victimization Time 1), commissions and omissions entered as
items, and dividing the result by the total number of answers. In outcome.
our study, Cronbach’s alpha varied between 0.62 (psychoticism) Data analyzes was made with the support of the software IBM
and 0.87 (depression), at Time 1, and between 0.59 Statistical Package for Social Science (SPSS), version 22 for
(psychoticism) and 0.85 (depression) at Time 2. Windows (IBM, Armonk, NY).

© 2018 Scandinavian Psychological Associations and John Wiley & Sons Ltd
14679450, 2018, 3, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/sjop.12437 by Cochrane Portugal, Wiley Online Library on [10/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
^ C. Maia
314 C. S. Mesquita and A. Scand J Psychol 59 (2018)

RESULTS of commission (23.5%). As for adolescent victimization, witness


to victimization had the higher level of omission (20.6%) and
Descriptive data commission (23.5%). Results for adult victimization revealed that
At Time 2, 15 participants (44.1%) reported higher levels of threat of physical abuse/assault, physical abuse/assault and
emotional distress, and 19 participants (55.9%) reported lower discrimination had the higher level of omission (20.6%), while
levels, compared to Time 1. Table 1 shows the prevalence for witness to victimization had the highest level of commission
each victimization experience both at Time 1 and 2. At Time 1, (26.5%).
Total Victimization score varied from 0 to 19 (M = 5.97, SD =
5.33), while at Time 2, it varied from 0 to 15 (M = 5.18, SD =
4.99). Regression model
Correlation analyses revealed a positive significant association
between emotional distress at Time 1, and victimization report at
Consistency of victimization self-reports Time 1, r = 0.38, p < 0.05. When we tested for the same
Results from consistency analyses are presented in Table 1. For association between emotional distress and victimization report at
childhood victimization, kappa varied between poor (0.00, Time 2, results were not significant. We then tested for the
discrimination) and moderate (0.52, sexual abuse). Agreement association between changes on emotional distress from Time 1 to
varied from 61.8% (physical abuse/assault) to 91.2% (sexual Time 2, and report discrepancies and found a positive significant
abuse and discrimination). For adolescent victimization, kappa association, r = 0.43, p < 0.05.
varied from poor (0.02, witness to victimization) to moderate The results from the linear regression model testing the role of
(0.44, verbal abuse). Agreement varied from 55.9% (witness to changes on emotional distress in predicting discrepancies in
victimization) to 94.1% (sexual abuse). As for adult victimization, victimization reports was statistically significant, t (1, 32) = 7.29,
Kappa varied from fair 0(.22, witness to victimization) to p < 0.05, explaining 18.6% of the variance (adjusted R2 = 16%)
moderate (0.52, sexual abuse). Agreement varied between 64.7% in report discrepancies. Changes on emotional distress towards an
(witness to victimization) and 91.2% (sexual abuse). increase of symptoms predicted more discrepancies on
victimization reports.
We found a positive significant association between changes on
Inconsistency in victimization self-reports emotional distress from Time 1 to Time 2 and commissions, rbp =
Table 2 presents the discrepancies of the participant’s self-reports. 0.41, p < 0.05. The same association for omission was not
For childhood and adulthood victimization, participants made significant. The linear regression model testing the role of changes
more omissions compared to their initial report at Time 1. As for on emotional distress in predicting commissions was statistically
adolescent victimization, participants made the same number of significant, t (1, 32) = 15.86, p < 0.05, explaining 33% of the
omissions and commissions. variance (adjusted R2 = 31.1%) in report discrepancies, with
Comparing the discrepancies across the lifecycle, reports of changes on emotional distress towards an increase of symptoms
childhood victimization had less omissions. Reports of adolescent predicting more commissions.
victimization had more commissions, and reports of adult
victimization had the higher level of omissions and the lower
level of commissions. DISCUSSION
Results display the experiences more prone to inconsistencies. Our study intended to know the consistency of victimization
For childhood victimization, verbal abuse had the highest level of reports, and to test the role of emotional distress in predicting
omission (23.5%), and physical abuse/assault had the higher level changes in victimization reports, in a sample of psychiatric

Table 1. Prevalence of victimization at Time 1 and Time 2, Cohen’s kappa and percentage of agreement for each experience of victimization, in each
stage of the lifecycle

Childhood Adolescence Adulthood

N (%) N (%) N (%)


% % %
T1 T2 K agreement T1 T2 K agreement T1 T2 K agreement

Verbal abuse 16 (47.1) 11 (32.4) 0.34 67.3 14 (41.2) 11 (32.4) 0.44 73.5 18 (52.9) 15 (44.1) 0.47 73.5
Threat physical 8 (23.5) 3 (8.8) 0.27 79.4 9 (26.5) 6 (17.6) 0.24 73.5 14 (41.2) 9 (26.5) 0.42 73.5
abuse/assault
Physical abuse/assault 9 (26.5) 12 (35.3) 0.11 61.8 9 (26.5) 12 (35.3) 0.25 67.6 14 (41.2) 8 (23.5) 0.48 76.5
Sexual abuse 3 (8.8) 4 (11.8) 0.52 91.2 1 (2.9) 1 (2.9) –0.03 94.1 4 (11.8) 3 (8.8) 0.52 91.2
Discrimination 3 (8.8) 0 0.00 91.2 8 (23.5) 7 (20.6) 0.41 79.4 16 (47.1) 13 (38.2) 0.35 67.6
Neglect 5 (14.7) 7 (20.6) 0.20 76.5 4 (11.8) 7 (20.6) 0.25 79.4 4 (11.8) 5 (14.7) 0.36 85.3
Witness to 10 (29.4) 7 (20.6) 0.30 73.5 11 (32.4) 12 (35.3) 0.02 55.9 8 (23.5) 14 (41.2) 0.22 64.7
victimization
Total victimization 54 44 56 56 78 67

© 2018 Scandinavian Psychological Associations and John Wiley & Sons Ltd
14679450, 2018, 3, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/sjop.12437 by Cochrane Portugal, Wiley Online Library on [10/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Scand J Psychol 59 (2018) Victimization reports in psychiatric patients 315

Table 2. Omission and commission for each victimization experience, for each stage of the lifecycle

Type of inconsistency

Childhood Adolescence Adulthood


N (%) N (%) N (%)

Omission Commission Omission Commission Omission Commission

Verbal abuse 8 (23.5) 3 (8.8) 6 (17.6) 3 (8.8) 6 (17.6) 3 (8.8)


Threat physical abuse/assault 6 (17.6) 3 (8.8) 6 (17.6) 3 (8.8) 7 (20.6) 2 (5.9)
Physical abuse/assault 5 (14.7) 8 (23.5) 4 (11.8) 7 (20.6) 7 (20.6) 1 (2.9)
Sexual abuse 1 (2.9) 2 (5.9) 1 (2.9) 1 (2.9) 2 (5.9) 1 (2.9)
Discrimination 3 (8.8) 0 4 (11.8) 3 (8.8) 7 (20.6) 4 (11.8)
Neglect 3 (8.8) 5 (14.7) 2 (5.9) 5 (14.7) 2 (5.9) 3 (8.8)
Witness to victimization 6 (17.6) 3 (8.8) 7 (20.6) 8 (23.5) 3 (8.8) 9 (26.5)
Total discrepancies 29 24 30 31 34 23

patients. Implications for research include a better understanding Forns, Soler & Plaellas, 2014); experiences assessed as highly
of the limitations and challenges of data obtained through self- negative are properly recalled, due to their distinctiveness and the
reports in this group, further clarifying the potential of self-reports physiological and behavioral reactions associated. And as they
as a data collection methodology. As for clinical practice, this may endanger life, their memory must remain consistent through
knowledge might allow the design of more targeted interventions time, in order to prevent their re-occurrence (Alexander et al.,
and preventive actions. Inconsistent reports raise questions about 2005; Spinhoven et al., 2012). Likewise, we also found that
the actual occurrence of victimization, compromising the success among the most prevalent experiences of victimization for each
of interventions targeted to address emotional issues related to this stage of the lifecycle, Kappa scores varied from poor to moderate.
experience, potentially compromising the success of treatments Although they were the most prevalent, generally, the prevalence
and care. Additional implications include the role of psychiatric rates of victimization were not high. And as mentioned earlier,
patients as witnesses, as mentioned in the Introduction. low prevalence rates of the attribute can lead to a reduced kappa
This study had a twofold aim. First, we aimed to discover the score, due to chance correction (Sim & Wright, 2005). This fact,
consistency of victimization reports of adult psychiatric patients. combined with the small sample size, may account for the general
We assessed the consistency of experiences occurred during levels of Kappa found in our sample. Results from percentage of
childhood, adolescence and adulthood, detailing the nature of the agreement showed that higher agreement was found in less
inconsistencies. We used Cohen’s kappa and percentage of prevalent experiences, reflecting a bias toward the agreement for
agreement to describe our results. We found lower kappa levels the nonoccurrence. As stated by Hardt and Rutter (2004),
had corresponding lower percentages of agreement, and higher psychiatric patients may be more consistent in reporting events
kappa levels had corresponding higher percentages of agreement that did not happened.
for childhood sexual abuse, adolescent witnessing to victimization Compared to childhood and adult victimization, reports of
and adult witnessing to victimization and sexual abuse. Childhood adolescent victimization had the lower kappa scores and
discrimination was the experience with the lower kappa score, but percentages of agreement. One possible explanation is presented
presented the highest percentage of agreement. The disagreement by Kremers and colleagues (2007). According to the authors,
between measures may be explained by the nature of the statistics individuals with a history of victimization may elaborate general
used. Cohen’s kappa is sensitive to the prevalence of the attribute, schemes of victimization events that allow them to remember that
that is, the presence of victimization, and corrects for chance a given victimization occurred, but may lead to difficulties
agreement (Sim & Wright, 2005); thus in the absence of remembering specific details. This is especially salient in
childhood discrimination at Time 2, kappa scores reflect an individuals that suffered from repeated victimization. Thus, the
absence of consistency. On the other hand, the high levels of memory concerning the occurrence of the victimization tends to
percentage of agreement reflect the agreement for the be more precise than the memory for its specific course:
nonoccurrence of childhood discrimination. The same applies to participants remember the victimization, but may not be able to
disagreement concerning adolescent experiences. Despite the fact correctly recall if it happened during childhood, adolescence or
that the same number of participants reported sexual abuse in adulthood (Hardt & Rutter, 2004; Peace et al., 2014; Quas,
adolescence in both Time 1 and 2, the low prevalence rates of this Alexander, Goodman, Ghetti, Edelstein & Redlich, 2010; van
experience (only one participant) may explain the low kappa Giezen et al., 2005).
score alongside with the high score for percentage of agreement. Examining the nature of the inconsistencies in our study, we
Despite the fact of Cohen’s kappa being sensitive to the found that participants made more omissions, decreasing the
prevalence of the attribute, some victimization experiences that number of victimization experiences reported at Time 1, except
had low prevalence rates had the higher Kappa scores, as for adolescent victimization, where they made the same amount
childhood and adulthood sexual abuse. This specific experience of omissions and commissions. According to Kringsley and
has been classified as one of the more serious forms of colleagues (2003), there is a tendency to increase the number of
victimization (Finkelhor, Ormrod & Turner, 2009; Kirchner, victimization experiences reported throughout repeated

© 2018 Scandinavian Psychological Associations and John Wiley & Sons Ltd
14679450, 2018, 3, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/sjop.12437 by Cochrane Portugal, Wiley Online Library on [10/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
^ C. Maia
316 C. S. Mesquita and A. Scand J Psychol 59 (2018)

assessments, which is contrary to our findings. Several factors Despite this limitation, it is noteworthy that some relevant studies
may have contributed for our results. Contextual factors may have in this field had samples similar in size (Fisher et al., 2011;
influenced the reports of victimization. According to Hard and Goodman et al., 1999; Paivio, 2001), thus providing this study
Rutter (2004), individuals tend to attribute meaning to their with value. Another limitation concerns the failure to control for
memories. It is possible that participants in our study were more additional victimization experiences that might have occurred
willing to report their victimization experiences at Time 1 because between assessments. It is possible that further victimization
of the context of assessment, the psychiatric hospital. By reporting occurred and might have been reported, increasing the
victimization, participants might have felt that their reports could inconsistency in our findings. In future studies, we will consider
account for their current symptoms, thus justifying their victimization that occurred during the time frame between
psychiatric care requirements (Fisher et al., 2011; Kremers et al., assessments. Furthermore, it is possible that the sensitive nature of
2007). Additionally, being in under psychiatric care might have the information required might have interfered with disclosure in
elicited feelings of distress, increasing the reports (Bonanno, Noll, either Time 1, 2 or both, especially if the perpetrator was a family
Putnam, O’Neill & Trickett, 2003). As Time 2 assessments were member or someone close to the participant (Goodman-Brown,
carried when patients were in their homes, and with a schedule Edelstein, Goodman, Jones & Gordon, 2003; Hegarty & Tafta,
they chose, they might have underreported, either because they did 2001; Ullman, 2002). According to Langeland and colleagues
not feel the need to justify their psychiatric care requirements, (2015), the quality of the reports of victimization may be
either because the assessment was made via telephone, leading to influenced not only by factors pertaining to memory, but also by
unwillingness to disclose (DiLillo, DeGue, Kras, Loreto-Colgan & reluctance in disclosing the experiences. Another limitation
Nash, 2006; Hobrook, Green & Krosnick, 2003; Pridemore, concerns the conditions in which assessment were made, which
Damphousse & Moore, 2005). Furthermore, with time, participants were not kept constant. Due to external constraints, namely rules
might minimize their experiences, no longer considering them as and procedures of each psychiatric institutions, we were not able
victimization, and failing to report them (Alexander et al., 2005). to conduct Time 2 assessments in the same setting as the Time 1
These hypotheses may explain the fact that adult experiences had assessment, leading to changes not only in the context of
the higher levels of omission. On the other hand, the lowest levels assessment (psychiatric hospital vs home) but also in the method
of commission concerning adult victimization may be justified by of assessment (in person vs via telephone). It is possible that both
the fact that these experiences were recent, and less prone to these changes may have played a role in the content of the
memory decay or incorrect recall (Fisher et al., 2011; Kremers, reports.
et al 2007; van Giezen et al., 2005). Despite these limitations, our work brings some novelty to the
Reports of adolescent victimization displayed the higher levels study of consistency of victimization reports. This study was
of commissions. The presence of general schemes for conducted with psychiatric patients, thought to be more
victimization might have led to a recollection of the victimization, vulnerable to memory errors and distortion due to psychiatric
failing to correctly locate the timing of its occurrence from one symptoms. We found acceptable levels of consistency suggesting
assessment to the other (Hardt & Rutter, 2004; Peace et al., 2014; that self-reports may be useful in ascertaining the occurrence of
Quas et al., 2010; van Giezen et al., 2005). Finally, childhood interpersonal victimiation in psychiatric patients. As symptoms of
experiences had the lower levels of omission. These experiences emotional distress predict discrepancies in victimization reports,
might have been repeatedly thought of and reported, thus particularly towards an increase in reporting, caution must be used
allowing the creation of a structured narrative, leading to more when considering the presence of victimization in this population
stable reports (Peace & Porter, 2004; van Giezen et al., 2005). (van Giezen et al., 2005). This has practical implications. At a
Our second goal aimed to test the role of changes on emotional clinical level, psychiatric patients with victimization require
distress, from Time 1 to Time 2, in predicting discrepancies on intervention to integrate these experiences. In order for the
the number of victimizations reported from Time 1 to Time 2, intervention to succeed, health care providers need to have
further detailing the role of commissions and omissions. We confidence in patients’ reports. It is important to make thorough
found that changes on emotional distress explained 18.6% of the and repeated assessments, through the use of different methods
variance in discrepancies. Changes towards an increase on (Peace & Porter, 2004), in order to prevent failure of interventions
emotional distress predicted an increase on report discrepancies (Ewing, Levy & Boamah-Wiafe, 2014; Neger & Prinz, 2015;
towards an increase in the number of victimizations reported. Waldmand-Levi, Finzi-Dottan & Waintraub, 2015), particularly
These findings met those from previous studies that found due to the fact that the prevalence of interpersonal victimization
changes on emotional distress to be related to inconsistencies in is high in this population (Fitzgerald, DeCastella, Filia, Benitez &
victimization reports in psychiatric patients (Fisher et al., 2011; Kulkarni, 2005; Horwitz et al., 2001; Meade, Kershaw, Hansen
Kremers et al., 2007; Paivio, 2001; Spinhoven et al., 2012; van & Sikkema, 2009; Scott, 2007; Silver, Arseneault, Langley, Caspi
Giezen et al., 2005), with a trend to increase the reporting of & Moffitt, 2005; Swanson, Swartz, Essock et al., 2002).
victimization over time (Fisher et al., 2011; Kremers et al., 2007; Implications at the legal level highlight the need for assessments
Paivio, 2001; Spinhoven et al., 2012; van Giezen et al., 2005). of the mental health of potential witnesses, as their reports of
This study has some limitations. The major limitations concern victimization may be influenced by symptoms of emotional
the number of dropouts in our sample, due mostly to the distress (Peace & Porter, 2004; van Giezen et al., 2005). The
impossibility of contacting participants for the second assessment. confidence in the reports provided by the witness impacts on
The size of the sample calls for caution in the interpretation of the conviction rates, further preventing additional victimization for
results, and further limits the extent of some statistical analyzes. the self and other potential victims.

© 2018 Scandinavian Psychological Associations and John Wiley & Sons Ltd
14679450, 2018, 3, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/sjop.12437 by Cochrane Portugal, Wiley Online Library on [10/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
Scand J Psychol 59 (2018) Victimization reports in psychiatric patients 317

Further studies are required in order to deepen the Goldberg, L. & Freyd, J. (2008). Self reports of potentially traumatic
understanding of factors affecting report consistency: experiences in an adult community sample: Gender differences and
test–retest stability of the items in a Brief Betrayal-Trauma Survey.
pharmacological treatments, specific mental disorders, perception
Journal of Trauma & Dissociation, 7, 39–63.
of safety to disclose, fear of retaliation. These factors may play a Goodman-Brown, T., Edelstein, R., Goodman, R., Jones, D. & Gordon, D.
direct role in explaining discrepant reports, or mediating/ (2003). Why children tell: A model of children’s disclosure of sexual
moderating the association between changes on emotional distress abuse. Child Abuse & Neglect, 27, 525–540.
and discrepancies on reports. Finally, it would be helpful to Goodman, L., Thompson, K., Weinfurt, K., Corl, S., Acker, P., Mueser,
K. et al. (1999). Reliability of reports of violent victimization and
question participants about their inconsistent reports, exploring
posttraumatic stress disorder among men and women with serious
their explanations for discrepancies. mental illness. Journal of Traumatic Stress, 12, 587–559.
Goodman, L., Salyers, M., Mueser, K., Rosenberg, S., Swartz, M.,
The authors state that there were no sources of grant or financial support. Essock, S. et al. (2001). Recent victimization in women and men with
severe mental illness: Prevalence and correlates. Journal of Traumatic
The authors state that they have no financial interests or potential conflict Stress, 14, 615–632.
of interests. Hardt, J. & Rutter, M. (2004). Validity of adult retrospective reports of
adverse childhood experiences: Review of the evidence. Journal of
Child Psychology and Psychiatry, 45, 260–273.
REFERENCES Hegarty, K. & Tafta, A. (2001). Overcoming the barriers to disclosure and
inquiry of partner abuse for women attending general practice.
Alexander, K., Quas, J., Goodman, G., Ghetti, S., Edlstein, R., Redlich, A.
Australian and New Zealand Journal of Public Health, 25, 433–437.
et al. (2005). Traumatic impact predicts long-term memory for
Hepp, U., Gamma, A., Milos, G., Eich, D., Adjacic-Gross, V., R€ ossler, W.
documented child sexual abuse. Psychological Science, 16, 33–40.
et al. (2006). Inconsistency in reporting potentially traumatic events.
Altman, D. (1991). Practical statistics for medical research. London:
British Journal of Psychiatry, 188, 278–283.
Chapman & Hall.
Hobrook, A., Green, M. & Krosnick, J. (2003). Telephone versus face-to-
Bonanno, G., Noll, J., Putnam, F., O’Neill, M. & Trickett, P. (2003).
face interviewing of national probability samples with long
Predicting the willingness to disclose childhood sexual abuse from
questionnaires: Comparisons of respondent satisficing and social
measures of repressive coping and dissociative tendencies. Child
desirability response bias. Public Opinion Quarterly, 67, 79–125.
Maltreatment, 8, 302–318.
Horwitz, A., Widom, C., McLaughlin, J. & White, H. (2001). The impact
Byrne, C., Hyman, I. & Scott, K. (2001). Comparison of memories for
of childhood abuse and neglect on adult mental health: a prospective
traumatic events and other experiences. Applied Cognitive Psychology,
study. Journal of Health and Social Behaviour, 42, 184–201.
15, S119–S133.
Kendal-Tackett, K. & Becker-Blease, K. (2004). The importance of
Cougle, J., Resnick, H. & Kilpatric, D. (2009). Does prior exposure to
retrospective findings in child maltreatment research. Child Abuse &
interpersonal violence increase risk of PTSD following subsequent
Neglect, 28, 723–727.
exposure? Behavior Research and Therapy, 47, 1012–1017.
Kirchner, T., Forns, M., Soler, L. & Plaellas, I. (2014). Post-traumatic
DiLillo, D., DeGue, S., Kras, A., Loreto-Colgan, A. & Nash, N. (2006).
stress problems among poly-victimizated Spanish youth: time effect of
Participant responses to retrospective surveys of child maltreatment:
past vs recent interpersonal victimization. Child Abuse & Neglect, 38,
Does mode of assessment matter? Violence and Victims, 21, 410–424.
1303–1312.
Dube, S., Williamson, D., Thompson, T., Felitti, V. & Anda, R. (2004).
Kottner, J., Audige, L., Brorson, S., Donner, A., Gajewski, B.,
Assessing the reliability of retrospective reports of adverse childhood
Hrobjartsson, A. et al. (2011). Guidelines for Reporting Reliability and
experiences among adult HMO members attending a primary care
Agreement Studies (GRRAS) were proposed. International Journal of
clinic. Child Abuse & Neglect, 28, 729–737.
Nursing Studies, 48, 661–671.
Elliot, D. & Briere, J. (1997). Posttraumatic stress associated with delayed
Kremers, I., van Giezen, A., van der Does, A., van Dyck, R. &
recall of sexual abuse: A general population study. Journal of
Spinhoven, P. (2007). Memory of childhood trauma before and after
Traumatic Stress, 8, 629–647.
long-term psychological treatment of borderline personality disorders.
Epstein, M. & Bottoms, B. (1998). Memories of childhood sexual abuse: a
Journal of Behavior Therapy and Experimental Psychiatry, 38, 1–10.
survey of young adults. Child Abuse & Neglect, 12, 1217–1238.
Kringsley, K., Gallagher, J., Weathers, F., Kulter, C. & Kaloupek, D.
Epstein, M. & Bottoms, B. (2002). Explaining the forgetting and recovery
(2003). Consistency of retrospective reporting about exposure to
of abuse and trauma memories: possible mechanisms. Child
traumatic events. Journal of Traumatic Stress, 16, 359–409.
Maltreatment, 7, 210–225.
Lalande, K. & Bonanno, G. (2011). Retrospective memory bias for the
Ewing, C., Levy, S. & Boamah-Wiafe, L. (2016). Attachment-based
frequency of potentially traumatic events: A prospective study.
family therapy within 13-year-old girl presenting with high risk for
Psychological Trauma-Theory Research Practice and Policy, 3, 165–
suicide. Journal of Marital and Family Therapy, 42, 91–105.
170.
Finkelhor, D., Ormrod, R. & Turner, H. (2009). Lifetime assessment of
Langeland, W., Smit, J., Rerckelbach, H., deVries, G., Hoogendorn, A. &
poly-victimization in a national sample of children and youth. Child
Draijes, N. (2015). Inconsistent retrospective self-report of childhood
Abuse & Neglect, 33, 403–411.
sexual abuse and their correlates in the general population. Social
Fisher, H., Craig, T., Fearon, P., Morgan, K., Dazzan, P., Lappin, J. et al.
Psychiatry and Psychiatric Epidemiology, 50, 603–612.
(2011). Reliability and comparability of psychosis patients:
McFarlane, A., Schrader, G., Bookless, C. & Browne, D. (2006).
Retrospective reports of childhood abuse. Schizophrenia Bulletin, 37,
Prevalence of victimization, posttraumatic stress disorder and violent
546–553.
behaviour in the seriously mentally ill. Australian and New Zealand
Fitzgerald, P., DeCastella, A., Filia, K., Benitez, J. & Kulkarni, J. (2005).
Journal of Psychiatry, 40, 1010–1015.
Victimization of patients with schizophrenia and related disorders.
Mckinney, C., Harris, T. & Caetano, R. (2004). Reliability of self-reported
Australia & New Zealand Journal of Psychiatry, 39, 169–174.
childhood physical abuse by adults and factors predictive of
Ghetti, S., Goodman, G., Eisen, M., Qin, J. & Davis, S. (2002).
inconsistent report. Violence and Victims, 24, 653–668.
Consistency in children’s reports of sexual and physical abuse. Child
Meade, C., Kershaw, T., Hansen, N. & Sikkema, K. (2009). Long-term
Abuse & Neglect, 26, 977–995.
correlates of childhood abuse among adults with severe mental illness:
Gisev, N., Bell, J. & Chen, T. (2013). Interrater agreement and interrater
Adult victimization, substance abuse, and HIV sexual risk behaviors.
reliability: Key concepts, approaches, and applications. Research in
AIDS Behavior, 13, 207–216.
Social and Administrative Pharmacy, 9, 330–338.

© 2018 Scandinavian Psychological Associations and John Wiley & Sons Ltd
14679450, 2018, 3, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/sjop.12437 by Cochrane Portugal, Wiley Online Library on [10/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
^ C. Maia
318 C. S. Mesquita and A. Scand J Psychol 59 (2018)

Mechanic, M., Resick, P. & Griffin, M. (1998). A comparison of normal Shaffer, A., Huston, L. & Egeland, B. (2008). Identification of child
forgetting, psychopathology and information–processing models of maltreatment using prospective and self-report methodologies: A
reported amnesia for recent trauma. Journal of Consultant and Clinical comparison of maltreatment incidence and relation to latter
Psychology, 66, 948–957. psychopathology. Child Abuse & Neglect, 32, 682–692.
Mueser, K., Salyers, M., Rosenberg, S., Goodman, L., Essock, S., Osher, Silver, E., Arseneault, L., Langley, J., Caspi, A. & Moffitt, T. (2005).
F. et al. (2004). Interpersonal trauma and posttraumatic stress disorder Mental disorder and violent victimization in a total birth cohort.
in patients with severe mental illness: demographic, clinical and health American Journal of Public Health, 95, 2016–2021.
correlates. Schizophrenia Bulletin, 30, 45–57. Sim, J. & Wright, C. (2005). The Kappa statistic in reliability studies:
Neger, E. & Prinz, R. (2015). Interventions to address parenting and Use, interpretation, and sample requirements. Physical Therapy, 85,
parental substance abuse: Conceptual and methodological 257–268.
considerations. Clinical Psychology Review, 39, 71–82. Spinhoven, P., Bamelis, L., Haringsma, R., Molendijk, M. & Arntz, A.
Odinot, G., Wolters, G. & van Giezen, A. (2013). Accuracy, confidence (2012). Consistency of reporting sexual and physical abuse during
and consistency in repeated recall of events. Psychology, Crime & psychological treatment of personality disorder: An explorative study.
Law, 19, 629–642. Journal of Behavior Therapy and Experimental Psychiatry, 43, 543–
Paivio, S. (2001). Stability of retrospective self-reports of child abuse and 550.
neglect before and after therapy for child abuse issues. Child Abuse & Swanson, J., Swartz, M., Essock, S., Osher, F., Wagner, H., Goodman, L.
Neglect, 25, 1053–1068. et al. (2002). The social-environmental context of violet behavior in
Peace, K. & Porter, S. (2004). A longitudinal investigation of the persons treated for severe mental illness. American Journal of Public
reliability of memories for trauma and other emotional experiences. Health, 92, 1523–1531.
Applied Cognitive Psychology, 18, 1143–1159. Ullman, S. (2002). Social reactions to child sexual disclosures: A critical
Peace, K., Shudra, R., Forrester, D., Kasper, R., Harder, J. & Porter, S. review. Journal of Child Sexual Abuse, 12, 89–121.
(2014). Tall tales across time: Narrative analysis of true and false van Giezen, A., Arensman, E., Spinhoven, P. & Wotters, G. (2005).
allegations. Journal of Investigative Psychology and Offender Consistency of memory for emotionally arousing events: A review of
Profiling, 12, 171–184. prospective and experimental studies. Clinical Psychology Review, 25,
Pridemore, W., Damphousse, K. & Moore, R. (2005). Obtaining sensitive 935–953.
information from a wary population: A comparison of telephone and Waldmand-Levi, A., Finzi-Dottan, R. & Waintraub, N. (2015).
face-to-face surveys of welfare recipients in the United States. Social Attachment security and parental perception of competence among
Science & Medicine, 61, 976–984. abused women in the shadow of PTSD and childhood exposure to
Quas, J., Alexander, K., Goodman, G., Ghetti, S., Edelstein, R. & Redlich, domestic violence. Journal of Child and Family Studies, 29, 57–65.
A. (2010). Long-term autobiographical memory for legal involvement:
Individual, and sociocontextual predictors. Cognitive Development, 25, Received 22 April 2017, accepted 23 January 2018
394–409.
Scott, S. (2007). Multiple traumatic experiences and the development of
posttraumatic stress disorder. Journal of Interpersonal Violence, 22,
932–938.

© 2018 Scandinavian Psychological Associations and John Wiley & Sons Ltd

You might also like