Professional Documents
Culture Documents
Paper 'Encuesta Sobre Videoconferencia' (Batastini 2019)
Paper 'Encuesta Sobre Videoconferencia' (Batastini 2019)
To cite this article: Ashley B. Batastini, Madison Pike, Megan A. Thoen, Ashley C. T. Jones, Riley
M. Davis & Esteisy Escalera (2019): Perceptions and use of videoconferencing in forensic mental
health assessments: A survey of evaluators and legal personnel, Psychology, Crime & Law, DOI:
10.1080/1068316X.2019.1708355
Article views: 26
Forensic mental health assessments (FMHA) are a specialized type of evaluation com-
pleted by qualified mental health professionals for purposes of providing necessary infor-
mation – typically to courts – to aid in making decisions related to various psycho-legal
issues (Heilbrun, 2001). FMHA may be useful in a number of civil and criminal contexts
including adjudicative competency, criminal responsibility, prediction of general and
sexual violence risk, child custody and parental fitness, and personal injury cases. Accord-
ing to current regulations, psychiatrists, licensed clinical and counseling psychologists,
CONTACT Ashley B. Batastini ashley.batastini@usm 118 College Drive, 5025, Hattiesburg, MS 39406, USA
Communication regarding this manuscript can be directed to Ashley B. Batastini, Ph.D., 118 College Drive, Hattiesburg,
Mississippi 39406, Ashley.batastini@usm.edu, 601-266-6479. Madison Pike graduated from USM in 2019 and is currently
a medical student at in the College of Osteopathic Medicine at William Carey University. Esteisy Escalera graduated from
TTU in 2019 and is now affiliated with Atlantis Health Services in El Paso. We thank Michael E. Lester and Alexandra Repke
for providing oversight on portions of this manuscript.
© 2019 Informa UK Limited, trading as Taylor & Francis Group
2 A. B. BATASTINI ET AL.
and, in some cases (e.g. child custody) social workers, qualify as forensic mental health care
professionals competent to perform FMHAs depending on the education and experience
required to address a particular question (Heilbrun, 2001).
person settings to include remote virtual technologies (Harley, 2006). The emerging field
of telemental health (often referred to as telepsychiatry or telepsychology depending on
the type of services provided) has been defined as, ‘using telecommunication modalities,
including teleconferencing software, hardware, and supporting infrastructure, to provide
mental health care’ (Deslich et al., 2013, p. 80). Prior research supports the assumption that
remote services can improve access to assessments and demonstrate cost efficiency
(Deslich et al., 2013). A 2007 study by O’Reilly et al., for example, found that the use of tele-
psychiatry drastically improved cost efficiency by alleviating extraneous costs like accom-
modation and travel expenses thus decreasing the average cost per visit by $50 a visit
(O’Reilly et al., 2007).
Because a number of rural areas have been federally designated as having a shortage of
mental health professionals (Gustafson, Preston, & Hudson, 2009), telemental health has
grown increasingly in recent years to address this need (Richardson, Frueh, Grubaugh,
Egede, & Elhai, 2009) and some statistics estimate 6% of all telehealth programs are
focused on mental health specifically (Aboujaoude, Salame, & Naim, 2015). In fact, it
was previously projected the integration of technology into mental health sectors
would be the largest expanding initiative by 2022 (Norcross, Pfund, & Prochaska, 2013).
Using telemental health services is especially useful as it offers greater accessibility to pro-
fessionals for rural consumers who, without this technology, would either not receive ser-
vices, spend time on waitlists for the few providers available in their area, or face increased
costs and lost wages for travel to distant offices or clinics. With FMHA, the benefits are
similar; the availability of remote options for FMHA may increase the likelihood that indi-
viduals will move more quickly through the judicial system without violations to their
rights or creating potential threats to public safety.
Often telemental health involves videoconferencing (VC; i.e. real-time, audiovisual tech-
nology) to connect the evaluee with a professional who is able to provide that specific
service even from miles away (Batastini, McDonald, & Morgan, 2013). While not extensive,
there have been a number of studies examining the use of VC in forensic contexts. A 2006
study concluded that provider ratings of psychological functioning assessed via VC were
reliably similar to ratings following in-person assessments (Lexcen, Hawk, Herrick, & Blank,
2006). Furthermore, research by Manguno-Mire et al. (2007) demonstrated high consist-
ency between competency decisions made via VC and in-person using the Georgia
Court Competency Test. In their 2016 meta-analysis, Batastini and colleagues found
small effect sizes suggesting that telepsychology outcomes including mental health symp-
toms, therapeutic processes, program engagement, program performance, and service
satisfaction were largely comparable to in-person for criminal justice and substance
abusing clients.
Despite potential benefits of telecommunications such as VC to FMHA, there remains
the question of whether and to what extent providers will embrace this technology in
their work. Given the increasing attention on remote technology in FMHA (e.g. Luxton
& Lexcen, 2018), there are likely a number of professionals who are already incorporating
VC, yet the extent to which it is being used and for what purposes is not known. In the
practice of telepsychology more generally, previous studies have observed different
factors that affect the probability of using VC to perform mental health assessments.
For example, length of time in the field and the amount of training using this type of tech-
nology have been found to significantly increase the probability that a professional will
4 A. B. BATASTINI ET AL.
use VC (Simms, Gibson, & O’Donnell, 2011). Another study conducted by Jameson and col-
leagues in 2011 sought to examine mental health care providers’ opinions on use of VC
through in-depth group interviews and surveys. This study found provider attitudes
toward VC was generally positive; however, they reported a lack of space, resources,
and training for VC use. How often and for what purposes VC was used in their practice
varied widely across providers, with pharmacological treatment being the most
common use. The authors proposed that more information on the technology could
help alleviate these worries (Jameson, Farmer, Head, Fortney, & Teal, 2011).
Hesitation from providers, including forensic evaluators, may be related to concerns
about the inability to properly observe important client behaviors that provide information
on interpersonal communication skills or how certain clients, such as older adults who may
be less familiar with technology or those who are experiencing persecutory delusions, will
respond (Batastini, King, Morgan, & McDaniel, 2016; Magaletta, Fagan, & Peyrot, 2000). In a
pilot study conducted by Magaletta and colleagues in 1998 within the Federal Bureau of
Prisons, psychiatrists and psychologists were questioned about their experience using VC.
Most respondents initially expressed some hesitation in using VC but agreed that their
fears were reduced over the course of its implementation. One provider, for example,
anticipated struggling to establish rapport with the inmate, but later admitted this
concern was unfounded (Magaletta, Fagan, & Ax, 1998). Despite resistance from providers,
several studies suggest that VC is generally well-received by forensic and correctional
clients (Brodey, Claypoole, Motto, Arias, & Goss, 2000; Magaletta et al., 1998).
Although VC is useful, previous research highlights the fact there are potential pro-
blems that need to be considered. A 2001 survey of psychologists’ satisfaction after in-
person therapy sessions versus VC therapy highlighted the most notable barrier was tech-
nical difficulties that sometimes led to delays in sessions; however, they noted these issues
were not extremely significant and were eventually resolved (Simpson, 2001). Some
researchers also have identified possible ethical and/or legal problems with telemental
health. For example, licensure and insurance coverage could become complicated if the
mental health care professional’s practice is in another state from where the client is
located, and mental health professionals working within a forensic or correctional
context should be aware of the specific protocols at the site where they are providing ser-
vices (Shore et al., 2018). Despite these issues, the benefits of VC appear to outweigh the
potential disadvantages, if appropriate steps are taken to ensure provider competency in
the use of designed technologies and adherence to proper data security and storage.
manner (either at all or in certain types of cases) and how they prepare for testimony. In
addition, too many open opportunities for attorneys to discredit VC could determine
whether courts offer VC as an option for conducting court-ordered evaluations. For
example, it is possible that a judge could rule an expert’s testimony subsequent to a
VC-derived evaluation as inadmissible for failing to meet the required standard of being
the ‘product of reliable principles and methods’ (Federal Rules of Evidence, 2017, Rule
702). Such a ruling may be even more likely if the evaluator experienced technical difficul-
ties during the interview or attempted to administer testing that could not be adequately
adapted remotely. In an inadmissibility ruling, the retaining attorney’s legal strategy and/
or the credibility of the evaluation could collapse.
Additionally, all evidence related to FMHA via VC must meet the Daubert Standard of
scientific validity – specifically,
(1) whether the theory or technique in question can be and has been tested; (2) whether it has
been subjected to peer review and publication; (3) its known or potential error rate; (4) the
existence and maintenance of standards controlling its operation; and (5) whether it has
attracted widespread acceptance within a relevant scientific community. (Daubert v. Merrell
Dow Pharmaceuticals Inc., 1993)
While the use of VC in FMHA could arguably meet these standards, some courts may dis-
agree. Until FMHA via VC can be viewed as meeting the requirements of the Federal Rules
of Evidence and the Daubert standard, it is possible that reports and any related testimony
could be deemed inadmissible. Because of the influence of these standards on the practice
of forensic mental health, the perceptions of legal professionals and forensic experts are
equally important for making informed decisions about the use of remote assessment
approaches.
was also expected that age would predict evaluators’ willingness to use VC for FMHAs.
Results of qualitative analyses were expected to reveal a mix of opinions regarding VC
for this purpose; however, it was generally anticipated that evaluators would feel more
positively about the ability of VC to mitigate court-related logistical barriers (e.g. wait
times), but express more concern related to actual assessment procedures. Knowing for-
ensic evaluators’ thoughts about telemental health will inform strategies to address poss-
ible problems with the technology or common areas of concern within the profession, as
well as highlight areas of service within forensic practice where this modality of assess-
ment is particularly useful. Provider perspectives may also help normalize the use of VC
and understanding how existing hesitancies toward VC can be overcome.
Using a similar design, Study 2 surveyed attorney and judges’ opinions on the advan-
tages and disadvantages, and potential legal challenges of the use of VC for conducting
FMHA. Similar to Study 1, we expected mixed responses, with legal personnel being gen-
erally less concerned about the use of VC to overcome systemic barriers and more con-
cerned over its viability in court. The purpose of Study 2 was to provide more
information, even if preliminary, for both forensic examiners and the legal community
regarding the potential advantages, disadvantages, and challenges to the use of telecom-
munication for forensic evaluations.
Study 1
Method
Participants
Participants were recruited from December 2017 to March 2018 through relevant pro-
fessional listservs and email list (e.g. Psych-Law List, membership list of the American Psy-
chology-Law Society), search-engine generated email lists of forensic psychologists and
psychiatrists, and personal contacts of the first and third authors. While the exact
number of professionals who were initially contacted for participation is unknown (i.e.
some listserv membership statistics were unavailable and the extent of overlap across
lists or number of inactive emails within lists cannot be feasibly determined), it is estimated
that the recruitment email was sent to at least several hundred forensic practitioners. The
AP-LS membership list alone, for example, includes over 1000 emails. Participants were eli-
gible if they practiced in the area of forensic mental health either as a psychologist (e.g.
counseling psychologist, clinical psychologist), psychiatrist, or doctoral-level trainee.
Because this study was focused on both use and perceptions of use, previous experience
using VC was not a requirement for participation.
After removing six participants due to missing data, the final sample for this survey
included 156 forensic mental health practitioners (including trainees) ranging from 23
to 75 years old (M = 49; SD = 14.42). Most participants identified as female (55.7%) and
Caucasian (94.3%). This sample primarily consisted of clinical psychologists (61.4%), but
other specialties such as counseling psychology (13.6%) and psychiatry (0.7%) were rep-
resented. A majority of the participants stated their highest degree obtained was a
Ph.D. (64.5%; 24.3% held a Psy.D.) and practiced within the United States (96.2%). Partici-
pants were also asked to state whether or not they were currently under the supervision of
a licensed psychologist. Out of the 20 respondents who responded to this item, 9
PSYCHOLOGY, CRIME & LAW 7
Materials
This survey was created using Qualtrics, an online surveying platform. The questionnaire
included both open and closed ended questions. For the purpose of this study, VC was
defined as the use of real-time audio/visual equipment to communicate with another
person or party over a distance. Participants were provided several examples of VC ser-
vices, including FaceTime, Skype, Microsoft Lync, Cisco WebEx, GoToMeeting, and
Polycom.
Participants were first asked: ‘Have you ever used telecommunications or videoconfer-
encing of any kind in the context of completing a forensic mental health evaluation?’ If a
participant responded yes, they were asked a series of questions about how often they use
VC to perform certain types of forensic assessments (e.g. risk assessments, adjudicative
competency evaluations, or child custody assessments). To assess the context in which
respondents typically used VC, participants were given a Likert-type scale ranging from
‘Never’ to ‘Always or Almost Always’ and asked to rate how often they used VC to
perform various types of forensic assessments. They also were given the option to
denote they did not perform this type of evaluation in their practice, so their answer
could be distinguished from someone who performed those assessments but does not
use VC to do so. Participants who endorsed using VC for a particular type of assessment
(s) were asked why they specifically chose to use VC in that context, how helpful they
thought this technology was, and if there were there any problems that occurred when
using this technology.
All participants, regardless of experience with VC, answered questions to rate their
perceptions about the ethicality, legality, usefulness, and validity of VC for FMHA, as
well as their willingness to use VC in future evaluations, on a 0–100 sliding scale. For
ethical and legal issues, lower scores indicated less concern (0 = not at all concerned;
100 = highly concerned); for usefulness, validity, and willingness, higher scores indicated
more positive perceptions (e.g. 0 = not at all valid, 100 = highly valid). Participants were
also asked to identify possible benefits and consequences of its use in FMHA using a
‘select all that apply’ response option. The lists of available options provided to partici-
pants (see Tables 3 and 4) across both studies were developed by the first and third
authors based largely on common advantages and disadvantages cited in the literature,
as well as anecdotal experience (e.g. informal discussions with other professionals). At
the end of the survey, participants were asked a series of de-identified demographic
questions such as their race/ethnicity, gender, age, and educational background, and
professional experience to assess whether certain demographic factors affect the use
or perceptions of VC.
Procedures
Approval was received from the review board for human subjects research at the Univer-
sity of Southern Mississippi. Those interested in participating were directed to the Qualtrics
questionnaire from the email recruitment announcement. Prior to completing the survey,
participants were informed about the study’s purpose, the voluntary nature of this
research, their right to withdraw from the survey, and available compensation. Those
who elected to continue with the study following informed consent were then directed
to the full questionnaire which took approximately 15 min to complete. Following study
completion, participants were given the option to enter a random drawing for the
chance to win one of six gift cards valued at either $25 or $50. Respondents who
wished to enter the drawing were redirected to another survey form in Qualtrics where
they could enter their contact information. This contact form was kept separate from
the questionnaires used for the actual research to protect anonymity.
Table 3. What do you think are, or could be, the main benefits (if any) of using videoconferencing in
forensic assessment (select all that apply)?
Possible benefits of videoconferencing Study 1 (N = 156) Study 2 (N = 27)
Frequency (%) Frequency (%)
Reduced costs for court or state 104 (66.7%) 20 (74.1%)
Reduced wait times for defendants 90 (57.7%) 25 (92.6%)
Reduced costs for defendant/evaluee 90 (57.7%) 23 (85.2%)
Improved safety for the evaluator 80 (51.3%) 16 (59.3%)
Reduced costs for the evaluator 61 (39.1%) 22 (81.5%)
Increased evaluator productivity 57 (36.5%) 12 (44.4%)
Quicker report times; easier to meet statutory deadlines 51 (32.8%) 17 (63.0%)
Other 30 (19.2%) —
Improved safety for the community 18 (11.5%) 6 (22.2%)
There are no benefits 5 (3.2%) 0 (0.0%)
Note: Study 1 is listed in order from most to least endorsed (reduced wait times and defendant costs were identical); Study
2 is listed in the same order as Study 1 for comparative purposes.
PSYCHOLOGY, CRIME & LAW 9
Table 4. What do you think are, or could be, the main consequences (if any) of using videoconferencing
in forensic assessment (select all that apply)?
Possible consequences of videoconferencing Study 1 (N = 156) Study 2 (N = 27)
Frequency (%) Frequency (%)
Inability to properly administer some measures 133 (85.3%) 15 (55.6%)
Risk of technical difficulties 127 (81.4%) 26 (96.3%)
Loss of important behavioral data 124 (79.5%) 17 (63.0%)
Difficulty establishing rapport 120 (76.9%) 24 (88.9%)
Risk of confidentiality breach 110 (70.5%) 17 (63.0%)
Other 21 (13.5%) —
Evaluator burnout 8 (5.1%) 2 (7.4%)
Higher costs for the court 8 (5.1%) 1 (3.7%)
Higher costs for the evaluator 8 (5.1%) 0 (0.0%)
Higher costs for defendant/evaluee 3 (1.9%) 0 (0.0%)
There are no consequences 0 (0.0%) 0 (0.0%)
Note: Study 1 is listed in order from most to least endorsed; Study 2 is listed in the same order as Study 1 for comparative
purposes.
Results
Quantitative results
First, frequencies and percentages were used to determine the proportion of participants
who reported using VC for FMHA purposes and to summarize the most frequently
endorsed benefits and negative consequences providers anticipated regarding VC use.
To test the hypothesis that examiners who previously used VC to conduct FMHAs
would have fewer concerns related to its legality, ethics, usefulness, and validity than
those who had not used VC, a one-way MANOVA was conducted. For this analysis, prior
VC use (yes or no) was used as the independent variable with legality, ethics, usefulness,
and validity as the combined dependent variables. A linear regression was used to test the
hypothesis that younger examiners would be more willing to use VC than older examiners.
10 A. B. BATASTINI ET AL.
For this analysis, practitioner age (measured continuously) served as the predictor variable
and willingness to use VC in the future was the predicted outcome.
p = .001, g = 0.64). This suggests that individuals who had experience conducting FMHAs
via VC believed expert opinions were more valid than individuals with no VC experience.
Given these mixed univariate results, the hypothesis that VC use would be associated with
more positive perceptions about such practices was partially supported.
Qualitative results
To aggregate general themes of concern regarding VC use to conduct FMHA, a word fre-
quency analysis was first conducted using NVivo software. Of the 156 participants included
in the above analyses, 124 provided qualitative descriptions of their concerns. The word
frequency analysis revealed four overarching themes in responses, including barriers to
accurate observations during FMHA (n = 25; 20%), administering standardized psychologi-
cal testing (n = 25; 20%), building rapport (n = 21; 16.9%), and maintaining confidentiality
(n = 16; 12.9%). In addition to a word frequency analysis, participant responses and
response-fragments were organized into more detailed, telling categories to provide a
richer understanding of these concerns. Most concerns reported by participants fit into
nine major categories: restricted assessment (n = 76; 61.3%), security and privacy (n =
60; 48.4%), technology concerns (n = 26; 21%), rapport (n = 22; 17.7%), insufficient
data (n = 21; 16.9%), control over the environment or evaluation (n = 16; 12.9%), tradition
(n = 13; 10.5%), ethical concerns (n = 10; 8.1%), and admissibility in court (n = 8; 6.5%).
Restricted assessment. A large number of participants (n = 76; 61.3%) felt their assessment
of the client would be limited. Subcategories of restricted assessment emerged, such that
56 participants cited either the restricted use of psychological assessments (n = 28; 22.6%)
and/or restricted behavioral or nonverbal observations (n = 28; 22.6%) as specifically pro-
blematic. Participants also reported potential difficulties observing less obvious symptoms,
drawing a complete picture of the individual, completing thorough mental or physical
status exams, and the risk of misinterpretation or misunderstanding. Frequently used
examples of data lost included visual (e.g. because the entire person is not in camera
view), interpersonal (e.g. cannot see the person interact with correctional or hospital
staff), and olfactory information (e.g. unable to assess the person’s hygiene using smell;
‘loss of sensory data, including – literally – how the person smells’).
Security and privacy. Sixty participants (48.4%) reported concerns over security or privacy
when using VC. Responses included being unable to confirm the evaluee’s identity (e.g.
‘accurately identify the individual on the other end of the video link’), the fallibility of
the computer or Internet being used to conduct the FMHA (e.g. ‘security issues with poten-
tial unsecured browsers’), and the unknowing involvement or influence of correctional
staff or legal parties in the assessment (a situation that would be hard to manage if the
12 A. B. BATASTINI ET AL.
evaluator is obstructed in their view of the room, e.g. ‘ensure that the interviewee is not
being influenced by persons out of camera range’).
Rapport. Some participants cited that VC posed a threat to rapport (n = 22; 17.7%), with
most concerns stating that ‘rapport would be more difficult to establish.’ Others indicated
that interpersonal components to the assessment, such as a working relationship or the
sense of a personal presence, also would be hindered by the remote nature of VC.
Insufficient data. Separate from concerns about restricted assessment, insufficient data
refers to a more general concern of not having enough data in general to conduct a
quality assessment or make any conclusions regarding the assessment (e.g. ‘less than ade-
quate data,’ ‘you cannot tell what you have missed by using [VC], so you risk an insufficient
evaluation’). A total of 21 respondents (16.9%) provided concerns falling within this theme.
Tradition. When prompted to discuss concerns about VC use, some participants opted to
describe reasons why they believed it is not widely used (N = 13; 10.5%). Although these
responses did not directly answer the question, they alluded to perceptions or attitudes
held by professionals that, rightfully so or not, discouraged the regular application of
VC in FMHA. This category was labeled ‘Tradition’ because the sentiment of many
responses in this unique (and unanticipated) category suggested that professionals’
sense of consistency and tradition is what decides whether VC is used more frequently.
An example response that reflects this sentiment was, ‘culture where in person is deter-
mined to be superior.’ The sentiment that psychology as a field has unofficially agreed
in-person evaluations are the only correct way to conduct evaluations, was echoed by
others who likewise cited a preference for in-person without providing any tangible con-
cerns for why VC use is problematic: ‘the need to be face to face and real time’ and ‘the loss
of an “experiential” aspect of an assessment.’ One outlying response appeared to
PSYCHOLOGY, CRIME & LAW 13
discourage VC use for FMHA altogether, citing pressure from the industry as the reason for
adopting what this participant felt was an unethical practice: ‘it seems like succumbing to
the bureaucratic demands of the containment industry. There are ethics issues involving
all our aspirational principles.’ Constituting about 10% of qualitative responses, ‘Tradition’
appeared to be a fringe category; however, these responses provided a unique perspec-
tive that suggest some professionals may be firmly reluctant to adopt VC no matter the
potential benefits and that tradition or what ‘feels right’ may be a more powerful predictor
of VC use than empirical findings supporting its use.
Other ethical concerns. Other ethical issues besides privacy and confidentiality also
emerged as reasons to avoid (or in some cases, engage) in VC use for FMHA (N = 10;
8.1%). Several responses in this category mentioned potential problems providing
informed consent remotely (e.g. ‘clearly obtaining consent’). Other responses reflected a
lack of ethical guidance as a reason for not using VC (e.g. ‘there need to be established
ethics and best practice procedures before I would consider it’), while only one participant
believed VC contradicted specific aspects of the relevant ethics codes. Several other
responses explicitly mentioned the APA Ethics Code as allowing for such a practice
under certain circumstances (e.g. ‘I think it is often well within ethical practice … but
only in circumstances where the quality of the evaluation does not suffer,’ ‘because the
defendant would otherwise have to wait months I believe that the beneficence, nonma-
leficence, and autonomy principles outweigh the reliability issue’).
Admissibility in court. The last, and least cited, concern with VC use in FMHA were related
to legal challenges (N = 8; 6.5%). Most responses in this category focused on evidence
admissibility (e.g. ‘admissibility in court,’ ‘Daubert challenge’); however, some clinicians
expressed concerns that VC may not follow legal standards (e.g. ‘compliance with relevant
legal standards,’ ‘interaction with rules of evidence’). Still others alluded to the possibility
that an assessment conducted using VC, although admissible and ethical, may face more
challenges during direct and cross-examination than an in-person assessment would (e.g.
‘it provides more avenues for the opposing side to take things out of context’).
Taken together, our general hypothesis that practitioners would be able to appreciate
the practical applications of VC in reducing barriers associated with the legal process
(financial, logistical) but express more concern about their ability to actually conduct
the assessment via VC was largely supported.
Discussion
Nearly one-third of forensic clinicians surveyed reported using VC in conducting a FMHA at
least once. VC was most often used in the prediction of future violence, followed by adju-
dicative competency assessments. When examining participants’ perceived benefits of VC,
reduced costs for courts was the commonly cited advantage. This result makes sense
based on previous research showing that the use of VC to provide services is more cost
effective than in-person in many settings (Deslich et al., 2013; Egede et al., 2009) and
FMHAs are often paid for by the court. However, as expected and consistent with research
on provider perceptions (e.g. Magaletta et al., 1998; Simms et al., 2011), many expressed
concerns regarding VC use. Thus, while providers understand the potential benefits
14 A. B. BATASTINI ET AL.
regarding productivity and cost effectiveness of VC, many were concerned about technical
problems that could potentially make their job more difficult as well as the consequences
of not being in the same room as the examinee, such as the inability to properly administer
some measures or fully capture relevant data.
It makes sense that mental health professionals, who are primarily trained to deliver ser-
vices in in-person settings – training that emphasizes rapport-building – would have fears
about interpersonal connectedness or losing relevant information during a remote assess-
ment. The perception that assessment administration may be hindered with the use of VC
could explain why clinicians had more moderate ratings regarding the validity of FMHA
performed via VC. The majority of participants also felt there could be some ethical or
legal issues with the use of VC in FMHA. However, it appears that concern about the val-
idity of a VC evaluation may be mitigated to some extent by experience. Furthermore,
while not statistically significantly different, those with experience tended to rate the ethi-
cality and legality of VC in FMHA more favorably than those without. Together, this pattern
of findings suggests that prior use of VC may in fact reduce hesitations. Younger age (or
perhaps generation) may also mitigate concerns about using VC, as it explained a signifi-
cant portion the variance in practitioners’ willingness to use VC in FMHA. It is possible that
age serves as a proxy for technology discomfort or skepticism, with older or later gener-
ation psychologists, who may not have ‘grown up’ in such a technology-fueled society,
feeling more committed to traditional in-person approaches.
Study 2
It was generally expected that similar patterns of concerns and benefits expressed by eva-
luators in Study 1 would be found with legal personnel for Study 2; however, more explicit
a priori hypotheses regarding these perceptions were not made given the limited litera-
ture on which to base any hypotheses.
Method
Participants
For Study 2, participants were eligible if they were at least 18 years of age and currently or
previously licensed to practice law in the United States. Survey recruitment was completed
primarily via snowball sampling, with an online survey (housed on the online REDCap
survey platform) being sent to various listservs with members who are judges or
lawyers. Recipients were also requested to pass the recruitment message to other attor-
neys/judges possibly interested in participating. Eighty listservs were contacted by
email or via the organization’s webpage. Of those, five responded they do not disseminate
research requests via their listservs, two confirmed they would post the request, and no
response was received from the other contacted organizations. Therefore, as with Study
1, we are unable to know how many people actually received the survey and therefore
cannot calculate an accurate response rate.
A total of 27 participants completed the survey; an additional 12 people accessed the
survey, but did not complete any questions. The mean age of the sample was 45.56 years
(SD = 11.54) and had been practicing law an average of 19 years (SD = 12.53). Of the total
respondents, 25 indicated their legal role (2 did not respond to this item), and only 16
PSYCHOLOGY, CRIME & LAW 15
indicated their type of law practiced. Of the types of law practiced, 5 participants practiced
criminal law, 7 civil law or litigation, and 4 family law. All participants were from the U.S.,
with the majority of participants from Oregon (8; 29.6%), Texas (6; 22.2%) and Florida (4;
14.8%). Additional demographics can be found in Table 1.
Results
Given the smaller sample size of Study 2, results presented below are descriptive in nature
and should be considered preliminary. It also should be noted that, because four partici-
pants did not indicate their legal role, two indicated their role to be that of law faculty (i.e.
neither an attorney or judge), and not every respondent answered the question regarding
the validity of conclusions from FMHA conducted via VC, the total sample size across out-
comes varies. These varying response rates are specified in-text and in Table 5 for each
question and legal role when applicable.
Table 5. Study 2: responses to survey questions related to admissibility and validity of evidence
gathered via FMHA.
Survey Question M (SD) Min Max
On a scale of 0 (Not at all willing) to 100 (Highly willing), how willing are you to accept as evidence results of a FMHA that
was conducted by VC?
Total (N = 27) 53.11 (29.08) 1 100
Judges (n = 2) 86.00 (8.49) 80 92
Attorneys (n = 21) 47.57 (28.73) 1 100
On a scale of 0 (Not at all likely) to 100 (Highly likely), how likely do you think there may be legal issues raised related to the
use of VC to conduct FHMA?
Total (N = 27) 73.30 (23.22) 3 100
Judges (n = 2) 21.50 (26.16) 3 40
Attorneys (n = 21) 77.81 (18.70) 38 100
On a scale of 0 (Not at all valid) to 100 (Highly valid), how valid to you think the conclusions drawn from the FMHA
conducted over VC tend to be?
Total (N = 25) 57.52 (24.41) 10 95
Judges (n = 2) 72.50 (10.61) 65 80
Attorneys (n = 19) 51.58 (23.95) 10 90
Notes: FMHA = forensic mental health assessment, VC = videoconferencing. Judge and attorney subtotals do not equal the
total sample because some participants did not indicate their legal role and several indicated they were law faculty. Two
respondents did not answer the item regarding validity of conclusions.
16 A. B. BATASTINI ET AL.
Discussion
Very few responses were received overall for Study 2, and of the 27 respondents, only 2
were judges. Thus, any firm conclusions about the opinions of legal personnel or
whether attorneys and judges differ in a meaningful way are limited. Given the low
return on our initial recruitment procedures, attorneys and judges appear to be a
difficult sample from which to collect data. Additional recruitment methods, including
mailed surveys, attending professional conferences or meetings of legal personnel, or
increasing opportunities for compensation beyong what was offered in the present
study, should be considered in the future to reach this population.
While more data is clearly needed to fully understand the opinions of attorneys and
judges, and why judges may be more amendable to the use of VC than attorneys,
results of this preliminary survey were generally consistent with the opinions of evalua-
tors, such that many expressed rather negative views without having much first-hand
PSYCHOLOGY, CRIME & LAW 17
experience. Future research should also examine whether and how these apparent
biases can be reduced. With more data on the legal perspectives of VC for FMHA
and how those perspectives can better align with existing research, jurisdictions in
rural or lower-income areas may be more likely to request a needed evaluation,
instead of opting to dismiss criminal charges or offer quick plea agreements when an
in-person forensic assessment would be burdensome (due to the cost, unavailability
of an examiner, etc.), thus improving treatment opportunities and justice outcomes
for defendants.
General discussion
This research sheds light on the opinions of forensic mental health care professionals
regarding use of VC for assessment purposes, as well as the acceptability within the
legal profession. While use of VC has been discussed in the context of FMHA and correc-
tional settings (see Batastini et al., 2013), no research has specifically surveyed clinicians or
legal professionals on the use and perceptions of this type of technology across various
FMHA purposes making this study the first of its kind. This research allows for a better
understanding of the extent to which actual experts use this technology and how they
view it, and this understanding is vital in determining ways to improve this technology
and its viability in practice. Results from this survey suggest that VC is used relatively infre-
quently, with just over one-third of participants in Study 1 indicating prior use and only
one participant in Study 2 being exposed to VC for FMHA. Further, many participants
felt VC could offer practical benefits (namely cost-effectiveness and reduced wait times
for defendants) that warrant further exploration of this technology and the possibility of
increased use for FMHA.
While these surveys offer several important insights into how forensic mental health
care and legal professionals use and perceive using VC to perform FMHA, there are
certain limitations that should be considered. First, data was obtained based on the
opinions of the participants and not on actual outcomes associated with VC for FMHA pur-
poses. Participant opinions were most likely influenced by personal biases and not, for
example, on findings from empirical studies showing that VC is general comparable to
in-person, even in FMHA (e.g. competency to stand trial; Manguno-Mire et al., 2007). It
could be the case that participants’ perceptions would have been more favorable
toward VC if they were exposed to existing research supporting its use in the provision
of both general and forensic mental health services.
Further, many practitioners may not be aware that practice guidelines already exist
regarding telepsychology more generally (see APA, 2013). These guidelines and other
scholarly commentary offer recommendations on issues of most concern to the present
sample. For example, Luxton, Pruitt, and Osenbach (2014) speak directly to best practices
for remote administration of psychological tests. More recently, Luxton et al. (2019) out-
lined findings, challenges, and recommendations for use of VC in pretrial assessments
of competency to stand trial. Future studies may consider examining the effects of training
and education (e.g. exposing participants to research findings or a brief training session)
on perceptions of VC in FMHA. The idea that training opportunities and exposure to VC
increase positive perceptions of VC is consistent with the recommendations of Simms
et al. (2011) following their study of provider perceptions.
18 A. B. BATASTINI ET AL.
Secondly, while a wide range of recruitment outlets was intentional to avoid a demo-
graphically-skewed sample, these studies were not racially diverse, with 94.2% of partici-
pants identifying as Caucasian in Study 1 and 84.6% in Study 2. However, a 2018 survey by
the APA found that, while the number of racial/ethnic minorities entering the psychology
workforce is increasing, 84% of practicing psychologists identify as Caucasian (Lin, Stamm,
& Christidis, 2018). Furthermore, approximately 71% of U.S. district court judges (McMillion,
2017) and 85% of lawyers (American Bar Association, 2018) are Caucasian. Therefore, while
the racial demographics of the present samples were not representative of the general
population, they do appear representative of their respective fields. It is possible that
the subfield of forensic psychology is even more discrepant. A majority (62.3%) of the
respondents in Study 1 also classified themselves as psychologists; therefore, the opinions
of forensic psychiatrists were significantly underrepresented in this study. Given the
general acceptance of VC in the medical field, including for the purpose of psychiatric con-
sultation, psychiatrists may be more open to the idea of incorporating VC into their foren-
sic practice.
Third, these studies simply surveyed use and perceptions and did not empirically
examine whether FMHA conducted via VC is comparable to the traditional in-person
approach. To date, there is limited research on the actual reliability and validity of
FMHA across VC and in-person. Therefore, further research in greatly needed to better
support VC as a viable option for this purpose, as well as to develop best practices to
reduce barriers and identify the types of examinees and/or psycho-legal questions VC
may be most appropriate. To better understand for whom VC is helpful (or not) and
under what circumstances, future evaluations of VC implementation for FMHA purposes
should also include measures of service and technology satisfaction from the perspective
of defendants, evaluators, and attorneys. This line of research is important considering that
assessment validity and proper test administration appear to be major areas of concern for
forensic mental health care professionals, especially those without experience using VC.
Additional research and established guidelines may get more forensic evaluators on
board with the idea of incorporating VC into their practice.
Lastly, and specific to Study 2, the attempts made to gather opinions from attorneys
and judges with little success highlights the challenges in getting legal professionals to
engage in the research process and share their opinions and experiences – information
that is integral to informing and improving the practice of forensic mental health. As
legal personnel will ultimately be the ones to address issues of admissibility of VC for
FMHA or challenge expert credibility based on such evaluations, their perceptions are
highly relevant to the adoption of VC in legal contexts. While we recognize that
different or more effortful recruitment mechanisms for these professionals are likely
needed to ensure adequate response rates, including better compensation, it is also poss-
ible that legal professionals see less value in participating in research opportunities or have
difficulty prioritizing their time for these purposes. We hope, at a minimum, this study will
encourage legal personnel to respond to future solicitations for their opinions.
Conclusion
It is imperative to find different ways to broaden access to forensic mental health assess-
ments due to the large demand for these assessments and shortage of providers. One
PSYCHOLOGY, CRIME & LAW 19
option is the use of VC. These studies show that forensic evaluators and legal personnel
were able to see various possible benefits to using VC, particularly cost benefits and
reduced wait times for evaluations. Conversely, practitioners and legal personnel also,
rightfully, recognized potential problems that could arise when using VC, including tech-
nical difficulties, barriers to administering some assessment measures, and concern
regarding confidentiality. While participants as a whole viewed VC as a somewhat valid,
ethical, and legal method for performing psycho-legal assessments, there remained
some skepticism. However, it is possible that forensic clinician’s may overcome some of
their concerns with greater exposure to technology in FMHA. More research on how to
increase forensic mental health evaluators’ openness to using VC and legal personnel’s
acceptance of results from these assessments, as well as more empirical research on the
reliability and validity of this method compared to in-person, is needed before advocating
for more widespread use in forensic practice settings. Nonetheless, this study shows that
many forensic evaluators and legal personnel are open to the idea of VC. A greater accep-
tance of this technology may substantially improve access to quality forensic mental
health professionals and, subsequently, improve the timely administration of justice.
Note
1. Hedge’s g was used to account for the unequal sample size between those who used VC
before and those who did not. Hedge’s g is interpreted the same way as Cohen’s d. In all com-
parisons, prior use served as the reference group, so negative signs indicate perceptions of this
group were rated lower.
Disclosure statement
No potential conflict of interest was reported by the authors.
References
Aboujaoude, E., Salame, W., & Naim, L. (2015). Telemental health: A status update. World Psychiatry, 14
(2), 223–230. doi:10.1002/wps.20218
American Bar Association. (2018). ABA national lawyer population survey: 10-year trend in lawyer
demographics. Retrieved from https://www.americanbar.org/content/dam/aba/administrative/
market_research/National_Lawyer_Population_Demographics_2008-2018.pdf
American Psychological Association. (2013). Guidelines for the practice of telepsychology. American
Psychologist, 68(9), 791–800. doi:10.1037/a0035001
Antonacci, D. J., Bloch, R. M., Saeed, S. A., Yildirim, Y., & Talley, J. (2008). Empirical evidence on the use
and effectiveness of telepsychiatry via videoconferencing: Implications for forensic and correc-
tional psychiatry. Behavioral Sciences & the Law, 26(3), 253–269. doi:10.1002/bsl.812
Barbovschi, M., Macháčková, H., & Ólafsson, K. (2015). Underage use of social network sites: It’s about
friends. CyberPsychology, Behavior & Social Networking, 18(6), 328–332. doi:10.1089/cyber.2014.
0553
Batastini, A. B., King, C. M., Morgan, R. D., & McDaniel, B. (2016). Telepsychological services with crim-
inal justice and substance abuse clients: A systematic review and meta-analysis. Psychological
Services, 13(1), 20–30. doi:10.1037/ser0000042
Batastini, A., McDonald, B. R., & Morgan, R. D. (2013). Videoteleconferencing in forensic and correctional
practice. In K. Myers, & C. Turvey (Eds.), Telemental health: Clinical, technical, and administrative foun-
dations for evidence-based practice (pp. 251–271). doi:10.1016/b978-0-12-416048-4.00013-0
20 A. B. BATASTINI ET AL.
Brodey, B. B., Claypoole, K. H., Motto, J., Arias, R. G., & Goss, R. (2000). Satisfaction of forensic psychia-
tric patients with remote telepsychiatric evaluation. Psychiatric Services, 51, 1305–1307. doi:10.
1176/appi.ps.51.10.1305
Daubert v. Merrell Dow Pharmaceuticals Inc., 509 U.S. 579. (1993). doi:10.4135/9781483365817.n374
Deslich, S. A., Thistlethwaite, T., & Coustasse, A. (2013). Telepsychiatry in correctional facilities: Using
technology to improve access and decrease costs of mental health care in underserved popu-
lations [Electronic version]. Permanente Journal, 17(3), 80–86. doi:10.7812/TPP/12-123
Downard, W. (2018, March 17). Defendants with mental illness suffer long waits for justice. Retrieved
from https://www.usnews.com/news/best-states/mississippi/articles/2018-03-17/defendants-
with-mental-illness-suffer-long-waits-for-justice
Egede, L. E., Frueh, C. B., Richardson, L. K., Acierno, R., Mauldin, P. D., Knapp, R. G., & Lejuez, C. (2009).
Rationale and design: Telepsychology service delivery for depressed elderly veterans. Trials, 10(1),
22. doi:10.1186/1745-6215-10-22
Federal Rules of Evidence. (2017). Testimony by expert witnesses. Article VII, Rule 702. Retrieved from
https://www.uscourts.gov/sites/default/files/evidence-rules-procedure-dec2017_0.pdf
Gustafson, D. T., Preston, K., & Hudson, J. (2009). Mental health: Overlooked and disregarded in rural
America. Center for Rural Affairs Series (4), 1–5. Retrieved from http://files.cfra.org/pdf/Mental-
Health-Overlooked-and-Disregarded-in-Rural-America.pdf
Harley, J. (2006). Economic evaluation of a tertiary telepsychiatry service to an island. Journal of
Telemedicine and Telecare, 12(7), 354–357. doi:10.1258/135763306778682378
Heilbrun, K. (2001). Principles of forensic mental health assessment (Vol. 12). New York, NY: Springer
Science & Business Media.
Jameson, J. P., Farmer, M. S., Head, K. J., Fortney, J., & Teal, C. (2011). VA community mental health
service providers’ utilization of and attitudes toward telemental health care: The gatekeeper’s per-
spective [Electronic version]. The Journal of Rural Health, 27(4), 425–432. doi:10.1111/j.1748-0361.
2011.00364.x
Lexcen, F. J., Hawk, G. L., Herrick, S., & Blank, M. B. (2006). Use of video conferencing for psychiatric
and forensic evaluations [Electronic version]. Psychiatric Services, 57(5), 713–715. doi:10.1176/ps.
2006.57.5.713
Lin, L., Stamm, K., & Christidis, P. (2018). 2007–16: Demographics of the U.S. psychological workforce.
Retrieved from https://www.apa.org/workforce/publications/16-demographics/index
Luxton, D. D., & Lexcen, F. J. (2018). Forensic competency evaluations via videoconferencing: A feasi-
bility review and best practice recommendations. Professional Psychology: Research and Practice,
49(2), 124–131. doi:10.1037/pro0000179
Luxton, D. D., Lexcen, F. J., & McIntyre, K. A. (2019). Forensic competency assessment with digital
technologies. Current Psychiatry Reports, 21(60). doi:10.1007/s11920-019-1037-9
Luxton, D. D., Pruitt, L. D., & Osenbach, J. E. (2014). Best practices for remote psychological assessment
via telehealth technologies. Professional Psychology: Research & Practice, 45(1), 27–35. doi:10.1037/
a0034547
Magaletta, P. R., Fagan, T. J., & Ax, R. K. (1998). Advancing psychology services through telehealth in
the federal bureau of prisons. Professional Psychology: Research and Practice, 29, 543–548. doi:10.
1037/0735-7028.29.6.543
Magaletta, P. R., Fagan, T. J., & Peyrot, M. F. (2000). Telehealth in the federal bureau of prisons:
Inmates’ perceptions. Professional Psychology: Research and Practice, 31, 497–502. doi:10.1037/
0735-7028.31.5.497
Manguno-Mire, G. M., Thompson, J. W., Shore, J. H., Croy, C. D., Artecona, J. F., & Pickering, J. W. (2007).
The use of telemedicine to evaluate competency to stand trial: A preliminary
randomized controlled study. Journal of the American Academy of Psychiatry and the Law
Online, 35(4), 481–489.
McMillion, B. J. (2017). U.S. Circuit and district court judges: Profile of select characteristics (Report No.
R43426). Washington, DC: Congressional Research Service. Retrieved from https://fas.org/sgp/crs/
misc/R43426.pdf
Norcross, J. C., Pfund, R. A., & Prochaska, J. O. (2013). Psychotherapy in 2022: A delphi poll on its
future. Professional Psychology: Research and Practice. doi:10.1037/a0034633
PSYCHOLOGY, CRIME & LAW 21
O’Reilly, R., Bishop, J., Maddox, K., Hutchinson, L., Fisman, M., & Takhar, J. (2007). Is telepsychiatry
equivalent to face-to-face psychiatry? Results from a randomized controlled equivalence trial.
Psychiatric Services, 58(6), 836–843. doi:10.1176/ps.2007.58.6.836
Richardson, L. K., Frueh, C. B., Grubaugh, A. L., Egede, L., & Elhai, J. D. (2009). Current directions in
videoconferencing tele-mental health research. Clinical Psychology: Science and Practice, 16(3),
323–338. doi:10.1111/j.1468-2850.2009.01170.x
Ryba, N. L., Cooper, V. G., & Zapf, P. A. (2003). Juvenile competence to stand trial evaluations: A survey
of current practices and test usage among psychologists. Professional Psychology: Research and
Practice, 34(5), 499–507. doi:10.1037/0735-7028.34.5.499
Schopp, L., Johnstone, B., & Merrell, D. (2000). Telehealth and neuropsychological assessment: New
opportunities for psychologists. Professional Psychology: Research and Practice, 31(2), 179–183.
doi:10.1037/0735-7028.31.2.179
Shore, J. H., Yellowlees, P., Caudill, R., Johnston, B., Turvey, C., Mishkind, M., … Hilty, D. (2018). Best
practices in videoconferencing-based telemental health April 2018. Telemedicine and e-Health,
24(11), 827–832. doi:10.1089/tmj.2018.0237
Simms, D. C., Gibson, K., & O’Donnell, S. (2011). To use or not to use: Clinicians’ perceptions of tele-
mental health [Electronic version]. Canadian Psychology, 52(1), 41–51. doi:10.1037/a0022275
Simpson, S. (2001). The provision of a telepsychology service to shetland: Client and therapist satis-
faction and the ability to develop a therapeutic alliance. Journal of Telemedicine and Telecare, 7(1),
34–36. doi:10.1177/1357633X010070S114
Thomas, K. C., Ellis, A. R., Konrad, T. R., Holzer, C. E., & Morrissey, J. P. (2009). County-level estimates of
mental health professional shortage in the United States. Psychiatric Services, 60(10), 1323–1328.
doi:10.1176/ps.2009.60.10.1323