CNUR 106 Evaluation and

Information Literacy Skills

Week 4 2024
Learners True or False?
will tell you
if they don’t
understand? House MD
The evaluation Process
“ A systematic process that judges the worth or value of
something- in this case, teaching and learning” (Bastable,
2017, p. 498)
Why Evaluate?

To ensure
Eliminates
objectives and
misunderstandings
goals are met
Evaluation Vs Assessment
• Assessment: gathering, summarizing,
interpreting & using the data to decide on
a direction for action
• Evaluation: involves gathering,
summarizing, interpreting and using data
to determine if an action was successful.

• Bastable, 2017, p. 500

Types of Data
Qualitative
• Explores feelings and behaviors
• Words or phrases are
summarized into categories and
emerging themes
• Used to measure satisfaction or
quality
Quantitative
• Statistics
• Frequency
• Mean (average)
• Ratio (proportion)
• Used to measure how much
improvement in a learner’s
knowledge or skills in the result
of patient education
Process/ Formative Evaluation

• Ongoing process
• Purpose:
• To determine where further learning is needed
• To make required adjustments as required (materials, instructors,
facilities, learning objectives and attitude)
• Summary of informal feedback
• (Bastable, 2017)
Process/ Formative Evaluation
Advantages
• Events are recent
• Results can be used to improve
performance, learning outcomes
before the end of the session,
course…
Disadvantages
• Making judgments on results
before activity is completed and
outcomes are visible
• Can interrupt the flow of
outcomes
Content Evaluation

• Measurement immediately after learning examining degree to which

objectives are met.
• Determine whether patients and families have acquired the knowledge
and skills taught during the learning experience.
• Occurs immediately after learning
Impact Evaluation

• Focus is on a goal for learning

• Measures the results that learning has had for the organization
(institution, community)
• Usually beyond the scope of the individual nurse educator
• Expensive
Outcome/Summative Evaluation

• Summarizes what happens as a result of education

• Measures long-term change
• What is effective and what is not?
• What has the student learned?
• Were behavior objectives met?
• Did skill competence continue after discharge?
• Measures the changes that result from teaching and learning
Outcome/Summative Evaluation
Advantages
• Everything is completed and
evaluation shows results
• Assess long-term effects
• Look at other variables
• Work environment
Disadvantages
• Resources are more complex &
costly than process or content
evaluation
• Nothing can be done to change
the results
Total Program Evaluation

• Focuses on the extent to which all activities in a program or department

over a specific time period
• Broad scope and focuses on overall goals vs. objectives
• Looks at all levels of evaluation
Documentation
Documentation:
 establishes accountability for care
 promotes quality nursing care,
 facilitates communication among RNs
and other health care providers
 conveys the contribution of nursing to
health care

 (CRNS, 2021, p. 4).

Documentation

Communication of critical information to other health

professionals involved with patient care
Helps with continuity and prevents duplication
Evidence for accreditation bodies
Legal record

(CNPS, 2020; CRNS, 2021)

What to document:
• Materials
• Methods for teaching
• Involvement of client/ family in the teaching/ learning process
• Evaluation of client/family comprehension of the information
provided

(CRNS, 2021, p. 10)

How to document:
 Patient identifier on every page of documentation
 Time and date all entries
 Sign each entry
 Black or blue ink for legal and reproduction purposes
 Legible
 Correct spelling and grammar
 Accurate and truthful
 Objective—do not show personal bias or let others
influence what you write, do not label behavior
 Chronological order
 Mistaken entry: follow organizations procedures
 Health
Information
Literacy
Internet-based Communication
 Electronic Discussion Groups
= many formats of on-line discussion/chats

Advantages
Disadvantages:
• Means of networking
• Vehicle for info exchange • Few checks for accuracy
• Can be used to provide on-line
• Can be time-consuming
support
• Easy to use • May result in e-mail overload
• Low cost • Moves very quickly
• Anonymity • May be difficult to follow
• Allows for real-time discussion
• May Requires everyone to be
• Widely accessible This Photo

on at the same time by

Unknown
• Provides a mechanism for information Author is
licensed
exchange under
CC BY-SA-
NC
 Mobile Learning (m-
Learning)

• Takes advantage of various

wireless, mobile, portable, and
handheld devices.
• Great potential and growing use
• Smart phones capable of web
access are expensive. Those who
cannot afford such a device can use
a computer.
This Photo by Unknown Author is licensed under CC BY-SA-NC
 Facebook, Twitter, YouTube
• Numerous advantages
for health education
• Risks as well
Blogs, Wikis
• Consumers may turn to
these for health-related
information
This Photo by Unknown Author is licensed under CC BY-NC

Other sites/applications?

Social Media
E-Mail/Texting
Advantages: Disadvantages:
This Photo by Unknown Author is licensed under CC BY-SA

• Easy to use • Messages lack context

• Can be used any time, day or
night
• Low cost
• World-wide access
• Provides a written record
• Takes time to complete an
interaction
• Legal issues related to the
written record created
• Privacy cannot be assured
 Gap between those who have access to
IT resources and those who don’t

Risk Factors:
• Age (>65 years)
Digital • Income (<$30,000/year household
income)
Divide • Level of Education (<High School)

Working with Groups at Risk:

• Recognize/assess risk factors.
• Be knowledgeable about resources.
• Create supportive environments.
 Internet is unregulated; anyone
can publish content!

Evaluating
Health Websites Sound medical information
https://nnlm.gov/priorities/to along with dangerous info
pics/health-websites

Ask yourself the

following:
Why did the person create the
page?

What's in it for them?

Are they trying to sell me

something?
www.trustortrash.org
 1. You know they know about the topic;
you respect and trust them
2. They can explain why
When do you 3. They’re not biased
4. They’re up-to-date
believe 5. Their facts are based on studies of
someone? many people (lots of cases)
6. There’s a body of evidence to back
up what they’re saying
 Health Messages in the Media
Principle Key Questions

1 All media messages are carefully crafted Who created this health message?
constructions.

2 Media messages represent reality and What lifestyles, values, and viewpoints are
contain values and viewpoints. represented in, or omitted from, this health
message?

3 Media messages are constructed using What techniques are used to draw attention
a unique set of rules. to this health message?

4 Individuals interpret and make meaning How might different people interpret this
of media messages based on their health message?
personal experiences.

5 Most media messages are driven by Why was this health message communicated?
profit within commercial, ideological, or
political contexts.
 Health Information Literacy:
For Patients & Nursing Students
 • Why is it wise to avoid unreliable
sources?
• Information from unreliable
sources is not always true, up-to-
More date, or accurate
• Students: can weaken the
Credible, credibility of the writer, dilute the
More Reliable writer’s argument, and detract
from the overall strength of the
Sources paper.
• Retrieved from
https://writingcommons.org/what-
might-be-a-more-credible-reliable-
source
 Accuracy Authority
Evaluating Health
Websites

Currency,
Bias,
timeliness,
objectivity
coverage
 1. Accuracy
• Is the information based on sound medical research?
• Can the information on the web page be verified by another source?
• Are the sources cited reliable?
• Are there grammatical and spelling errors?
• Are there footnotes, bibliographies, or references so that you can
verify the information? Are these reliable?
• Who wrote the web site and why? Are they qualified or have the
This Photo by Unknown Author is licensed under CC BY-NC-ND

needed experience to be knowledgeable? Can you find out more

about them?
 2. Authority
• Is there a publisher or organization behind the author?
• What institution published the site?
• Do they have qualifications to show they know what they are talking about?
• Who published the page? What are the person's credentials?
• What do you know about them?
• Is the person backed by a known organization?

This Photo by Unknown Author is licensed under CC BY-SA-NC

e.g. “American Association for Cancer Therapy” may be a made-up name
for something operating out of someone's basement.
• Is the person affiliated with a university? A student or a faculty member?
• Can you easily find contact information on the web page? Physical location?
• What does the About Us section tell you about the purpose of the organization?
• What is the domain name? (.edu, .gov ) A personal page or supported by the organization?
 3. Currency/Timeliness/Coverage

• Is there a date on the page? Original date? Update?

• When was the page last updated?
• Do the links work?
• Has there been more recent research on the subject? Is the
information complete?
• Are there sources given for additional information?
• Are any links current or outdated?
This Photo by Unknown Author is licensed under CC BY-NC

• Is the site easy to navigate, can you see it all, do you have to register
or pay a fee?
• Author, publishers, date and so on may not be obvious so you need to
search the webpage for them
 4. Bias/Objectivity
• Are opinions expressed,
or is the information backed up by research
• What goals does the page meet?
• Is the information detailed or general?
• Is the information showing just one point of view?
• What kind of institution sponsored the webpage? A pharmaceutical company? A non-
This Photo by Unknown Author is licensed under CC BY-NC-ND
profit organization?
• Is advertising clearly marked?
• Can you tell if the information you are reading is advertisement?
• Do the graphics, fonts, and verbiage play to th emotions? Beware of CAPITAL
LETTERS, EXCLAMATION POINTS!!!!! Or words like MIRACLE CURE!!!
• Is the author using data improperly to promote a position or a product?
 Academic databases
• These databases (e.g., CINAHL) include searchable collections of
scholarly works, academic journals, online encyclopedias, and
helpful bibliographies and can usually be accessed through a
college library website.
Where are Academic peer-reviewed journals
credible, • Journal articles that have been peer-reviewed are generally
considered reliable because they have been examined by
reliable experts in the field for accuracy and quality.

Google scholar
sources • Internet search engine helps the user to locate scholarly

found? literature in the form of articles and books, professional

societies’ websites, online academic websites, and more.

Library reference or research desk

• Library staff can assist with research tools, guidance with
identifying credible and non-credible sources, and selection of
reliable sources.
Peer Review Process
•(Furman Library, 2018)
 • Work in pairs- look at 1 website
• Discuss 3 positive & 3 negative
points for each website’s
trustworthiness or lack thereof:

1) https://www.mercy.com/
2) https://www.fitwise.com.au/
3) https://drchristinemaren.com/
4) https://www.mercola.com/
5) https://naturallysavvy.com/
6) http://www.thehealingpeople.
SMALL GROUP Activity: com/
Summary

• Technology is a powerful tool to enhance

learning.
• Technology is a means to an end, not an end in
and of itself.
• It must be used with thought, careful planning,
and thorough evaluation.
 Bastable, S.B. (2017). Nurse as educator:
References Principles of teaching and learning for
nursing practice. Toronto, Canada: Jones &
Bartlett.