Modelling HCI for all

Pradipta Biswas University of Cambridge Computer Laboratory, United Kingdom pb400 @ cl.cam.ac.uk http://www.cl.cam/.ac.uk/~pb400

Problem
Standards and Guidelines
Existing Systems

User Profile

2 April 30, 2009

Presentation at University of Bristol

Solution
Prototype Systems User Model Best Alternative User Testing

New System

Existing Systems

3 April 30, 2009

Presentation at University of Bristol

Challenge

4 April 30, 2009

Presentation at University of Bristol

My Objective
1. Simulate HCI of both able-bodied users and those with disabilities. 2. Work for users with different levels of skill.

3. Be easy to use and comprehend for an interface designer.

5 April 30, 2009
Presentation at University of Bristol

Architecture of the Simulator

6 April 30, 2009

Presentation at University of Bristol

Model Output
Perception model

Visual Search Time, Eye movement trajectory

Cognitive model

Intended action

Motor-behaviour model

Movement Time, Input device (mouse) movement path

7 April 30, 2009

Presentation at University of Bristol

Approach
Perception
Simulating visual impairment Tracking eye gaze during visual search tasks

Cognition
Modelling novel interaction Modelling novel interface

Motor-behaviour
Relating hand strength with pointing performance Developing regression model to predict pointing time
8 April 30, 2009
Presentation at University of Bristol

Main Results
Identified and calibrated two image processing algorithms to predict points of eye-gaze fixations and the corresponding fixation durations. Identified most probable eye movement strategies to predict the actual trajectory during visual search in a computer screen. Investigated the effect of hand strength on human-computer interaction and found people with higher hand strength can perform pointing faster. Developed a statistical model to predict pointing times of motor-impaired computer users.
9 April 30, 2009
Presentation at University of Bristol

Applications
Evaluating any system w.r.t. limitations posed by users or context Developing
New assistive technology
Cluster scanning system

Inclusive applications
Accessible game Websites accessibility

Multimodal Accessibility Wizard

10 April 30, 2009
Presentation at University of Bristol

Skills Acquired
Human side
Psychological experiment design Statistical data analysis Knowledge about cognitive psychology, perception, opthalmology, optometry, motor-control and motorimpairment.

Computer side
Expert and intelligent systems Graphics algorithms Statistical models
11 April 30, 2009
Presentation at University of Bristol

Relation
Perception of people with visual acuity loss Effect of hand strength in interaction Scanning Interfaces Perception in small sized display Tilt based and pressure based interactions Novel input technology

Inclusive Ubiquitous Interaction

12 April 30, 2009
Presentation at University of Bristol