Chapter 5 - CONTEXT DEPENDENCY AND PHYSICAL ADAPTABILITY
Using Personal Objects as Tangible Interfaces for Memory
Recollection and Sharing
Elena Mugellini Elisa Rubegni
University of Applied University of Siena
Sciences of Western Via dei Termini 6,
Switzerland, Fribourg 53100, Siena, Italy
Bd de Pérolles 80, 1705 rubegni@media.uni
Fribourg, Switzerland si.it
elena.mugellini@hefr.ch
ABSTRACT
Tangible User Interfaces (TUIs) are emerging as a new
paradigm of interaction with the digital world aiming at
facilitating traditional GUI-based interaction. Interaction
with TUIs relies on users’ existing skills of interaction with
the real world [9], thereby offering the promise of interfaces
that are quicker to learn and easier to use. Recently it has
been demonstrated [1] that the use of personal objects as
tangible interfaces will be even more straightforward since
users already have a mental model associated to the
physical objects thus facilitating the comprehension and
usage modalities of that objects. However TUIs are
currently very challenging to build and this limits their
widespread diffusion and exploitation. In order to address
this issue we propose a user-oriented framework, called
Memodules Framework, which allows the easy creation and
management of Personal TUIs, providing end users with the
ability of dynamically configuring and reconfiguring their
TUIs. The framework is based on a model, called
MemoML (Memodules Markup Language), which
guarantees framework flexibility, extensibility and
evolution over time.
Author Keywords
HCI, Tangible User Interface, personal objects, user-
oriented framework, model, markup language.
ACM Classification Keywords
H.5.2 User Interfaces, H5.m. Information interfaces and
presentation (e.g., HCI): Miscellaneous.
INTRODUCTION
With the constant progress in information retrieval and
Permission to make digital or hard copies of all or part of this work for
personal or classroom use is granted without fee provided that copies are
not made or distributed for profit or commercial advantage and that copies
bear this notice and the full citation on the first page. To copy otherwise,
to republish, to post on servers or to redistribute to lists, requires prior
specific permission and/or a fee.
TEI’07, February 15-17, 2007, Baton Rouge, Louisiana, USA.
Copyright 2007 ACM ISBN 978-1-59593-619-6/07/02…$5.00.
TEI'07, 15-17 Feb 2007, Baton Rouge, LA, USA
Sandro Gerardi Omar Abou Khaled
University of Applied University of Applied
Sciences of Western Sciences of Western
Switzerland, Fribourg Switzerland, Fribourg
Bd de Pérolles 80, 1705 Bd de Pérolles 80, 1705
Fribourg, Switzerland Fribourg, Switzerland
sandro.gerardi@hefr.ch omar.aboukhaled@hefr.ch
storage, the amount of information, a person owns and
handles, never stops increasing. Worst, information is
dematerializing in our daily life and thus, people are often
experiencing the “lost in infospace” effect. What we often
miss in our daily-life are tangible shortcuts (reminders) to
our information, like used to be books in our shelves [12,
13].
TUIs are emerging as a new paradigm for facilitating user
interaction with digital world by providing a mean for
integrating physical and digital world. This term, has been
first introduced by Ullmer and Ishii [12], which defines
Tangible User Interfaces as follows: “TUIs couple physical
representations (e.g. spatially manipulable physical objects)
with digital representations (e.g. graphics or audio),
yielding user interfaces that are computationally mediated
but not generally identifiable as “computers” per se”.
Recently it has been demonstrated that personal objects and
souvenirs can be used as tangible interfaces and ambient
intelligent objects [1]. Users have a mental model of the
links between their personal physical objects (souvenirs)
and the related digital information, as a consequence those
objects can be used as TUIs instead of developing new ones
that have to be learned by the users. In other worlds
personal objects can act as stimulus connected to the events
helping people to evoke certain circumstances and
supporting the reconstruction of memory. In this case the
stimulus is a tangible cue which enables the retrieval of
information from the memory.
According with this, the paper presents Memodules
Framework which enables personal objects as TUIs for
memory recollection and sharing. This framework supports
the rapid composition of Memodules (augmented personal
objects) with existing devices in the home environment
(TV, Hi-Fi, PDA, etc.).
MEMODULES PROJECT
Memodules project 1 has the objective of developing,
experimenting and evaluating the concept of tangible
1
http://www.memodules.ch
231
 TEI'07, 15-17 Feb 2007, Baton Rouge, LA, USA Chapter 5 - CONTEXT DEPENDENCY AND PHYSICAL ADAPTABILITY

shortcuts (reminders), facilitating (a) the control of devices Associative memory

in the everyday life and also (b) the information
categorization in order to improve information access and
retrieval. The project aims at facilitating user interaction
with multimedia information by supporting the creation and
management of tangible links to digital contents. The
process of “remembering” usually consists in associating
something with a sensory cue [4]. For example, we may see
a picture of a place visited in our childhood and the image
recalls memories associated to the same time. It appears
that humans easily access and retrieve information when it
is linked to other related information or objects [18].
Tangible interfaces can be useful to establish links between
our memory and information in order to roost abstract
information in the real world through tangible reminders. In
particular, as Hoven largely arguments [1], personal objects
can be used as memory cues for supporting memory recall.
In fact, souvenirs are connected to the memory of particular
events which can be easily evoked by physically
manipulating the object as carrier of meaning in interaction.
Based on this associative process of remembering, the main
objective of our research is to investigate the opportunity of
a more complex, multi-sensorial combination of, and
interaction between, personal objects and multimedia
information (e.g. photos, videos, audio files, text
documents, web resources, etc.).
The project is based on a methodology approach which
integrates two different perspectives: user-centred design
and technology-driven.
User-centred design aims to understand how people collect
objects and information and investigating how personal
objects and souvenirs are used for memories recalling,
storytelling and sharing of experience.
The technology-driven perspective investigates how to
improve those objects with embedded sensors and
technology, we call them Memodules, in order to enhance
their capabilities and to support users to recollect and share
memories.
The paper focuses and presents the results of technology-
driven perspective.
Physical
scenario
Action
reminder materialization
Phase 1 Phase 2 Phase 3
MEMODULES
Memodules Approach
architecture
Figure 1 Memodules Approach
In order to explore the Memodules approach we decided to
focus on traveling as a privileged application domain since
this activity is strongly related to the concept of souvenirs
and memories collection.
The technology-driven perspective has been driven by the
following scenario.
Sabrina created a folder full of pictures from her last
vacations in Greece. She glues an RFID (Radio Frequency
Identification) on a nice seashell she brought back from
Greece and asks the system to associate it with the picture
folder. One week later she wants to show her friends a
slideshow of her vacations. She places the seashell in a little
hole next to the plasma screen, which activates the show. At
the same time the CD of traditional Greek music she bought
in Athens is played on the CD player (see Figure 2).
Nicola who enjoyed the evening and the pictures gives his
business card to Sabrina. The following day, Sabrina places
Nicola’ business card along with the seashell on top of the
communicator and makes a brief gesture to send
everything.

Memodules Approach
According to the concept of associative memory [18],
objects can act as physical reminders to some memories.
Then using those physical reminders it is possible to define
some scenarios which allows materializing user memories
evoked by personal objects. In the same way, the approach
followed in Memodules project to support the process of
memory recall is based on three main phases (Figure 1):
Phase 1 - Tangible object initialization, Phase 2 - Usage
scenario description and Phase 3 - Action materialization. Figure 2 Memodules usage scenario

232
 Chapter 5 - CONTEXT DEPENDENCY AND PHYSICAL ADAPTABILITY
In order to support this type of interaction and to enable
people 2 to use Memodules for organizing, manipulating
and consuming information and memories it is necessary to
provide users an easy way to create, assemble and manage
them. This means providing a user-oriented framework
which allows configuring Memodules objects and
describing their usage scenarios in a simple and intuitive
way. Moreover the framework has to support the easy
reconfiguration of Memodules usage scenarios since
personal memories associated to objects and events are not
“absolute” but rather they change over time [2].
PERSONAL OBJECTS AS TANGIBLE CUES TO
MEMORIES
The innovative works of Wellner’s DigitalDesk [14], and
Ishii and Ullmer’s Tangible Bits [7] have pioneered
exploration of post-WIMP (Windows, Icons, Menus,
Pointers) tangible interfaces. Ubiquitous computing
applications have motivated these novel physical interfaces
even more. However, tangible interfaces are difficult and
time consuming to build, requiring a specific technological
expertise that limits their widespread adoption. Several
research efforts have been done during recent years to
develop tools for prototyping tangible user interfaces and
designing ubiquitous computing architectures. Some
examples of those projects are: Smart-Its [10], Phidgets
[11], the iStuff [7] and iCAP [6]. These projects were
mainly focused on providing rich prototyping toolkits or
programming languages for developing Tangible User
Interfaces and ubiquitous devices from a developer point of
view instead of focusing on end-users. Other examples of
interesting projects focusing more on supporting non-expert
in programming users to manage personal ubiquitous
environments are Accord [3,4], Oxygen [8] and GAS [14]
projects. All these three projects have focused on giving
end users the ability to construct or modify ubiquitous
computing environments.
Our work has been inspired by the results achieved within
the framework of those projects. However, some
fundamental conceptual differences between those projects
and our work exist: (1) our focus on personal objects and
souvenirs as tangible interfaces instead of generic domestic
objects and devices, and (2) our focus on memory
recollection and sharing instead of management of generic
everyday activities in the home environment. While those
projects refer to the concept of smart objects and their
combination to facilitate everyday activities, we concentrate
more on the concept of reminiscence and on the association
between personal objects and multimedia resources in order
to enhance the experience of memory recall.
2
In the rest of the paper the terms “user”, “end user”, “non-
expert programmer”, “normal user” are indifferently used to
refer to any type of user, e.g. people who do not have any
PC-experience.
TEI'07, 15-17 Feb 2007, Baton Rouge, LA, USA
Our work is intended to support any type of user to use and
combine augmented personal objects as a means for
memory recollection and experience sharing and to support
dynamic re-combination of those objects since personal
memories associated to objects and events can change over
time [2]. For this reason users should be provided with a
mechanism for easily associating and re- associating multi-
sensorial information to their personal objects. To achieve
this, we developed a generally applicable model describing
the objects and the devices within the environment and the
interaction occurring between them. This model, presented
in the following, provides a common, technology-
independent, description of the whole system which can be
implemented using different technologies.
Finally it is worth noting that even if this work was derived
by investigating travelling activity application domain, the
framework we are going to present in the next paragraphs is
flexible to be applied in different contexts.
MEMOML MODEL
MemoML (Memodules Markup Language) has been
developed to respond to the need of providing a universally
applicable model which is technology-independent and
which, as a consequence, can be implemented over different
platforms. MemoML is an XML-based modeling language
which formalizes the previously presented Memodules
approach.
MemoML is based on Document Engineering approach
[15] which is emerging as a new discipline for specifying,
designing, and implementing systems belonging to very
different business domains by using XML technologies.
The choice of a declarative modeling approach 3 allows us
to describe what the framework is like, rather than how to
create it, enabling system flexibility, reusability and
portability over different implementation technologies.
More specifically MemoML describes the components and
the structure of a Memodules environment. The
components are the building blocks of the environment (e.g.
Memodules objects, devices, communication protocols,
actions, etc.) which can be combined together in order to
define Memodules usage scenarios. The structure defines
what a usage scenario is, and the rules it has to undergo
such as for instance the constraints associated to actions
which restrain the types of information an action can
3
Declarative programming is an approach to computer
programming that involves the creation of a set of
conditions that describe a solution space, but leaves the
interpretation of the specific steps needed to arrive at that
solution up to an unspecified interpreter. For more details
on declarative programming see
http://www.csc.liv.ac.uk/~frans/OldLectures/2CS24/declara
tive.html#detail
233
 TEI'07, 15-17 Feb 2007, Baton Rouge, LA, USA Chapter 5 - CONTEXT DEPENDENCY AND PHYSICAL ADAPTABILITY

operate upon (e.g. the action “play music” could not operate shown on the business card. Then when Sabrina adds the
upon some photos). business card of her best friend to the system, then this
Memodule is automatically associated to the pre-defined
The two most important elements in the model are the
send_email scenario and Sabrina is able to send e-mails to
concepts of Memodules environment (MemoEnvironment
her best friend without doing any other thing.
element 4 in Figure 3) and Memodules usage scenario
(MemoScenario element in Figure 3). The first comprises
the whole collection of available Memodule objects,
devices and resources which can be assembled in order to
define Memodules usage scenarios. The second refers to
Memodules usage scenarios and describes which
information is associated to a Memodules and how this
information is rendered to the user.
Since Memodules are physical objects that activate actions,
a usage scenario describes how a Memodule (or a
combination of Memodules) interacts with the surrounding
environment. A MemoScenario is composed of three main
parts: the Memodule which is in turn associated to the
information to which the object reminds according to the Figure 4 Memodules element
user mental model (e.g. the seashell souvenir reminds to the
pictures of some Greek holidays), the input device which is
responsible for identifying the Memodule and starting the MemoClusters are virtual folders defined by the user
scenario (InputDevice element in Figure 3), and the containing collections of information (a set of pictures, a
Operation to perform once the Memodule is identified by collection of video, a compilation of songs, etc.).
the input device. Information in a cluster is constrained to be of the same
type (e.g. the “type picture” will include “.jpg”, “.gif”,
“.bmp”, the “type music” will include “.mp3”, “.wav”) in
order to guarantee consistence of action operated upon a
MemoCluster. Alternatively, it is possible to associate
multiple MemoClusters to a single Memodule and perform
a different action upon each of them.

Figure 3 MemoML model

The collection of information (a set of pictures, a playlist,

etc.) a Memodule is associate with is called MemoCluster
(see the next paragraph).
Every Memodule can either belong to a generic Memodule
category (e.g. generic business card category) or be a single
specific object. If it belongs to a generic category, then it
inherits all the properties and pre-defined usage scenarios
defined for that category.
Supposing the “send_email” usage scenario has been
defined for the generic “business card” category as
following: every time a business card is approached to the
PC, the system has to send an e-mail message at the address
4 InputDevice couple. Alternatively, if multiple Memodules
words in italics correspond to the real name of elements in
the model.
Figure 5 MemoResources element
InputDevice is a device equipped with an RFID reader
which can identify a Memodule and make the link between
the Memodule object and the output device where the
action associated to the Memodule is to be executed. The
InputDevice starts the execution of a scenario upon
identification of the corresponding Memodule.
The combination of a Memodule and an input device allows
to uniquely identify a scenario, i.e. it is not possible to
associate two different scenarios to the same Memodule-
are combined, different scenarios can be created using the
same input device:

234
 Chapter 5 - CONTEXT DEPENDENCY AND PHYSICAL ADAPTABILITY
• seashell Memodule + business card Memodule + Input
device1 = scenario1
• seashell Memodule + book Memodule + Input device1
= scenario2
Operation element describes the action the user wants to
perform when interacting with the Memodule object in
order to render the associated memories and events. Each
Operation is identified by (Figure 6):
• the Action to perform,
• the Application to use to materialize the action (since
the same action could be carried out using different
applications – e.g. the “play music” action could be
carried out using “windows media player” or “java
music player” application),
• the OutputDevice where the action is to be executed,
• the MemoCluster of information the action operate
upon,
• the Mode of actions execution (parallel or sequential) if
multiple operations are defined within the same
scenario.
Figure 6 Operation element
MemoEnvironment as shown in Figure 3 is composed of:
• the collection of Memodule objects,
• the collection of all the MemoClusters, called
MemoResouces (see Figure 5),
• the set of available devices and applications which can
be used within a scenario to materialize actions
described within the MemoConfig element (see Figure
7)
Figure 7 MemoConfig element
TEI'07, 15-17 Feb 2007, Baton Rouge, LA, USA
As presented in the next paragraph, MemoML is the base
upon which the framework is built. More specifically, the
Action Builder visual editor, presented in the following
section, implements the concept of MemoScenario,
supporting user creation of Memodules usage scenarios.
MEMODULES FRAMEWORK
Memodules framework is a user-oriented framework
enabling end users to create their own Memodules
environment and it is built upon the previously described
MemoML model. Configuring Memodules means linking
them to multimedia information and describing how they
interact with the surrounding environment (i.e. how and
when information associated to them is rendered). The
framework provides a one-stop platform 5 : a single platform
that allows users to add new Memodules objects to the
existing Memodules environment, to describe their usage
scenarios and to manage the execution of those scenarios.
Memodules framework allows persons to create and
manage their own Memodules environment by dynamically
arranging heterogeneous Memodules and device
components with digital information. Moreover, it provides
users with the ability of easily configuring and
reconfiguring Memodules usage scenarios. Memodules
framework, which supports the 3-phases approach
described earlier, is composed of the following
components:
• Memodules Lay&Play which handles the phase 1,
corresponding to tangible object initialization
• Memodules Action Builder which supports the phase 2,
corresponding to usage scenario description
• Memodules Console which handles the phase 3,
corresponding to action materialization
Phase 1 - Tangible Object Initialization
This phase is handled by Memodules Lay&Play. As stated
before, Memodules are augmented personal objects used to
access information and to help controlling daily life
devices. Memodules Lay&Play allows to easily “create”
Memodules and to add them to the Memodules
environment. Memodules Lay&Play is composed of a
webcam and an RFID reader which allows simultaneously
to take a picture of the object laying over the Lay&Play
system and to read the ID of the RFID tag attached to the
object. The digital counterpart of the physical object is
created (Memodule creation) and added to the list of
5
the term one-stop platform originates from the e-
government research domain to indicate a single access
point to all public services which provide users with
integrated services.
235
 TEI'07, 15-17 Feb 2007, Baton Rouge, LA, USA
available Memodules objects displayed on the Memodule
Action Builder editor.
Webcam
RFID
reader
Figure 8 Memodules Lay&Play
Phase 2 - Usage Scenario Description
This phase is supported by Memodules Action Builder. The
Memodules Action Builder is a visual editor based on the
puzzle metaphor which handles the creation of usage
scenarios for every Memodule. The choice of the puzzle
metaphor was inspired by the results achieved within the
framework of Accord project [17]. The project designed a
visual editor based on the puzzle metaphor to enable end
users to easily configure their home ubiquitous
environment. The evaluation activity they did with real
users confirmed extensively the suitability of their approach
[5]. However, although the puzzle metaphor was easily
grasped, poor design choice for icons graphics made it
difficult to couple them with their physical counterpart [5].
Memodules Action Builder uses the puzzle metaphor
proposed by Accord and extends it in order to support more
complex puzzle configurations combining parallel and
sequential actions. Moreover, thanks to Memodules
Lay&Play component, icons representing the digital
counterparts of personal objects in our visual editor are
created using the picture of the object itself, thus facilitating
physical object to digital representation coupling.
Memodules Action Builder allows users to create
interaction scenarios which describe how Memodules
interact with the surrounding environment and which
devices are involved in the scenario. Scenarios are created
using the puzzle metaphor: the user connects components
through a series of left-to-right couplings of puzzle pieces,
providing an easy to understand mechanism for connecting
the different pieces. Moreover, constraining puzzle
connections to be left to right also gives the illusion of a
pipeline of information flow which creates a cause-effect
relationship between the different components.
The puzzle editor is composed of a number of different
panels (Figure 9). The control panel (Figure 9 on the top)
contains the list of available puzzle pieces grouped in six
different categories (see below for more details about
categories). Puzzle pieces can be dragged and dropped in
the editing panel (or workspace) and assembled in order to
create the scenarios. When a puzzle piece is dragged onto
236
Chapter 5 - CONTEXT DEPENDENCY AND PHYSICAL ADAPTABILITY
the workspace it clones itself and becomes a symbolic link.
Useless pieces in the workspace can be thrown in the trash
(on the bottom-right of the workspace). In order to connect
puzzle pieces together it is necessary to drag a particular
piece in the vicinity of a fitting target piece. If the two
pieces are matching a visual feedback is provided to the
user (the border of the puzzle pieces become red-colored),
on the contrary if the user tries to drag a non-compatible
piece the system will not allow their assembly. When a
Memodule puzzle piece is selected the MemoCluster panel
(on the right) displays information clusters associated to
that Memodule which have been created and used in
previous scenarios.
Scenarios can be edited starting from puzzle pieces
belonging to any category.
Control Puzzle pieces
panel categories
Available
components
Working space for MemoCluster
creating scenarios panel
Figure 9 Memodules Action Builder
Memodules Connectors
Input Devices Output Devices
Actions MemoClusters
Figure 10 Puzzle pieces categories
Puzzle pieces are grouped into 6 different categories (see
Figure 10) and displayed with different colors: the blue
ones represent Memodules objects, the green ones regroup
Input Devices (i.e. devices that can identify Memodules
objects and start corresponding actions), the pink ones
represent Actions to carry out (e.g. play music, show
pictures, send an e-mail, etc.), the yellow ones stand for
information that can be associated to Memodules objects
(e.g. some photos, music, etc.). As described in MemoML
model information is grouped in “logical” clusters called
Memo Clusters. This means that no physical clusters are
created but information is browsed from every where in the
 Chapter 5 - CONTEXT DEPENDENCY AND PHYSICAL ADAPTABILITY
PC and grouped into logical collections. Black-colored
pieces identify Output Devices, i.e. devices where the
action is to be carried out (a TV for showing some photos, a
Hi-fi stereo for playing some music, etc.). Finally red-
colored pieces refer to Connectors which allow creating
complex scenarios. To date two types of connectors have
been implemented: the “AND” connector and “TIMER”
connector. The first is used to combine (1) multiple
Memodules, for instance when Sabrina approaches the
seashell Memodule and the business card Memodule a
specific action has to be performed), and/or (2) multiple
actions (e.g. when Sabrina approaches the seashell both the
photos and the music have to be played). The second, the
“TIMER” connector, adds a time constraint to the execution
of the scenario (e.g. when Sabrina approaches the seashell
Memodule to the system, the system has to show the
pictures and 1 minute after the slideshow has finished it has
to play the music).
Finally the newly created scenario needs to be named and
saved. Once this has been done, the user can “play” the
scenario and test it to ensure that everything works exactly
as it has been intended.
Scenario examples
Following two examples of Memodules interaction
scenarios that can be created using the Memodules Action
Builder are presented.
Figure 11 Scenario examples
The first scenario (Figure 11a) describes the following
action:
• When Sabrina approaches the seashell (souvenir of
some Greek holidays) to the Memodules Console (see
next paragraph), the photos of that vacation are
displayed on the PC screen and after 5 minutes the
slideshow has terminated, a video of the Parthenon is
played
The second scenario (Figure 11b) describes the action:
TEI'07, 15-17 Feb 2007, Baton Rouge, LA, USA
• When Sabrina approaches the seashell (souvenir of
some Greek holidays) and the business card of her
friend to the Memodules Console the photos of that
vacation are sent to the e-mail address of her friend via
the PC.
Phase 3 - Action Materialization
This phase is handled by Memodules Console. Memodules
Console is based on Phidgets toolkit [4], and allows the
user to start a scenario and to manage subsequent
interactions with digital contents. When a Memodule is
approached to the Console, the system identifies the
Memodule object and retrieves the usage scenario
associated to it. Since the Console integrates three different
Input Devices (corresponding to the three RFID readers in
Figure 12) for each Memodule it is possible to create three
different scenarios, as described in the MemoML model. In
order to provide a visual feedback to the user, once the
Memodule has been identified, the green LED associated to
the RFID reader (see Figure 12) lights on.
LCD
screen
Touch
sensors LEDs
Infrared
sensor
RFID LEDs
readers
Figure 12 Memodules Console
Once the scenario has been started the console allows
managing actions execution. The Console is equipped with
an infrared sensor, activated by the user’s hand, which
allows controlling the volume of sound when playing. At
the same time some luminous Leds give a visual feedback
of the user’ hand movement while adjusting the volume
(Figure 12). Several touch sensors allow the user to interact
with multimedia content while playing (play next, previous,
stop, etc.). The LCD screen shows metadata information
about the multimedia content that is played, while the
circular touch (on the top left) allows the user to speed up
or slow down the forward and the backward motion of
some video or music playing.
Scenarios can be executed just after they have been created
with the visual editor, giving the possibility to the user to
test whether they work correctly.
237
 TEI'07, 15-17 Feb 2007, Baton Rouge, LA, USA Chapter 5 - CONTEXT DEPENDENCY AND PHYSICAL ADAPTABILITY
CONCLUSION AND FUTURE WORKS
This paper has presented a user-oriented framework, called
Memodules Framework, enabling the use of personal
objects as tangible user interfaces facilitating memory
recollection. The framework is intended to support any type
of user to use and combine Memodules (augmented
personal objects) as a mean for memory recollection and
experience sharing, and to support dynamic re-combination
of those objects as associated memories can change over
time. Memodules Framework is based on a formal model,
called MemoML, which describes the concept of
Memodules environment and Memodules usage scenario
proving a common, technology-independent, description of
the whole system which can be implemented using different
technologies. The framework is composed of three main
parts: Memodules Lay Play which allows to easily creating
Memodules, Memodules Action Builder which is a visual
editor based on the puzzle metaphor for describing
Memodules usage scenarios and Memodules Console which
materializes actions and executes scenarios.
As next step an accurate evaluation of the framework will
be performed in order to assess how acceptable is for end
users to use it. The evaluation will be centered on two main
aspects: the comprehensibility of the proposed framework
and underlying concepts and the willingness to use such
technology [14]. Moreover in the next future we will
explore how the proposed framework can be enhanced by
adding multimodal interfaces such as speech and gesture
recognition systems. This further improvement will allow
the design of additional interaction modalities enhancing
user manipulation and interaction with Memodules towards
a richer multi sensorial experience.
ACKNOWLEDGMENTS
This research has been supported by Hasler Foundation
within the framework of Memodules project. Particular
thanks to the Prof. Rolf Ingold, Dr. Denis Lalanne and all
the other people involved in the project for their valuable
contributions.
REFERENCES
1. Hoven, E. van den, and Eggen, B. Personal souvenirs as
Ambient Intelligent objects. Proceedings of the 2005
Joint Conference on Smart Objects and Ambient
intelligence: innovative Context-Aware Services,
Usages and Technologies, Grenoble, France, October
12-14, 2005. SOc-EUSAI’05, vol.121 (pp.123-128)
New York, USA, ACM Press.
2. Hoven, E. van den, and Eggen, B. Design
Recommendations for Augmented Memory Systems.
Designing for Collective Remembering Workshop at
CHI 2006, Montréal, Quebec, Canada.
3. Humble, J., Crabtree, A.., Hemmings, T., Åkesson, K-
P., Koleva, B., Rodden, T., Hansson, P. Playing with the
238
Bits - User-configuration of Ubiquitous Domestic
Environments. Proceedings of the Fifth Annual
Conference on Ubiquitous Computing, UbiComp2003,
Seattle, Washington, USA, 12-15 October 2003.
4. Rodden, T, Crabtree, A.., Hemmings, T., Koleva, B.,
Humble, J., Åkesson, K-P. and Hansson, P. Between the
dazzle of a new building and its eventual corpse:
assembling the ubiquitous home. Proceedings of the
2004 ACM Symposium on Designing Interactive
Systems, August 1st-4th, Cambridge, Massachusetts:
ACM Press.
5. Hansson, P., Humble, J. and Koleva, B. Understanding
and Using the Tangible Toolbox. Technical Report.
September 2002.
6. Sohn, T. and Dey, A.K. iCAP: An Informal Tool for
Interactive Prototyping of Context-Aware Applications.
Extended Abstracts of CHI 2003, 974-5.
7. Ballagas, A. R., Ringel, M., Stone, M., Borchers, J.
"iStuff: A Physical User Interface Toolkit for
Ubiquitous Computing Environments ", CHI 2003.
8. Oxygen project webiste: http://www.oxygen.lcs.mit.edu/
9. Ishii, H., and Ullmer, B. Tangible Bits: Towards
Seamless Interfaces between People, Bits and Atoms. In
Conference on Human Factors and Computing Systems,
March 1997.
10. Smart-its project website: http://www.smart-its.org/
11. Phidgets project website: http://www.phidgets.com/
12. Ullmer, B. and Ishii, H. Emerging frameworks for
tangible user interfaces. IBM Systems Journal, 39, 915-
931. 2000.
13. Shaer O., Leland N., Calvillo-Gamez E. H. and Jacob R.
J.K.. The TAC Paradigm: Specifying Tangible User
Interfaces. In Personal and Ubiquitous Computing
Journal. 2004.
14. Mavrommati, I., Kameas, A., and Markopoulos, P.. An
editing tool that manages devices associations in an in-
home environment. Personal and Ubiquitous Computing
8, 3-4. ACM Press/Springer-Verlag, London, U.K.
,2004, 255–263.
15. Glushko ,R. J. and McGrath, T. Document Engineering:
Analyzing and Designing Documents for Business
Informatics and Web Services. MIT Press. 2005.
16. Mugellini, E., Gerardi, S., Baechler, D. and Abou
Khaled, O. MyMemodules: a Graphical Toolkit for the
Easy Creation of Personal TUI, 19th ACM Symposium
on User Interface Software and Technology, UIST 2006,
Montreux, Switzerland, October 15-18, 2006.
17. Accord project website: http://www.sics.se/accord/
18. Hoven, E. van den. Graspable Cues for Everyday
Recollecting, PhD Thesis, Department of Industrial
Design, Eindhoven University of Technology, The
Netherlands, 2004, ISBN 90-386-1958-8.