Download as pdf or txt
Download as pdf or txt
You are on page 1of 6

Wearable Computing

Editor: Paul Lukowicz n University of Passau n paul.lukowicz@uni-passau.de

From Backpacks
to Smartphones:
Past, Present, and Future
of Wearable Computers
Oliver Amft and Paul Lukowicz

T he 5th International Symposium


on Wearable Computing in 2001
(ISWC 01) devoted an entire session to
SPOT platform, the Massachusetts
Institute of Technology MIThrill, the
ETH WearARM, and the CharmIT
ing, context awareness, wearable inter-
faces, and new application concepts. At
the same time, the market penetration
system design. More important, peo- system (see Figure 1) that originated of smart phones promises to give the
ple wearing a broad range of wearable at GeorgiaTech (which has been the results of such research a broad real-
systems filled the conference halls. The “workhorse” of wearable enthusiasts world impact.
exhibition and gadget show, both with for many years).
a strong focus on wearable hardware, By contrast, at ISWC 08 not a single The Concept
were the centerpiece of the confer- paper dealt with computing platforms. We can attribute the foundations of
ence. Among the systems shown (and More tellingly, only two participants wearable computers to the inventions
worn) were the IBM Linux Watch, the wore computer systems, and no one of pocket and wristwatches in the
Carnegie Mellon University (CMU) showed any new platforms at the exhi- 16th century (en.wikipedia.org/wiki/
bition. At the same time, by our esti- Watch). Among the first actual wear-
mate, around 30 percent (probably able computers were the systems to pre-
more) of the audience had iPhones and dict roulette wheels of Edward Thorp
comparable smart phones and were and Claude Shannon1 in the early
using them to access the Internet on a 1960s and that of Hubert Upton to aid
regular basis. lip reading.
Does that mean that the smart phone In the early 1990s, Thad Starner
has made the wearable computer obso- and Steve Mann at MIT, 2 among oth-
lete? And where does the rise of the ers, pioneered modern-day wearable
smart phone leave wearable computing computing. At a time when computing
research? had just entered the home with large,
While voices in the community are clumsy PCs, they envisioned comput-
talking about the smart phone bringing ers that:
the “death of the wearable computer”
(a panel with this title was actually • they could always have with them
proposed for ISWC two years ago), we and use any time and any place, not
believe that the opposite is true. Today’s just at the desk;
smart phones in many ways represent • have interfaces that would make
Figure 1. CharmIT. Charmed the culmination of the ideas that drove them usable even while a person is
Technologies began selling this wearable systems research in the past. physically and mentally engaged in a
wearable computer as the CharmIT They offer a platform to explore core complex real world;
Wearable Computing Kit in 2000. wearable research topics such as sens- • augment human perception and mul-

8 PERVASIVE computing  Published by the IEEE CS n 1536-1268/09/$25.00 © 2009 IEEE


Figure 3. Xybernaut. This wearable system was among the first
commercial solutions of the 1990s.

backpack-mounted ing the arms close together, the wearer


computer to con- could type and watch the input simul-
trol cameras. In taneously. Matias commercialized this
Figure 2. Private Eye. Thad Starner sports wearable the ’90s, increas- solution. IBM researchers followed the
computing gear in 1993. ing processing per- half-keyboard concept with a “belt
formance paved computer” (www.almaden.ibm.com/
tiply human mental capabilities; and the way for general-purpose wearable cs/user/inddes/halfkb.html). Panasonic
• have awareness of the physical envi- computers that allowed mobile users presented a similar product, called the
ronment and can incorporate this to perform classic desktop computing Brick Computer, in 2002. The Brick
awareness in their functionality. tasks. Many of the early systems were was coupled wirelessly to an arm-worn
worn at the waist, as locations close to display. Many companies introduced
Clearly, no off-the-shelf comput- the center of body mass made it easier concept studies of arm-worn comput-
ing devices existed at the time that fit- to deal with device sizes and weight. ers in the ’90s and beyond. A few sys-
ted such a vision. Thus, the search for Among these systems were Doug Platt’s tems achieved market success, such as
appropriate wearable computing devices Hip-PC in 1991, based on a Intel 80286 Vocollect (www.vocollect.com), a wear-
became a key research question. processor. This system served as basis able voice-directed logistics solution, as
for MIT’s Lizzy, which Starner wore well as the Symbol Technologies wire-
The Past in 1993 along with a Private Eye head- less barcode scanners.
For the subsequent development of mounted display (HMD) and a one- Since the early 2000s, various
wearables, we highlight trends in com- handed keyboard, called Twiddler (see mobile computers have appeared on
puting platforms while omitting many Figure 2).3 In 1990, one of the first com- the market, such as the Sharp Zau-
further foundational details. Bradley mercial solutions—the Xybernaut— rus (en.wikipedia.org/wiki/Sharp_
Rhodes and many contributors com- appeared on the market (see Figure 3). Zaurus) and the Nokia N770 (www.
piled a summary of historical events The standard Xybernaut system setup nokia.com) that eventually led to the
from which we took some of the infor- consisted of a belt-attached computing diversified product range of thin cli-
mation in this review (www.media.mit. block and a carry-on display. ents and smart phones today. In par-
edu/projects/wearables/timeline.html). In 1994, Edgar Matias and col- allel, research systems appeared, such
In the 1980s, rapid electronic minia- leagues presented a wearable computer as the Linux Advanced Radio Termi-
turization and convenient availability based on a small display and a half- nal (LART) embedded computer by
of computer parts led to several wear- QWERTY keyboard for one-handed TU Delft and the SPOT, which suc-
able computers that addressed specific operation (see Figure 4). Both devices ceeded the previous VuMan wearable
applications, such as Steve Mann’s 1981 were attached to forearms.4 By mov- generations from CMU. The TU Delft

July–September 2009 PERVASIVE computing 9


Wearable Computing

Wearable Computing

Figure 5. WearARM. A flat profile


wearable computer that used flex-print
technology to interconnect components,
Figure 4. Half keyboard. Edgar Matias and his colleagues developed this system introduced by ETH Zurich in 2001.
in 1994. Systems using the half-keyboard approach are available from the Matias
Corporation (www.matias.ca).

developers made the LART design platform (see Figure 7)7 in which devel-
available as open source to researchers opers integrated the actual computer
interested in using the embedded sys- into a belt buckle. They attached periph-
tem in their own applications (www. erals and interfaces, such as batteries,
lartmaker.nl). HMDs, and sensors to belt-integrated
Besides waist-attached and backpack- connectors. Researchers continue to use
worn units, researchers investigated this system in real-world data recording
further integration concepts in the and activity recognition investigations
early 2000s, such as the Compaq Itsy, today.
a pocket computer for speech recogni- Many researchers’ developments and
tion and real-time movie decoding. 5 application reports made clear that
Researchers at ETH Zurich investi- comfortable interaction with mobile
gated approaches to clothing-attached and wearable computers is a major chal-
electronics resulting in the WearARM lenge, related to managing the user’s
computing core in 2001 (see Figure 5).6 attention and providing convenient con-
The WearARM used flex-print technol- trols for information entry. Various see- Figure 6. IBM Linux Watch. Integration
ogy to interconnect components in a flat through and look-around HMDs have of a complete computing system into a
system profile. been developed that instantly switch wrist-worn device, presented in 2000.
In the ’80s, technological challenges focus between computer and environ- (image courtesy of IBM Research).
related to size, power consumption, and ment. The most convenient HMD might
weight constrained the development of eventually overlay a wearer’s actual able computer (www.tinmith.net). (For
wristwatch computers to simple calcu- vision with additional information more information on Thomas and his
lators. But in 2000, Chandra Naraya- and cues. Researchers have conducted colleagues’ work, see “Through-Walls
naswami and his team at IBM presented various investigations to augment real- Collaboration” on page 43.)
a highlight of wristwatch integration ity in this way, such as Eyetap goggles Sensors served as additional and
work with the “IBM Linux Watch” (see (www.eyetap.org). Bruce Thomas and later even primary information sources
Figure 6). In 2004, the ETH Wearable his colleagues developed the Tinmith for wearable computers, with the goal
Group introduced the Q-Belt Integrated system (see Figure 8) to study informa- of supplementing or even replacing
Computer (QBIC) as a new research tion overlay outdoors, using a wear- manual information entry by context

10 PERVASIVE
Wearable Computing

Figure 7. Q-Belt Integrated Computer


(QBIC). ETH Zurich introduced QBIC
for use in research and as a design study
in 2004.
Figure 9. Zypad WL1100. Eurotech
awareness. Consequently, mobile and introduced Zypad in 2007 as a
wearable computing systems became Figure 8. Tinmith. Wearable system wrist-worn wearable computer for
a prerequisite to record sensor data in that overlays computer information on emergency, security, logistics, and
research studies on context recognition. the wearer’s view, introduced by the further applications. (image courtesy of
One historical example of a distributed University of South Australia in 2003. Eurotech)
sensing and processing system is the
MIThril jacket of MIT, first presented tory in many industrial applications.
around 2003 (www.media.mit.edu/ The main remaining concern is battery
wearables/mithril). runtime, which remains well short of
Some approaches went even further the typically required 12 to 24 hours.
in this direction, aiming at integrating Another concern is the connections to
complex electronics directly into cloth- peripherals such as HMDs or special-
ing, such as jacket developments by ized sensors, which often require bulky
Philips, Levis, and Infineon. Research- on-body cabling.
ers often envisioned an entire general- In parallel to the aforementioned
purpose computer implemented on a developments, recent years have shown
textile substrate as the ultimate “smart an explosion in smart phones’ perfor-
garment.” mance and functionality. Systems such
as the iPhone and the Android phone Figure 10. OQO: A hand-held
The Present are powerful computers running full- touchscreen computer that has been
In 2007, Eurotech introduced the Zypad scale operating systems equipped with widely used in wearable computing
WL1100, a wrist-worn touchscreen a broad range of sensors. Being main- research.
computer, to the market for emergency, stream consumer devices, they have a
security, logistics, and further applica- form factor that’s widely accepted for com), and simple keypads embedded
tions (see Figure 9; www.arcom.com/ everyday use. As a consequence, the in jackets (such as the Burton jacket
wearable_computer/Zypad/default. wearable research community has been for skiers; www.burton.com), smart
htm). The device includes a number increasingly adopting them, in particu- phones are increasingly becoming true
of sensors, such as GPS, motion, and lar for long-term sensor data collection wearables.
audio to extend information input and and activity recognition applications. The key issues with current mobile
functionalities. Another device widely The default interaction with a phones is that they don’t offer suffi-
used in the wearable computing com- mobile phone currently doesn’t follow cient flexibility for combining differ-
munity has been the OQO touchscreen the wearable concepts. Typically, it ent functional modules and provide
PC (see Figure 10; www.oqo.com). It’s requires the use of both hands and full limited connectivity for additional
small enough that users can comfort- user attention. Thus, it isn’t possible to sensors or interaction devices. Often
ably wear it on the belt, features PC-like use the device while engaged with real- phones just provide Bluetooth, which
functionality, and has a broad range of world tasks, which is a key attribute seems inappropriate for interconnect-
interfaces such as USB host, Bluetooth, of wearable systems. However, with ing small distributed sensors with the
WLAN, and VGA. While such devices interfaces such as Bluetooth headsets, required runtime of several days. This
are still too bulky for everyday con- consumer-oriented HMDs (such as the has motivated ongoing development
sumer use, they’re perfectly satisfac- MyVu, for the iPhone; www.myvu. of platforms with a focus on modular

July–September 2009 PERVASIVE computing 11


Wearable Computing

Wearable Computing

suited to leverage the advantages of


clothing and textiles, such as that
they’re attached to certain body
parts (important for sensing) or span
entire body parts (relevant for com-
munication and large area power
generation—for example, using
solar cells).

These layers should seamlessly inter-


operate, allowing applications running
on the main computing device to make
automatic transitions between inter-
faces and sensing setups as the user
changes clothing.
Initial signs are already emerging
Figure 11. Mobile sensing platform (MSP). A mobile sensing platform supporting that systems are moving toward the
different sensor combinations, introduced in 2008. type of architecture we describe. The
Bluetooth headset is a good example
sensor configurations. As an example, into clothing (possibly even built on a of a widely accepted carry-on periph-
in 2008, Tanzeem Choudhury and her textile substrate). Instead we envision eral that allows the user to interact
colleagues from Intel, the University of future wearable systems that consist of with mobile phones while walking or
Washington, and Stanford presented four main layers: driving. Nike recently introduced run-
a mobile sensing platform (MSP) for ning shoes with an acceleration sensor
activity recognition research. The MSP • Mobile phone-like device as central wirelessly communicating with an iPod
used a module concept to attach dif- on-body platform for general pur- or iPhone, which nicely illustrates the
ferent sensor modules. Similar efforts pose computing tasks. It will likely concept of an embedded microsensor.
are underway in related communities, remain a standalone device carried in Increasingly, textiles provide the infra-
such as pervasive health and body sen- a pocket or a holster, not integrated structure for technology, such as sports
sor networks. in clothing. However, we’re likely jackets providing “cable channels” for
to see vastly improved connectivity headphones as well as simple textile
The Future to other devices and sensors, pos- touchpad sleeves that, for example, let
Our discussion shows that although sibly including interfaces to textile skiers operate their mobile phones with-
existing smart phone platforms cer- electronics. out removing their gloves. Researchers
tainly aren’t perfect from the point of • Carry-on peripherals such as head- have also demonstrated clothing-inte-
view of wearable applications, the main sets, displays, and textile touchpads. grated solar cells.
concerns aren’t the computing units and Such peripherals will facilitate real
their form factors. The key issue is the wearable interactions, making the
connectivity between the main comput-
ing unit (which will remain some sort of
commercial, mobile phone-like “brick”)
system usable even when the user is
interacting with the real world.
• Microsensors deeply embedded in
W hile the emergence of smart
phones as widespread versatile
mobile platforms has rendered classic,
and other devices, sensors in particular. accessories, such as rings, shoes, and general-purpose wearable computing
The latter are what really differentiate a belts, and, in some cases, encapsu- devices obsolete, their emergence is
wearable system from a mobile phone. lated in clothing. Such sensors are a powerful enabler for a wide range
In most cases, the other devices should essential to provide the system with of wearable concepts, systems, and
and will be tightly integrated and pos- environmental awareness and imple- applications.
sibly even built with textile technology. ment many health and sports related
Thus, it seems that there’s little space for applications.
further research on dedicated wearable • Sensing, communication, and power Acknowledgments
computing platforms. We also argue generation infrastructure that isn’t
against the classical wearable vision of just built on textiles, but actually The authors are grateful to many researchers who
a computer (or for that matter, a phone implemented in textile technology. have contributed photographs of their wearable
or a MP3 player) that’s fully integrated Such infrastructure is optimally computers for this article. Moreover, the authors

12 PERVASIVE
Wearable Computing

thank Thad Starner for his comments on an earlier


draft of this article. EU WearIT@Work project partly
sponsored the author’s work.

for Articles
References
1. E.O. Thorp, “The Invention of the First
Wearable Computer,” Proc. 2nd Int’l
Symp. Wearable Computers (ISWC 98),
Call
IEEE CS Press, 1998, pp. 4–8.

2. T. Starner, “The Cyborgs are Coming, Be on the Cutting Edge of Artificial Intelligence!
or, the Real Personal Computers,” tech.
report TR-318, Media Lab, Mass. Inst.
Tech., 1993.
Publish Your Paper in IEEE Intelligent Systems
3. T. Starner, “Lizzy: MIT’s Wearable
Computer Design,” 1993; www.media.
mit.edu/wearables/lizzy/lizzy/index.
html.
IEEE Intelligent Systems
4. E. Matias, I.S. MacKenzie, and W. Bux-
ton, “Half-QWERTY: Typing with One seeks papers on all aspects
Hand Using Your Two-Handed Skills,”
Companion Proc. Conf. Human Fac-
tors in Computing Systems (CHI 94),
of artificial intelligence, focusing on the
ACM Press, 1994, pp. 51–52.
development of the latest research into
5. W. Hamburgen et al., “Itsy: Stretching
the Bounds of Mobile Computing,” practical, fielded applications.
Computer, vol. 34, no. 4, 2001, pp.
28–36.

6. P. Lukowicz et al., “The WearARM


Modular, Low-Power Computing For guidelines,
Core,” IEEE Micro, vol. 21, no. 3,
2001, pp. 16–28. see www.
7. O. Amft et al., “Design of the QBIC
Wearable Computing Platform,” Proc.
computer.org/
15th IEEE Int’l Conf. Application-
Specific Systems, Architectures and mc/intelligent/
Processors (ASAP 04), IEEE CS Pres,
2004, pp. 398–410. author.htm.

Oliver Amft is an assistant


professor at TU Eindhoven.
Contact him at amft@
tue.nl.

The #1 AI Magazine
www.computer.org/intelligent
IEEE

Paul Lukowicz is a full professor at the Univer-


sity of Passau. Contact him at paul.lukowicz@
uni-passau.de.

July–September 2009 PERVASIVE computing 13

You might also like