• The Uber-Spatial Web Browser

• The Clickable World Lightfield

• Medical/Healthcare App
• Sensoryware Games Cross Platform
\ •
1
w w MI I 1 V V

Screentm
7 ' '
\ • •
\••\••
 ::
\K
rr./

0.
 . .
•
•. ';'•::••••••• ' ' • ' '''''''
s.s.••••• •••••••
7
7 .0
 ..
u 1'4

•• •
• •••
•• ..

•• •

...

ii/1l: min

fiiiFi
 . .. . ..
• ei/
 Magic Leap Sensory Weartm
Music Venue Applications

Our studio will develop initial applications that will show off the
capabilities of Magic Leap in the music space.

Digital Live Artisttm will "beam" an artists in full scale and digital presence
into your home - enabling you and your friends to enjoy a personal
concert at home from your favorite band.

Digital Music Venuetm will "beam" you and your friends into a amazing
digital space it will look and feel as if you are at a live music concert.

Magic Leap will also partner with an array of artists, labels, publishers,
and managers.
V.=
• \-4
Digital Live Concerttm
 a ic Leap Sensory Weartm Systei
Beta Applications

The technology demonstrated in the Speakbot

app (demo) paves the way for Monster Battle
and Digital Live Artist.

The Development for Wire

World & Digital Live Concert paves the way for
a multitude of other applications and tools in the
SDK.
 Our Users:
Persona Overview

MO
AVERAGE GAMER MMOG EXTREME GAMER COMIC-CON

Average Andrew

Soda! Sarah Samantha & Greg Taylor the Coe the icd
Teena9er •• •
Yryry- .. - „•, --

GIRL GAMER COOL KIDS UNDER 18 UNDER 6

TEENAGE GIRL OUTDOOR GAMIFIED ANTI-GAMER
TH WORKER-

ara the Teenager Outdoor Owen Waiter the Worker

••/////////////////////////////////////////////////////////////////////// •

DJ Magic Mix

MUSIC CULTURE
 Sprint

amazon
eZz/
044'

........
........
mm.3informs:""""- estg.

cont„
&-ftitOr6-'pattheitttottabbratof.

•••••••••••••••••••••••••••••••••••••••••••••
 Product
Overview &
Design

///
 •§
•
•
•
•
•
•
Sensory Weartm System

Backlit on/off finger slide

Molded in textural pattern

*:•.•!:4r;$;r:i:%;
Sensory Wear System

•Novel technology which "paints"

images on to the retina

•Reality Engine - Cinematic

Realitytm Depth Technology provides
for lifelike depth realism

•Blends the physical world and the

digital world

Registers and localizes the world

CLOUD SERVERS

Magic Leap Sensory

Weartm System
Massive Parallel State Computing
Cloud & Grid Network
Shared Resources To Enable World Platforms

MAGIC LEAP
•
• WORLD OBJECT STATES

0
fr
USER GRID
•
it

**6004*********
045 **E:36***

0 ******0 MAGIC LEAP

WORt41.
 r , v,7, /7/ „as4
A % d A iii/.
J

• General Purpose Wearable

Computing
• Initially Targeting $65b+ Gaming
Market
• Can Expand To $100b+ Mobile
Comm Market
• Enabled By Proprietary Scanning
Fiber Projector & True3D
Technology
 Sensorywaretm System:
Current Design Families

Ma
 ..........
.........
..........
...........
.............
.........................

7
 v/‘ y
, r/
iii/ 'z A A A z owa.
Engineering Program Management
• Agile process
• Task/ownership assignment
• Schedule
System & Software Teams
• Architecture
• Alpha prototypes
• Integrate with Dr. G Invaders Alpha
Optical Engineering
• Benchtop Testbed
• Optic System Simulations
Industrial Design/Human Factors
• ID
• Personas
• Ergonomics
Preliminary Component Architecture
Vniumafrie. Rfinorialc
464.4m000

.;i44W3x0.d...% Scx
SX.:10.XX;

YI!..14f4Z*%

•
11!

xv.6.,:ekt
no?. • .....
 7 r ,/,

Volumetric Model OTS ID Model Custom Integrated

Parts Components
 Design Attributes: Lite, Gamer, Extreme Gamer
A

Lite

Extreme Gamer

DESIGN DIRECTION
›),
"A THRO"
 %:( V ... / r. .
/ ' ,, : :- %:0::.A-V
..:!:,:' ' •/ Design Attributes: Magic Glass, Organic, Minimal, Human Tec
/.. ..A IA .d.:i. .. 4:: ....... ...:' ../ .4.V. /. .:/:: 0:/':./...
:V .
A

41;;;0*4"
.

DESIGN DIRECTION
›),
THRO CLEAR"
 A
v
Design Attributes: Magic Glass, Organic, Minimal, Human Tech

: : :•: """""""""""""••••••••••••••••••""

46;7/

DESIGN DIRECTION

"CLEAR"
 /, ,
4f. /, .47.0 z
/W/ 0,/ /
,,,,,,,,,,,,, • ,,,,,,,, ,, ,,,,,, ,,,,,,,,,,,,,,
,
„0/ "1
"/
r
 "

/7/

.• •.
. •:•:... •
f
 ,
- /Z // /r

•z%
••••••:!, text"'
,
 •

,,,,,,,,,,,,,,,
:%%"/Afe.yhreee4f,
V

/:*
/ 40/
„, 4• / 4/i , /4/ / / 0 4
400

4
ee:
 er n efface
ma 't(
 _SIGN
Contents and Organization_ ••
Preliminary System Diagram rMX* XS X9 S. WO S. 004 JOGS X* CRS X9 S. VAS.004.41

g. XV VV. S. VV. VSg

VS VA.. W. ...A., /A/ IV, /A* VA./. /.4 VA./ IV, 4. We /A* WVA. /A/ IV, VA./ ri..n /4, /4 .1. IV, VA./ e.

ENTERTAIIIMEP,I
NA:! GAT ON RC:A.
)1j ( 31' ITY TOOLS
5
,„„„„„„„„„„„„„„„„„„„„„„„„„„„„„,

• • ;••.,:".%

zz
;• ,5:;;•
/,•;;',
•„.,••

X. X. 44..
$
5
VIDEO 5'7A PY5 , g-p
•,.44
•• • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • •••
HY OM VA ma ve v... me vv. OM VA

XS VS. SSC XX. XS X. OX XS SS, XS VS.

.ip .0 VV, OM VA Avr ve v.. ve vv. OW VA Avr W.
g
frS,

p Determine the scope of the systei ,

5
,3 • •,,•;•$:
'v..). •••••••• and
#4 NEWS
PHOTO g
" ••;;;'••.•:,r,•:;y:1
44, g

APY Alie HA§

r el,.

" iteratiVf •••% • ;7,

e,51 e,4%%11 n rn
FILE $
VA ma ve v... me vv. OM VA AV VA OA
▪ CORE CONTENT
Areas of Focus

nformation Architecture / Content Organization

Navigation of Content
0 Primary navigation
Secondary navigation
interaction / Input Styles
Direct vs. Indirect / Physical vs. Virtual / Gestural vs. 7"raditiona I Etc.
0 Direct vs Proxy
0 Floating vs. Mapped
Scenario Based Brainstorming
For Example -3 User wants to connect via video with a friend
0 Context: Standing/sitting/walking
0 Environment: Home/work/public space
Social: Open vs. discrete
Aesthetics / Visualization
. Ul Philosophy
UI Philosophy

n./Inr TrA ,T

Intelligent / Empathetic (context specific)

Fun / Playful interaction (when appropriate)
Symbiotic (user aware)
Adaptable (system learns, user learns, idea of scaffolding)

just because you can do it, doesn't mean you should.

o 'wow actor" should not trump usability
Aim tor a long "wow"
4.5xQ
omv0'0%w (.;
Hula-Hoop Interface

........

A 'swipe' hand gesture brings UI 'ring' UI 'ring' presents user with User selects application/menu object
into the users field of view, application/menu options (scrollable) to expand experience (experience
varies depending on the application)

This could be the first step to opening

up 'magic rooms'
Magic Portal Interface

Gestural interaction used to

initiate new 3D portal

Portals provide access to system

contents (apps, games, tools. etc.)

Navigation or method for "drilling

down" tbd

Portals can be opened on any sized

object (or open space), including
small pads for discrete interactions
Magic Portal Interface

Specific tools can be assigned to

specific objects so that they open
automatically, eliminating the need to
navigate the UI

Virtual 3D objects can be

removed from the portals and
mapped to objects in the room

This interaction design principle

would enable users to build
virtual 'magic rooms'

...........
.........
.........

•• ,,,,,,,,,
Expanding Hand Interface

Image recognition in the system brings The user can select an item from
up the primary navigation menu when the menu or spread fingers to
the user holds up his/her hand expand menus
Expanding Hand Interface

Alternatively, users can rotate

through menus using a circular
gesture in the palm of his/her hand
Map to Environment Interface
........
User pinches virtual object to
be mapped and holds gesture
Objects that can be mapped
to in the environment are
illuminated
•
Holding the gesture, the user User opens hand to map the
moves his/her arm towards the virtual object to the physical
environmental object to be environment
mapped to
Both objects are highlighted in
the same color to confirm action
Exploration of Primary Interaction
 Scenario Based Brainstorming

•
' '/ //# 1

VA
Content Organization A New Platform

. •
..• • ... •• • • •• ••.x/Aw''
......•.•

.' ..'..... '•.

:vvm.,:,0;,•„//..,//w/7/4/
,W;)4%;,;
MMERS ,ON ,SRRATION
Common Interaction & Input Gestures

Swipe the side (Sio

• Spread hands apart
t Plovement
▪ Bring hands together
wrs;t, movements las ),)nosed to rde arm move
y
!•%,

• Al aVe

• Puli hand back • we / 6( (“.Ao

Swipe to the side (s ow) - Flip hang over

• Hip hand over.

sz Close hand
the sde fr-"-"a ri
• Siie to
Pinch- thumb to fore lint
• Pause (hand, .finger,
Stab (Pont)

Gesture auidethi
Intuitive
Ergonomic for a wide variety of body sizes and abilities
F"laid
Scalable / Discrete (when appropriate-
Cufturally accepted
MME, ,SON INSPIRATION
The Aeon Project

Expanding radio menu

Icon based main menu
3d helix content management
Pop up 2d alerts
VIDEO:
h tp,://v ww,yankodestn.comI2011/08/021 (-)n
be% ond-au emented-realit

i#1.;14,41:
MK,E, ,S,ON INSPRATION
Mediating Mediums — The digital 3d

2d and 3d objects dl splays

Mapping to 2d sue faces (real and virtua l
Site recognition
Visualizing / manipulating virtual objects
VIDEO:
httgiAwww,yankodesio.com/2011 /09114/virtual-
architecture/
MKERSION f IN SP RATION
"Sight"

r" i ig and mapped interfaces

r
Site recognition
pup tracking as a means of navigation
fe,
Navigation of content
VIDEO:
http://www.fa stodestn co mil 670420/watch-
what-ha ens-if- oovie-s lasses-are-evi
m , ERS,O Ni i, SP RAT!O N
Ringo Holographic Interface

Flu a-hoop like interface

Navigation of content
Data entry / Game play
VIDEO I:
h 2://vommyoutt be.comiwatch?v=t0H I NiNia6zX
M , E , 3,0, / ,NsPRATION
3D Navigation with 2D platforms

3d storage navigation space

Visual grouping by subject and/or color
Organic navigation style
• VIDEO I:
httg://www.yout be.comiwatch 9 =r0 .•4
u4
VIDEO 2:
h ://www.yo
p co m ANa t ?v= , xn ip7r
MN,F S ON / NISPIRATION
.g,„„. 4 / `,/„, e 4

3D Organization of 2D Content

Organization of 2d icons l content

exilD6 ty (maybe too much?)
Personalization
VIDEO:
h tp://www,ted.comitalksianand___a.garawala de
nos i bumptop
 ,soN i INsp RATION
The Future of Firefighting

.............

:~W:1 Hand mapped interface

Layered Content
,/ Constant always availab e, easy o
access, corner of user's FOV
On Demand — gestural interaction to
initiate, menus to dig deeper
Alerts — pop-up style icons
VIDEO:
tapillwww.youtube.comiwatch?v=QQA11122........L

WO'
rOE ,a0N INSP RATION
Other examples

Radial menu
Scalable 3d virtualobjects
2d display of information
Floating interface
VIDEO:
h tp:Mmtvw.yo itube,com/wa ch?‘"=Wt,7rnn,

.. . ......
r7/777/7

we" ''PO, 00 o0 PZ4

USER 1NT,„„„RA.CTON
"Rooms" Scenario

Average Andrew:
• 34 years old
• Civil Engineer
• Sports enthusiast, fantasy football

Scenarios:
• Working at the office 4 message from co-
worker comes in (alert)
• Select virtual "room" from living room; change
from entertainment room to work room
• Open/access specific application from one ......,:::::::::»

room while in another room (i.e., open camera

app from the entertainment room)
OFF CE ROOM
31
"Rooms
OFF CE ROOM
"Rooms"

vex'. //// . . . . ...

,„ 4
OFF CE ROOM
"Rooms"

*kw
OFF CE ROOM
"Rooms

..... . ...

..stentit
ori;tfi e;',ws

...
USER ,NITERA.CTON
Navigating Rooms

;moo Scenarios:
Select a room for use
ffe
Navigate from FrIt rtainment room to Work room
USER ,NTERACT1ON
Navigating Rooms

SELECT A ROOM FOR US

r•//////////////// •

•••••••;•,.,

,,,,,,,•• • • • • • •
;:i?:,;i;7;7;7;7;!;!;!:,....... • • • • :55,..V.V.V.V.,

Physical Living Room Virtual Entertainment Room

USER ,NTERACT1ON
Navigating Rooms

'AV GATE BETWEEN ROOM

...............

Entertainment Room Work Room

777777
USER ,NTER,
Selecting and/or Navigating Rooms

or. Demand: User inout to access menu system

o Gesture — i.e., hand motion up

o Button on Glasses or Pack

o Voice command

tye tracking
3D C,„„t„JST,„„„S
Gesture to open icon based clusters
3D C,„„t„JST,„„„S
Gesture to open icon based clusters

Provides quick access to non-functional rooms; different gesture to pull up comprehensive menu
Functional group of room based applications

Provides access to functional tools and applications while in another room; mini work station
 00
Functional group of room based applications

Swipe through context specific rooms

 ROOM PREV1EW
Swipe to navigate available rooms

.. ................................... .. ,,,,,,,,,,,,,,,,,,

. .

W.+

Location specific rooms; rooms have previously been mapped to physical location
 „OOM PREV1E N
Swipe to navigate available rooms

Navigating aesthetic "skins” that have been mapped to the living room
HIE, ,R „,,HA„„ MENU SYSTEM
Virtual touch pads

Navigate primary menu to access user defined rooms; rooms are a feature of the primary navigation menu
H1E„RCHAL MENU SYSTEM
Input by proxy
777777
CONSTANT RADIAL MENU
Peripheral vision
. .
. . . .
........ . .
.
.

Expandable menu always available in the upper right hand corner of user's field of view
CONsTAN7 RADIAL MENU
Peripheral vision
•• •

•;;;;skhOiki:,

•• •

fr

Expands to reveal available rooms

PRE-MAPPED ME, S
Based on physical location mapping
;0050000'

Projection based proxy input

PRE-MAPPED ME, S
Based on physical location mapping

Virtual touch pad

PRE-MAPPED m::, Li
Based on physical location mapping

More detailed navigation menu appears once the specific room is selected
USER ,NITERA.CTON
Navigating Rooms

Scenario:

Select application for use while in a specific room

USER ,NITERA.CTON
Navigating Rooms

Work Room at Home Specific Application (i.e., Camera)

DMPREHE„Si fE 'H.„„J,„„A HOOP MENU SYSTEM
Open SportsCenter while in 'work' room
Access specific app while in entertainment room

„,,

Navigate existing rooms to find specific apps

Access specific app while in entertainment room

„„.

0•0*. g
g •;:f •

Map/copy apps into current room

Access specific app while in entertainment room

App becomes permanently mapped to entertainment room

 JSE ,PPS
Gesture as hot key for the most commonly used apps

Define common use apps; unique and intuitive gestures for each 'common use app'
USER 1NTERA.CTON
Rooms

VVHA SAROOM?

A convenient grouping/organization of system tools and applications

Thetools/apps have a relationship that makes sense to the user

(supports the user's m nta

The rooms could be defined by: activity or goal, locationi.e,, work,

home, e c. time of day, etc.

Rooms are defined (created) by he user to support understandin

ease of use, and search efficiency

Rooms support navigation of the d iferent system tools and app !cations

Tools/apps not located within a specific room" shou d be readily

a ai rb e and easy to locate
 ,NT„„„,R, ,CT1ON
Office Room at Home

0:
. •
//Av
USER ,NTERA...„,./07,0N
Entertainment Room at Home
./..W/// ee-- xxxxeeeee effee effeeffeefee xxxxxxeeeee effeeffee

'' ,

iq]
•
USER ,NTERA,..,„,07,0N
Entertainment Room at Home

4,4><4,
4.4a0.44Venj,
444,
07:W ?.:40$'44%.,, 4 4;•$-';

POIV4444r!, 04;
//n, 7,
;41<r:P e'Pr;

441,44ral ogtve

444;$P1-

::::gEgESEggg
„„„„„OfloilOtt-

40:47,,,,m444440:44f444400000
.44,
USER ,NTERA...„,./07,0N
Entertainment Room at Home
•

zezelf/Xeg"

r
;r4:4,1

emeememeeeee
V .,,,..•,,, "pop
A0,,,,,w.,,4,44,,,„,,.,
aSCUSSION
Rooms

' ROOMS, EAS:

Users create rooms based on how they think features should be grouped
eature of the system)
1- 11 system provides pre-populated rooms based on a theme: activity based,
location based, time based, intelligence based, etc.
Combination of system and user defined rooms
 ,,„„,JSSION
Next Steps

NEXT S i,t5dREAS OF Fa US:

Deeper dive on interaction methods for:

Primary and secondary navigation
Set a KA customizatior of menus, dashboards andother content
"Room setup and e-a-= res
Features AND furth r ap enab apps
Exploration and definition of toy B

Create workflows for primary tasks

Determine level of fidelity for next round of deliverables
'frPAgffw,, yew
;4'%gs%oPot,4%
MMERS ,ON ,SRRATION
Common Interaction & Input Gestures

Swipe the side (Sio

• Spread hands apart
t Plovement
▪ Bring hands together
wrs;t, movements las ),)nosed to rde arm move
y
!•%,

• Al aVe

• Puli hand back • we / 6( (“.Ao

Swipe to the side (s ow) - Flip hang over

• Hip hand over.

sz Close hand
the sde fr-"-"a ri
• Siie to
Pinch- thumb to fore lint
• Pause (hand, .finger,
Stab (Pont)

Gesture auidethi
Intuitive
Ergonomic for a wide variety of body sizes and abilities
F"laid
Scalable / Discrete (when appropriate-
Cufturally accepted
MME, ,SON INSPIRATION
The Aeon Project

Expanding radio menu

Icon based main menu
3d helix content management
Pop up 2d alerts
VIDEO:
h tp,://v ww,yankodestn.comI2011/08/021 oin
be% ond-au emented-realit-

.
.00:::.00fti.:00tifOpAvit
MK ,E, ,,S ON 7 INSPRATION
Mediating Mediums — The digital 3d

2d and 3d objects dl splays

Mapping to 2d sue faces (real and virtua l)
Site recognition
Visualizing / manipulating virtual objects
VIDEO:
httgit,„vvywyankodesign.com/2011 /09114/virtual-
architecture/
MKERSION f INSP RATION
"Sight"

* r=~ lo tirng and mapped interfaces

Site recognition
tracking as a means of navigation
Navigation of content
VIDEO:
http://www.fa stcod esigp .co mil 670420/wa tch-
what-ha ens-ifµ oovie swryiasses-are-evi
 ERSJDN / 4NSP RATION
Ringo Holographic Interface

Flu a-hoop like interface

Navigation of content
Data entry / Game play
VIDEO I:
h 2://vommyoutt be.comiwatch?v=t0H I NiNia6zX

OV"
MNE, 3,0, / sPIRATION
3D Navigation with 2D platforms

3d storage navigation space

Visual grouping by subject and/or color
Organic navigation style
VIDEO I:
httg://www.you t be.comiwatch 9 = r 0 ,C4
% 6
u4
VIDEO 2:
h (,.;ortilwatc; ?v=!', , xn ip7r
M ,E, ,S,ON f NSPI RATIO N
3D Organization of 2D Content

Organization of 2d icons l content

F exilD6 ty (maybe too much?)
Personalization
VIDEO:
h tp://www,ted.comitalksianand_a.garawala de
nos

.464Y ,zzZ,
 ,s/oNi INsp RATION
The Future of Firefighting

Hand mapped interface

Layered Content
Constant always available, easy to
access, corner of user's FOV
On Demand — gestural interaction to
initiate, menus to dig deeper
Alerts — pop-up style icons
VIDEO:
http://www.youtube.comiwatch?v=QBAnr2g
MK,E,S,ON INSP RATION
Other examples

Radial menu
Scalable 3d virtualobjects
2d display of information
Floating interface
VIDEO:
h tp:Mmtvw.yo itube,com/wa ch?‘"=Wt,7rnn,
, r 7 7 6'6
z
717

Core Technologies
Scanning Fiber Projector
• 1 mm x 9mm
• Low power consumption
• Near zero weight
• High-resolution RGB
• Natural 3D Cinematic Reality
• Breakthrough technology solves 100+ year
old stereoscopic 3d problem
• Proprietary Machine Vision Portfolio
• Breakthrough tech developed at NASA

confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
nfid6 sri
 A
/
/ /
//// / /
7. 7 74.: • • / AO 7•
.././##:0 o ••%' 0';,.0 //4.
 r 4r „.., r, ,„„
/„„ , 7 v„
A d A % A /4 A
im , // •r/ z ; , A

r4r,r„‹, ,

% r
V fj2', '/ SS
•
•
•
M S17•/
4, J't r,e
•
•
A0

r, , , , ,
//4

confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
 7,,„ , 7r //, /77/
27
7 M
A /d z / ,

• Complete Wearable Computing

Platform & Ecosystem
• Magic Glasstm See-Through
Display
• Focus on Gaming/Entertainment
•
• $500b+ Mobile Computing Market
• Enabled By Proprietary
Ultralightweight projection And
True Lightfield Technology
• Natural Blending Of Digital And
Physical Worlds

confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
„, •
Overview

. .................................

confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
Additional Game
Applications

Ma
 .
j.
0*
• 4/ / e-55 Z5= OZ555: ////////: Ak/4/444.y.../~/...;
/444.4,44.4..../.44/44.4/4, •
4./
•• 4,4
•
 ''''''''''''
'''''' ''''''' ''''''''''''''
'''''''''''''''''''''
'''''''''''''''''''''''''' '''''' •Wee•f(*, /We ... .4,
7.

,97///7
•
V;53.,
4,
/A1 //////////..1.1.14446w. 44,ezeAvir.i.iiikir.,
,totototov.e.ow........" %WV', ,
;>.
""" '''''''''''''''''' ''''''''''''''''''''''''''''''''''''''''''''''''''''
 .V"

Virtual Mods •

Digi/Phys Blend
 Dr. Grordborts Invaders
• First ever true 3d/ lightfield interactive game
• Existing cult fan base around Dr. G's awesome
ray guns
• Invaders can expand into massively multi-player
franchise (ex: Halo)
• Novel Physical/Digital Experience
• Virtual Mods
• Novel game engine concept virtual bots use
real Al in the world
• User — character interaction is key
• Stress tests and helps develop our SDK!
 . . .
wz. • • %. nyy, • :4;

: ••

„„.... . . . 4.• ••• ••

 ic EPS

ENSORY E , TEM

VLU N ,,,NsoRywAR

• Setmtrywigre System Attd Seasormetre

%old briitg ti.> life tile ni4c tha you have tway
n't(nit% nrld Ac
• Rod tfie. Averoto, add have tleLof your

yen,' own!

r411.0:,d 6. WEI

z.

?;"
ENSORYWAIRE rIASS ES
MTN§ IOUS DESIGN STYLE

•
 /„.
r
;//
„„„„„„„„
/4
 • .5
4'.

Strp Oi
Rad aloud from your Book Of Spollint

Sop Um-
Wave &aougyveaNI, Wand % 4.6 dltrigiu
motiom

SKt Thrtz'
Yon •very own tw.,41h wjrat!
 The Book Of Spells

• Technology is magic
• Wands that work!
• Huge Magic Leap tentpole franchise potential
• "iTunes" store for digital spells create, share,
sell
• Physical and digital sales
• Novel Physical/Digital Experience
 SENSORY USER NT R CI101
magic lea
shidk
Grocery S opping Scenario Workficr

A mother and her child go grocery shopping together, and decide to use
Sensoryware to mak.e their experience more efficient, e f•i3ctive and enjoyable.

e
0( ...$42,
rAP,S4? / p. 9 0. „.!. • ...9* • ...
Scenario Workflow

Morn, with her daughter in

tow, grabs a cart from the
entrance of the grocery store..
A series of relevant apps
launch automatical
including:
Grocery first (or en zed by
user defined criteria,
dinner recpes)
Coupon book
Recipe book.
Recipe builder
Cost of shopping cart
Scenario Workflow

.... . . .. „,.
•••:„. .„.„.•

.... .... . . . . . . ... . . . .

While in the produce section,

morn weighs a food item on a
scale. The price of the item is
automatically entered into the
.shopping cart cost totals Additional
features of the system are seen in
the background
The 'smart grocery list is
automatically updated based
on location (e.g. focused on
fruits and vegetables in the
produce section).
Food items on morn's list are
visually hi. hiighted in the
scene.
 W orkflow

The child launches a scavenger hunt ,ipp to make b& shopping experience more engaging
end educational. The challenge is to locate food items from different countries around the

Scene 2b Points are added to the child's score as she dentif food items and her virtLiai
/ ;•••
•.• • • r;"
.;./• •1 %•
./ ••••eA %

.... . . . . .....

•"'
Scena10 Workflow

In the cereai aisle, mom

salads a particular mrea!
explore additional meladata,
including:
Dietary restriction;:i
t\lutritional information
si.ars)
R*of.luct revie,„Ais • odurA
comparisons
Customer comments
Available coupons are
pref.iented to her by Tbuc
0
ss•
0
 Workflow

At the end of an aisle; a virtual

Mario Bataii demonstrates a
simple recipe b custorners
the necessary ingredients are
available in the end dap,
•
Scenario Workflow

f
f
f
A
.. . • . •••••••••••••••:,:,:••x,x.x.x

While in the we section of

the grocery store, morn
decides to search for a
specific wine. A virtual map
used to navigate to the
desired wine..
While -walkng through the
aisles, data appears attached
to different wines, including
Recommendations from
friends
Wines that appear on her
personal wine list
.444444444444444444444444444444444444444444444444.144444, ,,,,
,,,,,,,,
Scenario Workflow

it it it it it it it it it it it it

Morn concludes her sno ping

experience by walking onto a
Magic Leap checkout map,
which rings up all the groceries
on her list and mentions any
items that may have been
for
She then czmpletes her check-
out through a virtual display ----
no crt:3dit card necessary. ......66666666666666666666666666666666666666666666666666666666666666666666666666666666666e.466666666666.6.10:0" ...... . Me.,..5 666666666666e
vs,
•••••••••• •ss,
Grocery S AA S‘arAi-AA 7*-0 0." %AI"

Scenes inciuded:
Virtual bookstore (1 scene)
. urgicai procedure (4 scenes)
Yoga .1 scene)
Garnified exercise scene)
Garnifie worker ( scene)
 Workflow

04.

Stella operi...3 Up her book totem

to reveal an imrnersive virtual
bookstore experience.
The virtual environment
combines the convenience of an
online txyAsiore with the
experience of e
environment. awnwrmw..vz.z.z.z.z.z4mAmr•z4A4.,v,v,vx,,vx.v,z,,v,vx.v..vx,,vx.v..vx,,vx.vx,,vx,
Scenario Workflow

A surgeon and his team,

including a visiting virtual
surgeon, conduct. a pre-operative
planning session for an
upcomng mitral valve
replacement procedure.
The patient's pre-mapped
anatomy is available in 3D for the
teem to analyze during the ;ggittglailik„1„,1_,
planning.
Scenario Workflow

Duhng the procedure, the

surgeon is able to reference the
pre-mapped 3D heart for
improving placement accuracy.
Meanwhile, a medical student is ..... ...... ....
able to observe virtually from her
classroom..
The patient's information is
readily available to confirm the
pathology; and avoid any critical
errors.
Scenario Workflow

DUring a post-operative meetin

the surgeon is able to describe
how the
surgery went using a
cross section of Stella's virtual
anatomy.
Stella's husband is able to join t
meeting virtually whiie et work. 4. • 4444.:
Scenario Workflow

When everyone leaves the

hospital room, Steile is be to
changer her environment to e
more comfortable setting, the
beach.
 Norkflow

Stella and a friend join a virtual

-oga dx.:;F; from the comfort of her
room,
 Workflow

Stella enhances her indoor

training with a virtual bng
experience, where she can feet
like she's biking outside on her
favorite, route,s.
She is able to track important stat
like ride time, distance traveled,
and speed. A virtual avatar allow;
her to compete with h& own
personal best time,
 Workflow

A landscaoir
enhances hs job with a
virtual game, where the
is to follow a virtua
mapped pattern.
F'onts are received .for
accurately following the
pattern and 'lifting certain
score multipliers before he
disappear.
 SEs ‘-.A,,,RY\NA.;\E
mactiC . a
ditr4
K EY RD

litutefeW
&e 5 itelik rte
MC) USE

7;aa

. . ........
fjPER STONE
.,50-0/1 Wheel
R N GS
 4 a
wh elahn, AAA/
'TINY TOTEMS"

/led- if,
 Other ideas
• Plants - For high-dimensional representation of information,
map content to familiar nature shapes. Natured encodes
vast information in trees, grass, etc. Ex. let each person in
an organization have a virtual "plant" they can tweak. They
give the plant to the leader, and they encode the color,
shape, leaves, flowers, etc. of the plant with their status. If
overworked, could be withered, if unhappy leaves could fall,
if no resources leaves turn brown, etc. Leader can put all
the plants in a "garden." He gets high-bandwidth view of
organization through general color of garden. Spotting
problem/positive groups is easily graphically. The people
grow their own plants.
 Other ideas, cont'd

• Plant as e-mail - Let e-mail be a tree. Branch is a

person, leaves are messages. Old messages are
brown and eventually fall to ground. Twigs, sub
branches are determined by connectivity of CC's or
something. User can easily "prune" branches from
annoying people, or put those branches on the back of
the tree.
Magic Leap: Pocket Totem Concept
Over Time a Virtual Plant will
Virtual Plant grow out
Pocket size
(with Sensory Wear) Physical Totem
"Mini Pot"
"Fr

Virtual Plant will

response to:
Time
Day or Night
Sun light direction
Temperature
Attention
-Voice
-Virtual Water
-Virtual Fertilizer
--Tweet or Text
messages from
distance
Magic Leap: Pocket Totem Concept Flower opens with a message when
Virtual Plant the product is ready. Builds up
anticipation through the process
(with Smart Phone/Tablet) „.. ..„

Card Scenario ••••••:‘,

Capture Image,
on a Card

Billboard Scenario

'Building size Giant

ee/ Flower blooms

Captiitelmage on, a
Large fwilding size:
"""""" rd
,• ..... •.

Tablet