Professional Documents
Culture Documents
01 Introduction PDF
01 Introduction PDF
01 Introduction PDF
Applications of Virtual
Reality and Immersive
Computing
Bjoern Hartmann, Allen Y. Yang
Fall, 2019
Instructors
Joe Menke
PhD student
Email:
joemenke@berkeley.edu
Course Resources: Jacobs Institute
hAp://jacobsinsDtute.berkeley.edu/
Course Resources: FHL Vive Center
hAps://vivecenter.berkeley.edu/
Course Resources: Berkeley VR Club
vr.berkeley.edu
VR DeCal (CS198-080)
Prerequisites
1. Mandatory:
1. CS Lower division or equivalent (CS61a, CS61b)
2. Ability to program in C, C++, C#
2. OpEonal (but you should know about at least one of these topics):
1. User Interfaces (CS160)
2. Computer Graphics (CS184)
3. OpEcal Engineering (EE218A)
4. Image Processing (EE225B)
5. Computer Vision (CS280)
6. InteracEve Device Design (CS294-84)
Enrollment
Graduate students can enroll directly.
Undergraduate students:
To request enrollment, please complete the following form:
hZp://bit.ly/enroll-arvr-fall2019
We have a small number of slots available. We will email out enrollment
codes on a first come, first served basis for those who meet the prerequisites.
Grading Policy
Your final grades will be determined by three factors:
1. AZendance by you (10%)
2. Homework assignments (40%)
• Spotlight presentaEon of an AR/VR experience
• Follow ARCore/ARKit tutorial to develop an AR board game
• Develop an AR landmark tracking algorithm using OpenCV
• (Team) Develop a Tilt Brush app on Vive Focus Plus
Course Project Schedule
• Encourage students to pitch and form their own projects
• Pitch Day: Sep 24. Aeer that, all students must commit to one project
hAps://www.youtube.com/watch?v=LuqFP2Vx358
Sibo Chen, Junce Wang, SanDago Guerra, Neha MiAal, Soravis Prakkamakul
13
Example Projects
14
Administrivia
Course website on bCourses
hZps://bcourses.berkeley.edu/courses/1486180
CommunicaEon with Instructors:
Use Piazza! Do not send individual email – you can elect to only message
instructors for personal maZers.
Office Hours
• Allen:
• General: Tue 10-12, 337 Cory Hall or by appointment
• M.Eng students: weekly meeEngs previously assigned.
• Joe: TBD
Recommended Reading Material
• PercepEon: SensaDon and PercepDon
by Bruce Goldstein
• Virtual Reality: Virtual Reality
By Steven LaValle (and checkout his YouTube lectures)
• Computer Graphics: Fundamentals of CG
by Peter Shirley
• Computer Vision: An InvitaDon to 3-D Vision
by Yi Ma, et al.
• Display: Mobile Displays
by Achin Bhowmik, et al.
• AR/VR Market Research: Virtual & Augmented Reality,
understanding the race for the next compuDng plaeorm
by Goldman Sachs
• 3D User Interfaces: Theory and PracDce
LaViola et al.
Goals of the Course
• Understand the fundamental theories that enable VR/AR and Immersive
CompuDng (IC)
Sony 3D Viewer
SEGA VR Nintendo Virtual Boy
1958 1977 1980s 1990s-2010s 2012 2018
What is Reality?
The Senses of Reality
Reasoning Taste
Speech Touch
AcEvity Planning OrientaEon
Vision
Hearing
Smell Fina Muscle
Movement
Anatomy of an AR Device: HoloLens
Summary of Corresponding Techs
3D Audio InteracDon
Early Forms of Photography
Camera Obscura, circa 400BC First photo on paper, 1800s Kodachrome, 1935
3D Illusion with Perspective
46
Definition: Augmented Reality
• AR is a computer technology that augments a
physical, real-world environment directly or through
its indirect view computer-generated sensory
information, including graphics, video, and sound. AR
may alter a user’s view of reality, and may also
enhance one’s perception of reality.
47
Assignments
• Undergraduates / waitlist:
Complete enrollment request form
due Sunday Sep 1, 11:59pm
48