3D Human Motion Capture and Gesture Recognition AFDS June 15, 2011

Vision

Evolution

Evolution

Evolution

Mass Market Solution?

HIGH cost LARGE form factor HIGH power Very specific range Avoid daylight

XTR3D Offering

3D Motion Capture and Gesture Control

Software only Utilizing a single built in/ standard rgb webcam Gesture Control from a few inches to 20ft away from the
camera

Low footprint Daylight support

XTR3D Offering

Utilizing the existing camera to Turn Laptops, TVs, Mobiles and Tablets into Gesture Controlled Devices!

Technology
3D SKELETON ANALYSIS
Real time extraction of 3D skeleton joints in every frame Analysis of the skeleton allows for real time detection of gestures

The entire technology is based on software only, and relies on basic input imagery that originates from a single, simple webcam. Subject to distance and resolution, the 3D skeleton extraction varies from fingers to full body.

9
Proprietary and Confidential Information of XTR

Technology

10
Proprietary and Confidential Information of XTR

Technology

11
Proprietary and Confidential Information of XTR

Technology
XBuilder Development Tools
App developers can utilize XTR tech very easily Add gesture control to existing content!

Platform agnostic same tool, all platforms

12
Proprietary and Confidential Information of XTR

 LOW cost SMALL form factor LOW power Support a variety of ranges Support daylight

Mass Market Solution!

13

SCALING UP
Enhanced experience requires:
Multi user support Full body (add legs detection) Maintain High Precision

Higher resolution ~2MP Much more computing power is needed

14
Proprietary and Confidential Information of XTR

XTR on Fusion
Much of XTR code is based on image processing functions operating on 2D arrays Data is locally accessible Operation on one part of the image is independent from other parts.

Classic candidates for GPU porting

15
Proprietary and Confidential Information of XTR

XTR on Fusion
Analysis shows that around 65% of current CPU load can be offloaded to GPU.

When scaling up to higher resolutions this code is effectively over 80% of the workload

16
Proprietary and Confidential Information of XTR

XTR on Fusion
Sample function 1X3 morphological erosion filter Fusion Platform Brazos (2CPU cores, 80 GPU cores)

Resolution CPU time GPU time Speedup

320X240 2.5ms 0.48ms X5.2

1024X768 75ms 4.7ms

X16

17
Proprietary and Confidential Information of XTR

Lets see some demos.

18
Proprietary and Confidential Information of XTR

Thank you!

19
Proprietary and Confidential Information of XTR

Disclaimer & Attribution

The information presented in this document is for informational purposes only and may contain technical inaccuracies, omissions and typographical errors. The information contained herein is subject to change and may be rendered inaccurate for many reasons, including but not limited to product and roadmap changes, component and motherboard version changes, new model and/or product releases, product differences between differing manufacturers, software changes, BIOS flashes, firmware upgrades, or the like. There is no obligation to update or otherwise correct or revise this information. However, we reserve the right to revise this information and to make changes from time to time to the content hereof without obligation to notify any person of such revisions or changes. NO REPRESENTATIONS OR WARRANTIES ARE MADE WITH RESPECT TO THE CONTENTS HEREOF AND NO RESPONSIBILITY IS ASSUMED FOR ANY INACCURACIES, ERRORS OR OMISSIONS THAT MAY APPEAR IN THIS INFORMATION. ALL IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE ARE EXPRESSLY DISCLAIMED. IN NO EVENT WILL ANY LIABILITY TO ANY PERSON BE INCURRED FOR ANY DIRECT, INDIRECT, SPECIAL OR OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF ANY INFORMATION CONTAINED HEREIN, EVEN IF EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. AMD, the AMD arrow logo, and combinations thereof are trademarks of Advanced Micro Devices, Inc. All other names used in this presentation are for informational purposes only and may be trademarks of their respective owners. The contents of this presentation were provided by individual(s) and/or company listed on the title page. The information and opinions presented in this presentation may not represent AMDs positions, strategies or opinions. Unless explicitly stated, AMD is n ot responsible for the content herein and no endorsements are implied.

20