Mobile Augmented Reality Game Development Jeff Chastine Southern Polytechnic State University Georgia State University, Mar. 27, 2013
Hi!
Overview • • • What got us here? Paradigm Shift! Case Study: Qualcomm Challenges of AR Game Dev If time: code review
A Little AR History • 1968 • Ivan Sutherland • Optical Combiner
A Little AR History • 1992 • Tom Caudell and David Mizell coin the term “Augmented Reality”
A Little AR History Mixed Reality Real Environment Augmented Reality (AR) Augmented Virtuality (AV) Virtual Environment (VR) • 1994 • Virtual Reality (VR) attempts to completely synthesize • Augmented Reality (AR) integrates virtual objects into the physical world
A Little AR History • 1996 – Rekimoto tracks in 6 Do. F! – x, y, z – yaw, pitch, roll
A Little AR History • 1997 • Azuma states three requirements: 1. Combines the real and virtual worlds 2. Interactive in real time 3. Registered in 3 D
A Little AR History • 1997 • Feiner et. al create the “Touring Machine” • First mobile augmented reality system
A Little History • • • 1999 ARToolkit Free/Open Source Kato/Billinghurst Good for intro to AR
Visual Tracking (ARToolkit)
A Little History • 2000 • Landmark breakthrough! • AR with Duran
Hardware Requirements • HMDs/Displays • Rendering • Tracking
Display • Tabletops • Tablets & Phones • HMDs – Optical (see-through) • Stereo? – Video (closed-view)
Tracking • • GPS, HA-GPS, GPS/RTK Acoustic (IS-900) Electro-magnetic (Polhemus) Visual (ARToolkit)
AR Examples
Scenarios • Medical • Scientific Visualization • Expert/Technician 17
Scenarios • Medical • Scientific Visualization • Expert/Technician 18
Scenarios • Medical • Scientific Visualization • Expert/Technician 19
AR in Education
Navigation
Commercial Nightvision
Military
General Problems • Tracking Accuracy • Optical vs. Video – Optical – High Resolution/Fo. V. Synching/Delay issues, brightness issues – Video – safety: camera vs. eye offset • Registration Problems – location – lag in rendering • Weight/Battery Life • Interaction – Techniques – Physical objects
Other Issues: Interaction
Paradigm Shift! • Note: – Media is cool – Mobile is cool – Media+Mobile must be really cool • Unity supports scripting – Basic programming concepts – Reinforces OO – Javascript or C# (or Boo) • Provides scaffolding to remove barriers (or at least lower them)
Moving into Mobile Layar Nearest Tube
Moving into Mobile (2007) Magic Books
Moving into Mobile • ARToolkit on an i. Phone (2008)
Moving into Mobile (2009) I MAED A GAM 3 W 17 H AR 1 N 1 T – (not really, it’s called AAAARRRRRGH!)
Moving into Mobile
Let’s make a Magic Book • Mark Billinghurst et al. • The hard part is finding a tracker…
Mobile AR Gaming • Need a good tracker – GPS + Gyros is NOT good enough! – Qualcomm has released their free tracker! • Need a good/cheap display – Phone is a window into the virtual world • Need a way to make games/render + = Easy AR!
Not anymore…
AR Preprocessed Images (pictures + tracking information) Into the Image. Target. Textures folder Into the Streaming Assets / QCAR folder “Page” Textures Tracking XML file and data file
Very Cool Unity Mobile API • Input. acceleration – Returns orientation as a Vector 3 • Input. Get. Key. Down(Key. Code. Mouse 0) – Screen tap event • i. Phone. Utils. Vibrate() – Makes the phone vibrate • GPS/Location – Unity 3. 2 or Java Location. Manager interface and native wrapper
AR Demo
Using accelerometers
A safe place to get started • ARToolkit – – Free Written in C Uses fiducials http: //www. hitl. washington. edu/artoolkit/ • What you’ll need: – – A webcam A printer A compiler Graphics card?
The Qualcomm AR SDK • Free • Works with Android – Java – JNI – C++ • Runs on Qualcomm chipsets – HTC Incredible – Nexus One – Others • https: //ar. qualcomm. com/qdevnet/
Others • Dekko SDK – No training! • 13 th Lab’s Point. Cloud – Dynamic building of the scene
The Burden of AR Gaming • Printing out fiducials – Is this really “mobile”? • User training – Do your parents know what AR is? – How do you interact in AR environments? – Don’t block the tracker! – Don’t shake the camera!
The Burden of AR Gaming • How do you interact? – Point and click? – Tactile feedback? • Will people get physically tired?
User Acceptance is Key • • Tracking is a challenge Lazy players AR must “go beyond” ( and why AR? ) Where’s the killer app?
5 Common AR Mistakes (if you don’t believe me) 1. 2. 3. 4. 5. Poor education Not investing in content Different AR app for every campaign AR and 3 D for the sake of AR Make content engaging http: //www. mobilemarketer. com/cms/news/software-technology/14435. html? goback=%2 Egde_67494_member_226398138
The Future of AR? • Lots of hype right now • Project Glass?
Thank you! Questions?
Скачать презентацию Mobile Augmented Reality Game Development Jeff Chastine Southern
4c31e3397df8a33644f84ba9cbb12ff6.ppt