name: inverse layout: true class: center, middle, inverse --- # Augmented Reality and your Phone Jennifer Mankoff CSE 340 Spring 2019 Slides credit: Chauncey Frend, Indiana University .footnote[[Frend, Chauncey. ”Augmented Reality & the UITS Advanced Visualization Lab." 30 Sep 2016/28 Feb 2017. Digital Arts & Humanities Workshop Series. Scholars' Commons, Wells Library, Indiana University, Bloomington.](http://hdl.handle.net/2022/21293) ] --- layout: false .title[What is Augmented Reality?] .body[  ] .footnote[ Milgram, Paul, et al. "Augmented reality: A class of displays on the reality-virtuality continuum." Photonics for industrial applications. International Society for Optics and Photonics, 1995. [Photo Source](http://smartideasblog.trekk.com/augmented-or-virtual-how-do-you-like-your-reality) ] --- .left-column[ ## What is AR? A combination of - a real scene viewed by a user and - a virtual scene generated by a computer that augments the scene with additional information. ] .right-column[  ] ??? Differences to VR? Augmented Reality - System augments the real world scene - User maintains a sense of presence in real world - Needs a mechanism to combine virtual and real worlds - Hard to register real and virtual --- .left-column50[ ## Brief History - 1901 Lyman Frank Baum author of “The Master Key” imagines a kind of AR. - 1968 Ivan Sutherland invents first head-mounted display “Sword-of-Damocles” at University of Utah. - 1999 ARToolkit was created by Hirokazu Kato at HITLab - 2010 Vuforia for AR Mobile Apps was released by Qualcomm. - 2013 Google announces Google Glass. - 2015 Microsoft announces the HoloLens. - 2016 Niantic released Pokémon Go. ] .right-column50[  ] --- .title[AR Coloring Book] .body[ ![:youtube AR Coloring Book Video, SWzurBQ81CM] 0:00-0:30 ] --- .title[AR Climbing Wall] .body[ ![:youtube AR Climbing Wall, rjWcE25s7kQ] 0:00-0:33 ] --- .title[AR 3D Assembly] .body[ ![:youtube AR 3D Assembly, CONY3q3OdPA] 0:00-0:33 [Similar example in medical domain](https://www.youtube.com/watch?v=MS3h9_KPoBY&feature=youtu.be) ] --- .title[AR in Retail] .body[  ] --- .title[AR in Tourism] .body[  ] --- .title[Human/robot Interaction] .body[ ![:youtube HRI, mSCrviBGTeQ] Time: 2:15 ] --- .left-column[ ## Building AR experiences] .right-column[ ASSETS Display Interface ] --- .left-column[ ## Building AR experiences: ASSETS] .right-column[ Sources? - 3D Scanning - Photogrammetry - 3D Authoring - 3D Repositories - e.g. Smithsonian X 3D https://3d.si.edu/browser - e.g. Thingiverse ] ??? Other media? --- .left-column[ ## Building AR experiences: Display Hardware] .right-column[   Requirements? ] ??? Camera Display ... --- .left-column[ ## Building AR experiences: Interface] .right-column[ ![:youtube Pokemon Go, vgfZbgwrbx8] - 4:00-7:20 ] .footnote[https://www.geekwire.com/2018/pokemon-go-evolved-remain-popular-initial-craze-cooled/] ??? Discussion of interface needs --- .left-column[ ## Combining real and virtual Registering assets with the scene Tracking objects ] .right-column[  ] ??? 1st picture - real world 2nd picture - real world with virtual objects and inter-reflections and virtual shading --- .title[Difficult!] .body[ Requires objects to behave in physically plausible manners when manipulated - Occlusion - Collision detection - Shadows AR systems sensitive to visual errors - virtual object may not be stationary in the real scene or it may be in the wrong place. Time delays lead to augmented image lagging behind motions in the real scene. ] ??? Failures in registration due to: Noise Position and pose of camera with respect to the real scene Image distortions Time delays In calculating the camera position --- .title[Some tools] .body[ - Unity (Basic package) - [Vuforia (AR Plugin)](https://medium.com/quick-code/top-tutorials-to-learn-vuforia-to-develop-ar-applications-274eedc2b18f) ]
layout: true
