A method for real-time generation of augmented reality work instructions via expert movements

Bhaskar Bhattacharya; Eliot Winer

doi:10.1117/12.2081214

17 March 2015 A method for real-time generation of augmented reality work instructions via expert movements

Bhaskar Bhattacharya, Eliot Winer

Proceedings Volume 9392, The Engineering Reality of Virtual Reality 2015; 93920G (2015) https://doi.org/10.1117/12.2081214
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

Augmented Reality (AR) offers tremendous potential for a wide range of fields including entertainment, medicine, and engineering. AR allows digital models to be integrated with a real scene (typically viewed through a video camera) to provide useful information in a variety of contexts. The difficulty in authoring and modifying scenes is one of the biggest obstacles to widespread adoption of AR. 3D models must be created, textured, oriented and positioned to create the complex overlays viewed by a user. This often requires using multiple software packages in addition to performing model format conversions. In this paper, a new authoring tool is presented which uses a novel method to capture product assembly steps performed by a user with a depth+RGB camera. Through a combination of computer vision and imaging process techniques, each individual step is decomposed into objects and actions. The objects are matched to those in a predetermined geometry library and the actions turned into animated assembly steps. The subsequent instruction set is then generated with minimal user input. A proof of concept is presented to establish the method’s viability.

Citation Download Citation

Bhaskar Bhattacharya and Eliot Winer "A method for real-time generation of augmented reality work instructions via expert movements", Proc. SPIE 9392, The Engineering Reality of Virtual Reality 2015, 93920G (17 March 2015); https://doi.org/10.1117/12.2081214

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available