Occlusion handling method for ubiquitous augmented reality using reality capture technology and GLSL

Suyang Dong, Chen Feng, Vineet R. Kamat

Research output: Contribution to conferencePaper

Abstract

The primary challenge in generating convincing Augmented Reality (AR) graphics is to project 3D models onto a user's view of the real world and create a temporal and spatial sustained illusion that the virtual and real objects co-exist. Regardless of the spatial relationship between the real and virtual objects, traditional AR graphical engines break the illusion of co-existence by displaying the real world merely as a background, and superimposing virtual objects on the foreground. This research proposes a robust depth sensing and frame buffer algorithm for handling occlusion problems in ubiquitous AR applications. A high-accuracy Time-of-flight (TOF) camera is used to capture the depth map of the real-world in real time. The distance information is processed using the OpenGL Shading Language (GLSL) and rendered into the graphics depth buffer, allowing accurate depth resolution and hidden surface removal in composite AR scenes. The designed algorithm is validated in several indoor and outdoor experiments using the SMART AR framework.

Original languageEnglish (US)
Pages494-503
Number of pages10
DOIs
StatePublished - Sep 29 2011
Event2011 ASCE International Workshop on Computing in Civil Engineering - Miami, FL, United States
Duration: Jun 19 2011Jun 22 2011

Other

Other2011 ASCE International Workshop on Computing in Civil Engineering
CountryUnited States
CityMiami, FL
Period6/19/116/22/11

    Fingerprint

Keywords

  • Imaging techniques
  • Monitoring
  • Three-dimensional models

ASJC Scopus subject areas

  • Civil and Structural Engineering
  • Computer Science Applications

Cite this

Dong, S., Feng, C., & Kamat, V. R. (2011). Occlusion handling method for ubiquitous augmented reality using reality capture technology and GLSL. 494-503. Paper presented at 2011 ASCE International Workshop on Computing in Civil Engineering, Miami, FL, United States. https://doi.org/10.1061/41182(416)61