Making Physical Objects Look Virtual: Closed-loop Spatial Augmented Reality


8fdc786a e214 48c3 903c 7b91e67f6026.jpg 500 500

Starting Date: earliest start: (2019-01-13) latest end: (2019-09-30)

Organization: Advanced Interactive Technologies

Involved Host(s): Lindlbauer David

Abstract: In this project, you will investigate a closed-loop system to control the appearance of an object that is augmented with projection mapping. The object is visually altered using a projector while simultaneously observed with a camera.

Description: Projector-based augmented reality (or Spatial Augmented Reality) is frequently used to alter the appearance of physical objects. Examples include altering the texture of objects, their size or color. While allowing for powerful alterations of the visual appearance of objects, most systems required a suitable surface, and use manual color-correction and one-shot calibration. In this project, you will investigate a closed-loop system to control the appearance of an object that is augmented with projection mapping. The object is visually altered using a projector while simultaneously observed with a camera. Given a target appearance, the projection should be modified to resemble the target as closely as possible. Two scenarios should be implemented: 1) Changing a physical objects in a way that it remains unnoticed by users. By extracting information about the current appearance of an object, they can be altered in a subtle way (e.g., only slightly changing its color or enhancing edges) so that users barely notice the change. 2) Making a physical object look virtual. Virtual object have special visual qualities (e.g., very sharp edges, pixelated, very saturated colors). This scenario serves as a showcase for the effectiveness of any proposed algorithm. The goal of the project is to implement efficient matching algorithms using a projector-camera unity that visually alter physical objects in controlled manner.

Goal: Implement a closed-loop spatial augmented reality application and multiple scenarios. Work packages # Literature review on appearance matching, spatial augmented reality and projection mapping # Implementation of a spatial augmented reality test environment in Unity or OpenFrameworks ## Track objects with camera ## Match color of physical and virtual object ## Multiple application scenarios. #Performing an evaluation to see if and when users notice the alteration.

Contact Details: David Lindlbauer (david.lindlbauer@inf.ethz.ch, https://ait.ethz.ch/people/lindlbauer/)

Spatial augmented reality projection mapping appearance mimicking


Labels: IDEA League Student Grant (IDL) Semester Project Bachelor Thesis Master Thesis CLS Student Project (MPG ETH CLS) ETH Organization's Labels (ETHZ)
Topics: Information, Computing and Communication Sciences
Applicant Organizations: ETH Zurich