Projector-based augmented reality (or Spatial Augmented Reality) is frequently used to alter the appearance of physical objects. Examples include altering the texture of objects, their size or color. While allowing for powerful alterations of the visual appearance of objects, most systems required a suitable surface, and use manual color-correction and one-shot calibration.
In this project, you will investigate a closed-loop system to control the appearance of an object that is augmented with projection mapping. The object is visually altered using a projector while simultaneously observed with a camera. Given a target appearance, the projection should be modified to resemble the target as closely as possible.
Two scenarios should be implemented:
1) Changing a physical objects in a way that it remains unnoticed by users. By extracting information about the current appearance of an object, they can be altered in a subtle way (e.g., only slightly changing its color or enhancing edges) so that users barely notice the change.
2) Making a physical object look virtual. Virtual object have special visual qualities (e.g., very sharp edges, pixelated, very saturated colors). This scenario serves as a showcase for the effectiveness of any proposed algorithm.
The goal of the project is to implement efficient matching algorithms using a projector-camera unity that visually alter physical objects in controlled manner.
Implement a closed-loop spatial augmented reality application and multiple scenarios.
# Literature review on appearance matching, spatial augmented reality and projection mapping
# Implementation of a spatial augmented reality test environment in Unity or OpenFrameworks
## Track objects with camera
## Match color of physical and virtual object
## Multiple application scenarios.
#Performing an evaluation to see if and when users notice the alteration.
David Lindlbauer (firstname.lastname@example.org, https://ait.ethz.ch/people/lindlbauer/)
Spatial augmented reality
IDEA League Student Grant (IDL)
CLS Student Project (MPG ETH CLS)
ETH Organization's Labels (ETHZ)
Information, Computing and Communication Sciences