3D Hand Pose and Shape from Images

D5ec2f34 1baf 4643 be07 462e4c3f54a9.png 500 500

Starting Date: earliest start: (2020-05-27) latest end: (2021-05-27)

Organization: Advanced Interactive Technologies

Involved Host(s): Spurr Adrian

Abstract: We provide several projects on 3D hand pose/shape estimation and reconstruction from images. If you are a research-oriented student and are interested in work in this area, you can contact me and we can work together on formulating your thesis topic. You can also bring your own ideas.

Description: Estimating 3D hand pose and shape has been gaining a lot of traction in the computer vision community. It has a wide range of applications in the area of robotics, AR/VR and enables technologies such as Microsofts HoloLens, Facebooks Occulus Rift and similar to be interactive. Several topics studying different aspects of this problem are provided. Knowledge from from computer vision and deep learning are leveraged to develop novel methods to tackle these problems. In particular, the focus lies in 1. 3D hand pose estimation (from monocular/stereo RGB or videos) 2. Hand detection from images 3. Dense surface reconstructions (such as hand meshes) 4. Leveraging weakly-/semi-supervised methods to tackle data scarcity to improve the state-of-the-art in hand pose estimation. Interested students should have a background in computer vision and deep learning. In addition, familiarity with learning frameworks such as PyTorch is required. The projects are research-oriented and if successful can result in a submission to a scientific venue. Therefore students should only apply if they are motivated to work in a research-minded setting. I prefer to work closely with the student, as I believe this brings the most benefits to both of us and the fastest progress in your thesis. If this fascinating area interests you, I encourage you to contact me via email so we can formulate your thesis topic together. You are also welcome to bring your own ideas to the table.

Goal: - Formulate a thesis topic in hand pose estimation based on an outstanding problem in the field. - Work towards solving the problem. - If results in scientific novelty, submit to an academic venue. - ??? - Profit.

Contact Details: Adrian Spurr (adrian.spurr@inf.ethz.ch)

deep learning computer vision 3D reconstruction hand pose estimation meshes 3D pose estimation 3D keypoints machine learning neural networks

Labels: IDEA League Student Grant (IDL) Semester Project Master Thesis CLS Student Project (MPG ETH CLS) ETH Organization's Labels (ETHZ)
Topics: Information, Computing and Communication Sciences
Applicant Organizations: ETH Zurich