Webcam-based Hand- and Object-Tracking for a Desktop Workspace in Virtual Reality

ACM Symposium on Spatial User Interaction (SUI), pp. 1–2

Abstract

As virtual reality overlays the user’s view, challenges arise when interaction with their physical surroundings is still needed. In a seated workspace environment interaction with the physical surroundings can be essential to enable productive working. Interaction with e.g. physical mouse and keyboard can be difficult when no visual reference is given to where they are placed. This demo shows a combination of computer vision-based marker detection with machine-learning-based hand detection to bring users’ hands and arbitrary objects into VR.

Authors 4

1. Sebastian Pape Aachen ITC/VR-Group

   RWTH Aachen University

   Affiliation as printed

   ITC/VR-Group, RWTH Aachen University, Germany

2. Jonathan Heinrich Beierle Aachen ITC/VR-Group

   RWTH Aachen University

   Affiliation as printed

   ITC/VR-Group, RWTH Aachen University, Germany

3. Torsten Kuhlen Aachen ITC/VR-Group

   RWTH Aachen University

   Affiliation as printed

   ITC/VR-Group, RWTH Aachen University, Germany

4. Tim Weißker Aachen ITC/VR-Group

   RWTH Aachen University

   Affiliation as printed

   ITC/VR-Group, RWTH Aachen University, Germany