Systematic Comparison of Projection Methods for Monocular 3D Human Pose Estimation on Fisheye Images
Proceedings - IEEE International Conference on Robotics and Automation/Proceedings, pp. 5914–5921
Abstract
Fisheye cameras offer robots the ability to capture human movements across a wider field of view (FOV) than standard pinhole cameras, making them particularly useful for applications in human-robot interaction and automotive contexts. However, accurately detecting human poses in fisheye images is challenging due to the curved distortions inherent to fisheye optics. While various methods for undistorting fisheye images have been proposed, their effectiveness and limitations for poses that cover a wide FOV has not been systematically evaluated in the context of absolute human pose estimation from monocular fisheye images. To address this gap, we evaluate the impact of pinhole, equidistant and double sphere camera models, as well as cylindrical projection methods, on 3D human pose estimation accuracy. We find that in close-up scenarios, pinhole projection is inadequate, and the optimal projection method varies with the FOV covered by the human pose. The usage of advanced fisheye models like the double sphere model significantly enhances 3D human pose estimation accuracy. We propose a heuristic for selecting the appropriate projection model based on the detection bounding box to enhance prediction quality. Additionally, we introduce and evaluate on our novel FISHnCHIPS dataset, which features 3D human skeleton annotations in fisheye images, including images from unconventional angles, such as extreme close-ups, ground-mounted cameras, and wide-FOV poses, available at: https://www.vision.rwth-aachen.de/fishnchips.
Authors 6
-
Affiliation as printed
RWTH Aachen University,Chair for Computer Vision,Germany
-
Affiliation as printed
RWTH Aachen University,Chair for Computer Vision,Germany
-
Affiliation as printed
RWTH Aachen University,Chair for Computer Vision,Germany
-
Affiliation as printed
Robert Bosch GmbH, Corporate Research & Bosch Center for AI, Rennin-gen and Hildesheim,Germany
-
Affiliation as printed
Robert Bosch GmbH, Corporate Research & Bosch Center for AI, Rennin-gen and Hildesheim,Germany
-
Affiliation as printed
RWTH Aachen University,Chair for Computer Vision,Germany
Cited by 1 stored of 1
1 result
No patents citing this paper on Lens.org (checked 2026-10-06).