Subproject A01
Subproject A01
Multimodal 3D Body Imaging Camera
The subproject A01 focuses on the innovation of a multimodal sensor concept for precise and contactless detection of the body surface and the velocity vectors of all points on this surface. In the first phase of the project, the focus is on the tracking of hand movements, which in the second step is to be transferred to whole-body applications. The primary research question deals with the integration of an RGB-D camera with an imaging radar, overcoming challenges such as spatial calibration, temporal synchronization, analysis of reflectance behavior based on sensor characteristics, and the development of a coherent strategy for data fusion of both sensors. On the radar front, the project includes the development of new signal shapes and signal processing algorithms. These innovations should facilitate fast data acquisition allowing for velocity measurements and simultaneous high-resolution radar imaging. On the other side, the reconstruction of hand shapes and the estimation of hand posture using RGB-D data are researched. In addition, it is researched how velocity information from the imaging radar can improve RGB-D-based hand tracking.
Contacts
Prof. Dr.-Ing. Marc Stamminger
Principal Investigator
Prof. Dr.-Ing. Martin Vossiek
Principal Investigator
Tobias Schwab, M. Sc.
Doctoral Candidate
Vanessa Wirth, M. Sc.
Doctoral Candidate
Johanna Bräunig, M. Sc.
Associated Doctoral Candidate
Lukas Engel, M. Sc.
Associated Doctoral Candidate
Additional Information
- Vossiek M, Haberberger N, Krabbe L, Hehn M, Carlowitz C, Stelzig M: A Tutorial on the Sequential Sampling Impulse Radar Concept and Selected Applications IEEE Journal of Microwave (2023)
- Körner G, Hoffmann M, Stief P, Zhang M, Rückert R, Herglotz C, Kaup A, Vossiek M: Applicability and Performance of Standard Compression Methods for Efficient Data Transmission and Storage in Radar Networks IEEE Journal of Microwave (2021)
- Phutane U, Liphardt AM, Bräunig J, Penner J, Klebl M, Vossiek M, Kleyer A, Schett G, Leyendecker S, Tascilar K: Evaluation of Optical and Radar Based Motion Capturing Technologies for Characterizing Hand Movement in Rheumatoid Arthritis — A Pilot Study Sensors 2021
- Ullmann I, Guendel R, Kruse NC, Fioranelli F, Yarovoy A: A Survey on Radar-based Continuous Human Activity Recognition IEEE Journal of Microwave (2023)
- Bräunig J, Wirth V, Kammel C, Schüßler C, Ullmann I, Stamminger M, Vossiek M: An Ultra-Efficient Approach for High-Resolution MIMO Radar Imaging of Human Hand Poses IEEE Transactions on Radar Systems (2023)
- Brückner S, Weber J, Michler F, Shanin N, Schober R, Hagelauer A, Weigel R, Gaßner H, Winkler J, Eskofier B, Vossiek M: A Wireless Joint Communication and Localization EMG-Sensing Concept for Movement Disorder Assessment IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology (2023)