单手三维手部姿态估计与重建在计算机视觉与人机交互领域具有重要意义。精准且高效的姿态估计能够为虚拟现实、增强现实、智能驾驶、机器人交互等应用提供自然、直观的交互方式。例如，在虚拟现实场景中，通过实时准确地捕捉手部姿态，用户可以自然地与虚拟环境进行交互，如抓取、操作虚拟物体，提升沉浸感。在机器人领域，准确的手部姿态估计可助力机器人更好地理解人类手势指令，实现高效的人机协作。此外，三维手部重建能够为医学、动画制作等领域提供高质量的三维手部模型，辅助医学诊断、动画角色动作生成等。我们研究主要致力于提高基于RGB模态和Depth模态的三维手部姿态估计算法的精度、速度和鲁棒性。
基于RGB图的三维手部姿态估计
Click here for details
Demo
-
Region-Aware Dynamic Filtering Network for 3D Hand Reconstruction
Yuchen Chen, Pengfei Ren*, Jingyu Wang, Haifeng Sun, Qi Qi, Jing Wang, Jianxin Liao
-
SMR: Spatial-Guided Model-Based Regression for 3D Hand Pose and Mesh Reconstruction
Haifeng Sun, Xiaozheng Zheng, Pengfei Ren, Jingyu Wang, Qi Qi, Jianxin Liao
-
SAR: Spatial-Aware Regression for 3D Hand Pose and Mesh Reconstruction from a Monocular RGB Image
Xiaozheng Zheng, Pengfei Ren, Haifeng Sun, Jingyu Wang, Qi Qi, Jianxin Liao
基于深度图的三维手部姿态估计
Click here for details
-
Keypoint Fusion for RGB-D Based 3D Hand Pose Estimation
Xingyu Liu, Pengfei Ren*, Yuanyuan Gao, Jingyu Wang, Haifeng Sun, Qi Qi, Jianxin Liao
-
Two Heads are Better than One: Image-Point Cloud Network for Depth-Based 3D Hand Pose Estimation
Pengfei Ren, Chenyu Chen, Jiachang Hao, Haifeng Sun, Qi Qi, Jingyu Wang, Jianxin Liao
-
SA-Fusion: Multimodal Fusion Approach for Web-based Human-Computer Interaction in the Wild
Xingyu Liu, Pengfei Ren, Yuchen Chen, Cong Liu, Jing Wang, Haifeng Sun, Qi Qi, Jingyu Wang
-
Pose-Guided Hierarchical Graph Reasoning for 3-D Hand Pose Estimation From a Single Depth Image
Pengfei Ren, Haifeng Sun, Jiachang Hao, Qi Qi, Jingyu Wang, Jianxin Liao
-
Spatial-Aware Stacked Regression Network for Real-Time 3D Hand Pose Estimation
Pengfei Ren, Haifeng Sun, Weiting Huang, Jiachang Hao, Daixuan Cheng, Qi Qi, Jingyu Wang, Jianxin Liao
-
AWR: Adaptive Weighting Regression for 3D Hand Pose Estimation
Weiting Huang, Pengfei Ren*, Jingyu Wang, Qi Qi, Haifeng Sun
-
SRN: Stacked Regression Network for Real-time 3D Hand Pose Estimation
Pengfei Ren, Haifeng Sun, Qi Qi, Jingyu Wang, Weiting Huang