Awesome Hand Pose Estimation

A curated list of related resources for hand pose estimation. Feel free to contribute!

Contents

• Evaluation
• arXiv Papers
• Journal Papers
  • TPAMI / IJCV
  • Others
• Conference Papers
  • 2023: CVPR, ICCV, Others
  • 2022: CVPR, ECCV, Others
  • 2021: CVPR, ICCV, Others
  • 2020: CVPR, ECCV, Others
  • 2019: CVPR, ICCV, Others
  • 2018: CVPR, ECCV, Others
  • 2017: CVPR, ICCV, Others
  • 2016: CVPR, ECCV, Others
  • 2015: CVPR, ICCV, Others
  • 2014: CVPR, Others & Before
• Theses
• Datasets
  • Depth
  • RGB+Depth
  • RGB
• Workshops
• Challenges
• Other Related Papers

* indicates equal contribution

Evaluation

See folder evaluation to get more details about performance evaluation for hand pose estimation.

arXiv Papers

• [arXiv:2206.04927] Pushing the Envelope for Depth-Based Semi-Supervised 3D Hand Pose Estimation with Consistency Training. [PDF]

Mohammad Rezaei, Farnaz Farahanipad, Alex Dillhoff, Vassilis Athitsos

• [arXiv:2206.04927] Ego2HandsPose: A Dataset for Egocentric Two-hand 3D Global Pose Estimation. [PDF]

Fanqing Lin, Tony Martinez

• [arXiv:2206.07117] TriHorn-Net: A Model for Accurate Depth-Based 3D Hand Pose Estimation. [PDF] [Code]

Mohammad Rezaei, Razieh Rastgoo, Vassilis Athitsos

• [arXiv:2202.04533] NIMBLE: A Non-rigid Hand Model with Bones and Muscles. [PDF]

Yuwei Li, Longwen Zhang, Zesong Qiu, Yingwenqi Jiang, Yuyao Zhang, Nianyi Li, Yuexin Ma, Lan Xu, Jingyi Yu

• [arXiv:2201.09548] Consistent 3D Hand Reconstruction in Video via self-supervised Learning. [PDF]

Zhigang Tu, Zhisheng Huang, Yujin Chen, Di Kang, Linchao Bao, Bisheng Yang, Junsong Yuan

• [arXiv:2111.06500] Dynamic Iterative Refinement for Efficient 3D Hand Pose Estimation. [PDF]

John Yang, Yash Bhalgat, Simyung Chang, Fatih Porikli, Nojun Kwak

• [arXiv:2109.14744] The Object at Hand: Automated Editing for Mixed Reality Video Guidance from Hand-Object Interactions. [PDF]

Yao Lu, Walterio W. Mayol-Cuevas

• [arXiv:2109.14657] Understanding Egocentric Hand-Object Interactions from Hand Pose Estimation. [PDF]

Yao Lu, Walterio W. Mayol-Cuevas

• [arXiv:2109.11747] A Multi-View Video-Based 3D Hand Pose Estimation. [PDF]

Leyla Khaleghi, Alireza Sepas Moghaddam, Joshua Marshall, Ali Etemad

• [arXiv:2108.13995] Realistic Hands: A Hybrid Model for 3D Hand Reconstruction. [PDF] [Project]

Michael Seeber, Martin R. Oswald, Roi Poranne

• [arXiv:2108.07044] Towards unconstrained joint hand-object reconstruction from RGB videos. [PDF] [Project] [Code]

Yana Hasson, Gül Varol, Ivan Laptev, Cordelia Schmid

• [arXiv:2107.00887] HO-3D_v3: Improving the Accuracy of Hand-Object Annotations of the HO-3D Dataset. [PDF]

Shreyas Hampali, Sayan Deb Sarkar, Vincent Lepetit

• [arXiv:2106.05954] Adversarial Motion Modelling helps Semi-supervised Hand Pose Estimation. [PDF]

Adrian Spurr, Pavlo Molchanov, Umar Iqbal, Jan Kautz, Otmar Hilliges

• [arXiv:2106.04324] Contrastive Representation Learning for Hand Shape Estimation. [PDF] [Project] [Code] [Data]

Christian Zimmermann, Max Argus, Thomas Brox

• [arXiv:2104.14639] HandsFormer: Keypoint Transformer for Monocular 3D Pose Estimation ofHands and Object in Interaction. [PDF]

Shreyas Hampali, Sayan Deb Sarkar, Mahdi Rad, Vincent Lepetit

• [arXiv:2102.07067] FastHand: Fast Hand Pose Estimation From A Monocular Camera. [PDF]

Shan An, Xiajie Zhang, Dong Wei, Haogang Zhu, Jianyu Yang, Konstantinos A. Tsintotas

• [arXiv:2012.11260] Unsupervised Domain Adaptation with Temporal-Consistent Self-Training for 3D Hand-Object Joint Reconstruction. [PDF]

Mengshi Qi, Edoardo Remelli, Mathieu Salzmann, Pascal Fua

• [arXiv:2008.08324] FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and Integration. [PDF] [Project]

Yu Rong, Takaaki Shiratori, Hanbyul Joo

• [arXiv:2006.05927] Recent Advances in 3D Object and Hand Pose Estimation. [PDF]

Vincent Lepetit

• [arXiv:2001.08047] Attention! A Lightweight 2D Hand Pose Estimation Approach. [PDF]

Nicholas Santavas, Ioannis Kansizoglou, Loukas Bampis, Evangelos Karakasis, Antonios Gasteratos

• [arXiv:2001.00702] HandAugment: A Simple Data Augmentation Method for Depth-Based 3D Hand Pose Estimation. [PDF] [Code]

Zhaohui Zhang, Shipeng Xie, Mingxiu Chen, Haichao Zhu

• [arXiv:1912.12436] Silhouette-Net: 3D Hand Pose Estimation from Silhouettes. [PDF]

Kuo-Wei Lee, Shih-Hung Liu, Hwann-Tzong Chen, Koichi Ito

• [arXiv:1911.12501] An End-to-end Framework for Unconstrained Monocular 3D Hand Pose Estimation. [PDF]

Sanjeev Sharma, Shaoli Huang, Dacheng Tao

• [arXiv:1912.01875] GraphPoseGAN: 3D Hand Pose Estimation from a Monocular RGB Image via Adversarial Learning on Graphs. [PDF]

Yiming He, Wei Hu, Siyuan Yang, Xiaochao Qu, Pengfei Wan, Zongming Guo

• [arXiv:1911.07424] Capturing Hand Articulations using Recurrent Neural Network for 3D Hand Pose Estimation. [PDF]

Cheol-hwan Yoo, Seung-wook Kim, Seo-won Ji, Yong-goo Shin, Sung-jea Ko

• [arXiv:1807.00898] Model-based Hand Pose Estimation for Generalized Hand Shape with Appearance Normalization. [PDF]

Jan Wöhlke, Shile Li, Dongheui Lee

• [arXiv:1705.09606] End-to-end Global to Local CNN Learning for Hand Pose Recovery in Depth data. [PDF]

Meysam Madadi, Sergio Escalera, Xavier Baro, Jordi Gonzalez

• [arXiv:1704.02224] Hand3D: Hand Pose Estimation using 3D Neural Network. [PDF] [Project]

Xiaoming Deng*, Shuo Yang*, Yinda Zhang*, Ping Tan, Liang Chang, Hongan Wang

• [arXiv:1612.00596] Learning to Search on Manifolds for 3D Pose Estimation of Articulated Objects. [PDF]

Yu Zhang, Chi Xu, Li Cheng

[back to top]

Journal Papers

TPAMI / IJCV

• [2023 TPAMI] Consistent 3D Hand Reconstruction in Video via self-supervised Learning. [PDF]

Zhigang Tu, Zhisheng Huang, Yujin Chen, Di Kang, Linchao Bao, Bisheng Yang, Junsong Yuan

• [2022 TPAMI] Recurrent 3D Hand Pose Estimation Using Cascaded Pose-guided 3D Alignments. [PDF]

Xiaoming Deng, Dexin Zuo, Yinda Zhang, Zhaopeng Cui, Jian Cheng, Ping Tan, Liang Chang, Marc Pollefeys, Sean Fanello, Hongan Wang

• [2021 TPAMI] HandVoxNet++: 3D Hand Shape and Pose Estimation using Voxel-Based Neural Networks. [PDF]

Jameel Malik, Soshi Shimada, Ahmed Elhayek, Sk Aziz Ali, Christian Theobalt, Vladislav Golyanik, Didier Stricker

• [2020 TPAMI] 3D Hand Pose Estimation Using Synthetic Data and Weakly Labeled RGB Images. [PDF]

Yujun Cai, Liuhao Ge, Jianfei Cai, Nadia Magnenat-Thalmann, Junsong Yuan

• [2019 TPAMI] Generalized Feedback Loop for Joint Hand-Object Pose Estimation. [PDF] [Project]

Markus Oberweger, Paul Wohlhart, Vincent Lepetit

• [2019 TPAMI] Feature Boosting Network For 3D Pose Estimation. [PDF]

Jun Liu, Henghui Ding, Amir Shahroudy, Ling-Yu Duan, Xudong Jiang, Gang Wang, Alex C. Kot

• [2018 TPAMI] Opening the Black Box: Hierarchical Sampling Optimization for Hand Pose Estimation. [PDF]

Danhang Tang*, Qi Ye*, Shanxin Yuan, Jonathan Taylor, Pushmeet Kohli, Cem Keskin, Tae-Kyun Kim, Jamie Shotton

• [2018 IJCV] Depth-Based Hand Pose Estimation: Methods, Data, and Challenges. [PDF] [Project] [Code]

James Steven Supančič III, Grégory Rogez, Yi Yang, Jamie Shotton, Deva Ramanan

• [2018 TPAMI] Real-time 3D Hand Pose Estimation with 3D Convolutional Neural Networks. [PDF]

Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann

• [2016 IJCV] Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups. [PDF] [Project]

Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, Li Cheng

• [2016 TPAMI] Latent Regression Forest: Structured Estimation of 3D Hand Poses. [PDF]

Danhang Tang, Hyung Chang, Alykhan Tejani, Tae-Kyun Kim

• [2016 IJCV] Capturing Hands in Action using Discriminative Salient Points and Physics Simulation. [PDF] [Project]

Dimitrios Tzionas, Luca Ballan, Abhilash Srikantha, Pablo Aponte, Marc Pollefeys, Juergen Gall

• [2015 IJCV] Estimate Hand Poses Efficiently from Single Depth Images. [PDF] [Project] [Code]

Chi Xu, Ashwin Nanjappa, Xiaowei Zhang, Li Cheng

[back to top]

Other Journals

• [2023 ESWA] TriHorn-Net: A Model for Accurate Depth-Based 3D Hand Pose Estimation. [PDF] [Code]

Mohammad Rezaei, Razieh Rastgoo, Vassilis Athitsos

• [2022 TIP] A Dual-Branch Self-Boosting Framework for Self-Supervised 3D Hand Pose Estimation. [PDF] [Code]

Pengfei Ren, Haifeng Sun, Jiachang Hao, Qi Qi, Jingyu Wang, Jianxin Liao

• [2022 Technologies] A Survey on GAN-Based Data Augmentation for Hand Pose Estimation Problem. [PDF]

Farnaz Farahanipad, Mohammad Rezaei, Mohammad Sadegh Nasr, Farhad Kamangar, Vassilis Athitsos

• [2022 TCSVT] 3D Hand Pose Estimation from Monocular RGB with Feature Interaction Module. [PDF]

Shaoxiang Guo, Eric Rigall, Yakun Ju, Junyu Dong

• [2021 TIP] Hand Pose Understanding with Large-Scale Photo-Realistic Rendering Dataset. [PDF]

Xiaoming Deng, Yinda Zhang, Jian Shi, Yuying Zhu, Dachuan Cheng, Dexin Zuo, Zhaopeng Cui, Ping Tan, Liang Chang, Hongan Wang

• [2021 TIP] Joint Hand-object 3D Reconstruction from a Single Image with Cross-branch Feature Fusion. [PDF]

Yujin Chen, Zhigang Tu, Di Kang, Ruizhi Chen, Linchao Bao, Zhengyou Zhang, Junsong Yuan

• [2021 Neurocomputing] Spatial-aware Stacked Regression Network for Real-time 3D Hand Pose Estimation. [PDF]

Pengfei Ren, Haifeng Sun, Weiting Huang, Jiachang hao, Daixuan Cheng, Qi Qi, Jingyu Wang, Jianxin Liao

• [2021 TMM] Differentiable Spatial Regression: A Novel Method for 3D Hand Pose Estimation. [PDF] [Code]

Xingyuan Zhang, Fuhai Zhang

• [2020 TIP] Weakly-supervised Learning for Single Depth based Hand Shape Recovery. [PDF]

Xiaoming Deng, Yuying Zhu, Yinda Zhang, Zhaopeng Cui, Ping Tan, Wentian Qu, Cuixia Ma, Hongan Wang

• [2020 Signal Process Image Commun] Accurate 3D Hand Pose Estimation Network Utilizing Joints Information. [PDF]

Xiongquan Zhang; Shiliang Huang; Zhongfu Ye

• [2020 TCSVT] Improve Regression Network on Depth Hand Pose Estimation with Auxiliary Variable. [PDF]

Lu Xu, Chen Hu, Ji’an Tao, Jianru Xue, Kuizhi Mei

• [2020 TVCG] 3D Hand Tracking in the Presence of Excessive Motion Blur. [PDF]

Gabyong Park, Antonis Argyros, Juyoung Lee, Woontack Woo

• [2019 Computers & Graphics] Simple and effective deep hand shape and pose regression from a single depth image. [PDF]

Jameel Malik, Ahmed Elhayek, Fabrizio Nunnari, Didier Stricker

• [2019 TIP] SRHandNet: Real-time 2D Hand Pose Estimation with Simultaneous Region Localization. [PDF] [Project]

Yangang Wang, Baowen Zhang, Cong Peng

• [2019 Sensors] WHSP-Net: A Weakly-Supervised Approach for 3D Hand Shape and Pose Recovery from a Single Depth Image. [PDF]

Jameel Malik*, Ahmed Elhayek*, Didier Stricker

• [2019 RA-L] Variational Object-aware 3D Hand Pose from a Single RGB Image. [PDF] [Code]

Yafei Gao*, Yida Wang*, Pietro Falco, Nassir Navab, Federico Tombari

• [2018 PR] A Survey on 3D Hand Pose Estimation: Cameras, Methods, and Datasets. [PDF]

Rui Li, Zhenyu Liu, Jianrong Tan

• [2018 Neurocomputing] A CRNN module for hand pose estimation. [PDF]

Zhongxu Hu, Youmin Hu, Jie Liu, Bo Wu, Dongmin Han, Thomas Kurfess

• [2018 IVC] Large-scale Multiview 3D Hand Pose Dataset. [PDF] [Project]

Francisco Gomez-Donoso, Sergio Orts-Escolano and Miguel Cazorla

• [2018 TCSVT] Mask-pose Cascaded CNN for 2D Hand Pose Estimation from Single Color Image. [PDF] [Project] [Code]

Yangang Wang, Cong Peng and Yebin Liu

• [2018 IVC] Top-down model fitting for hand pose recovery in sequences of depth images. [PDF]

Meysam Madadi, Sergio Escalera, Alex Carruesco, Carlos Andujar, Xavier Baró, Jordi Gonzàlez

• [2018 TCYB] Context-Aware Deep Spatio-Temporal Network for Hand Pose Estimation from Depth Images. [PDF]

Yiming Wu, Wei Ji, Xi Li, Gang Wang, Jianwei Yin, Fei Wu

• [2018 IEEE Access] SHPR-Net: Deep Semantic Hand Pose Regression From Point Clouds. [PDF] [Project]

Xinghao Chen, Guijin Wang, Cairong Zhang, Tae-Kyun Kim, Xiangyang Ji

• [2018 Neurocomputing] Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation. [PDF] [Project] [Code]

Xinghao Chen, Guijin Wang, Hengkai Guo, Cairong Zhang

• [2018 PR] Learning a deep network with spherical part model for 3D hand pose estimation. [PDF]

Tzu-Yang Chen, Pai-Wen Ting, Min-Yu Wu, Li-Chen Fu

• [2018 TIP] Robust 3D Hand Pose Estimation from Single Depth Images using Multi-View CNNs. [PDF]

Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann

• [2018 JVCI] Region Ensemble Network: Towards Good Practices for Deep 3D Hand Pose Estimation. [PDF] [Code]

Guijin Wang, Xinghao Chen*, Hengkai Guo*, Cairong Zhang

• [2017 TCYB] Hough Forest with Optimized Leaves for Global Hand Pose Estimation with Arbitrary Postures. [PDF]

Hui Liang, Junsong Yuan, J. Lee, Liuhao Ge and Daniel Thalmann

• [2017 TCSVT] Robust RGB-D Hand Tracking Using Deep Learning Priors. [PDF]

Jordi Sanchez-Riera, Kathiravan Srinivasan, Kai-Lung Hua, Wen-Huang Cheng, M. Anwar Hossain, and Mohammed F. Alhamid

• [2017 CVIU] Hand Pose Estimation through Semi-Supervised and Weakly-Supervised Learning. [PDF]

Natalia Neverova, Christian Wolf, Florian Nebout, Graham Taylor

• [2017 Neurocomputing] Multi-task, Multi-domain Learning: application to semantic segmentation and pose regression. [PDF]

Damien Foururea, Rémi Emonet, Elisa Fromont, Damien Muselet, Natalia Neverova, Alain Trémeaua, Christian Wolf

• [2016 CVIU] Guided Optimisation through Classification and Regression for Hand Pose Estimation. [PDF] [Project]

Philip Krejov, Andrew Gilbert, Richard Bowden

• [2015 TCSVT] Resolving Ambiguous Hand Pose Predictions by Exploiting Part Correlations. [PDF]

Hui Liang, Junsong Yuan, Daniel Thalmann

• [2014 TMM] Parsing the Hand in Depth Images. [PDF] [Project] [Code]

Hui Liang, Junsong Yuan, Daniel Thalmann

[back to top]

Conference Papers

2023 CVPR

• A Probabilistic Attention Model with Occlusion-aware Texture Regression for 3D Hand Reconstruction from a Single RGB Image

Zheheng Jiang, Hossein Rahmani, Sue Black, Bryan M. Williams

• A2J-Transformer: Anchor-to-Joint Transformer Network for 3D Interacting Hand Pose Estimation from a Single RGB Image. [PDF] [Code]

Changlong Jiang, Yang Xiao, Cunlin Wu, Mingyang Zhang, Jinghong Zheng, Zhiguo Cao, Joey Tianyi Zhou

• MeMaHand: Exploiting Mesh-Mano Interaction for Single Image Two-Hand Reconstruction. [PDF]

Congyi Wang, Feida Zhu, Shilei Wen

• ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation. [Project]

Zicong Fan, Omid Taheri, Dimitrios Tzionas, Muhammed Kocabas, Manuel Kaufmann, Michael J. Black, Otmar Hilliges

• AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimation. [Project]

Takehiko Ohkawa, Kun He, Fadime Sener, Tomas Hodan, Luan Tran, and Cem Keskin

• High Fidelity 3D Hand Shape Reconstruction via Scalable Graph Frequency Decomposition.

Tianyu Luan, Yuanhao Zhai, Jingjing Meng, Zhong Li, Zhang Chen, Yi Xu, and Junsong Yuan.

• HandNeRF: Neural Radiance Fields for Animatable Interacting Hands. [PDF]

Zhiyang Guo, Wengang Zhou, Min Wang, Li Li, Houqiang Li

• POEM: Reconstructing Hand in a Point Embedded Multi-view Stereo. [PDF] [Code]

Lixin Yang, Jian Xu, Licheng Zhong, Xinyu Zhan, Zhicheng Wang, Kejian Wu, Cewu Lu

• HARP: Personalized Hand Reconstruction from a Monocular RGB Video. [PDF] [Project]

Korrawe Karunratanakul, Sergey Prokudin, Otmar Hilliges, Siyu Tang

• RelightableHands: Efficient Neural Relighting of Articulated Hand Models. [PDF] [Project]

Shun Iwase, Shunsuke Saito, Tomas Simon, Stephen Lombardi, Timur Bagautdinov, Rohan Joshi, Fabian Prada, Takaaki Shiratori, Yaser Sheikh, Jason Saragih

• H2ONet: Hand-Occlusion-and-Orientation-aware Network for Real-time 3D Hand Mesh Reconstruction.

Hao Xu, Tianyu Wang, Xiao Tang, Chi-Wing Fu

• Affordance Diffusion: Synthesizing Hand-Object Interactions. [PDF] [Project]

Yufei Ye, Xueting Li, Abhinav Gupta, Shalini De Mello, Stan Birchfield, Jiaming Song, Shubham Tulsiani, Sifei Liu

• gSDF: Geometry-Driven Signed Distance Functions for 3D Hand-Object Reconstruction. [PDF] [Project]

Zerui Chen, Shizhe Chen, Cordelia Schmid, Ivan Laptev

• Harmonious Feature Learning for Interactive Hand-Object Pose Estimation.

Zhifeng Lin, Changxing Ding, Huan Yao, Zengsheng Kuang, Shaoli Huang

• Handy: Towards a high fidelity 3D hand shape and appearance model.

Rolandos Potamias Potamias, Stylianos Ploumpis, Stylianos Moschoglou, Vasileios Triantafyllou, Stefanos Zafeiriou

• Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Video. [PDF] [Project]

Xingyu Chen, Baoyuan Wang Heung-Yeung, Shum

• Cross-domain 3D Hand Pose Estimation with Dual Modalities. [PDF]

Qiuxia Lin, Linlin Yang, Angela Yao

• Overcoming the Tradeoff in Accuracy and Plausibility for 3D Hand Shape Reconstruction. [PDF]

Ziwei Yu, Chen Li, Linlin Yang, Xiaoxu Zheng, Michael Bi Mi, Gim Hee Lee, Angela Yao

• Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB Videos. [PDF] [Project] [Code]

Yilin Wen, Hao Pan, Lei Yang, Jia Pan, Taku Komura, Wenping Wang

• Im2Hands: Learning Attentive Implicit Representation of Interacting Two-Hand Shapes. [PDF] [Project] [Code]

Jihyun Lee, Minhyuk Sung, Honggyu Choi, Tae-Kyun Kim

• Neural Voting Field for Camera-Space 3D Hand Pose Estimation. [PDF]

Lin Huang, Chung-Ching Lin, Kevin Lin, Lin Liang, Lijuan Wang, Junsong Yuan, Zicheng Liu

• Bringing Inputs to Shared Domains for 3D Interacting Hands Recovery in the Wild. [PDF]

Gyeongsik Moon

• Recovering 3D Hand Mesh Sequence from a Single Blurry Image: A New Dataset and Temporal Unfolding. [PDF]

JoonKyu Park*, Yeonguk Oh*, Jaeha Kim*, Gyeongsik Moon, Kyoung Mu Lee

• Semi-supervised Hand Appearance Recovery via Structure Disentanglement and Dual Adversarial Discrimination. [PDF]

Zimeng Zhao, Binghui Zuo, Zhiyu Long and Yangang Wang

• Transformer-based Unified Recognition of Two Hands Manipulating Objects. [PDF]

Hoseong Cho, Chanwoo Kim, Jihyeon Kim, Seongyeong Lee, Elkhan Ismayilzada, Seungryul Baek

• ACR: Attention Collaboration-based Regressor for Arbitrary Two-Hand Reconstruction. [PDF] [Project] [Code]

Zhengdi Yu, Shaoli Huang, Chen Fang, Toby P. Breckon, Jue Wang

2023 Others

• [2023 AAAI] Two Heads are Better than One: Image-Point Cloud Network for Depth-Based 3D Hand Pose Estimation. [[PDF]] (AAAI-23 Distinguished Papers)

Pengfei Ren, Yuchen Chen, Jiachang Hao, Haifeng Sun, Qi Qi, Jingyu Wang, Jianxin Liao

• [2023 AAAI] Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wild. [PDF]

Jiayi Chen, Mi Yan, Jiazhao Zhang, Yinzhen Xu, Xiaolong Li, Yijia Weng, Li Yi, Shuran Song, He Wang

• [2023 WACV] THOR-Net: End-to-End Graformer-Based Realistic Two Hands and Object Reconstruction With Self-Supervision. [PDF] [Code]

Ahmed Tawfik Aboukhadra, Jameel Malik, Ahmed Elhayek, Nadia Robertini, Didier Stricker

2022 ECCV

• Identity-aware Hand Mesh Estimation and Personalization from RGB Images . [[PDF]] [Code]

Deying Kong, Linguang Zhang, Liangjian Chen, Haoyu Ma, Xiangyi Yan, Shanlin Sun, Xingwei Liu, Kun Han, Xiaohui Xie

• AlignSDF: Pose-Aligned Signed Distance Fields for Hand-Object Reconstruction. [PDF] [Project] [Code]

Zerui Chen, Yana Hasson, Cordelia Schmid, Ivan Laptev

• S²Contact: Graph-based Network for 3D Hand-Object Contact Estimation with Semi-Supervised Learning. [PDF] [Project] [Code]

Tze Ho Elden Tse, Zhongqun Zhang, Kwang In Kim, Ales Leonardis, Feng Zheng, Hyung Jin Chang

• Domain Adaptive Hand Keypoint and Pixel Localization in the Wild. [PDF] [Project]

Takehiko Ohkawa, Yu-Jhe Li, Qichen Fu, Ryosuke Furuta, Kris M. Kitani, and Yoichi Sato

• 3D Interacting Hand Pose Estimation by Hand De-occlusion and Removal. [PDF] [Project][Dataset]

Hao Meng, Sheng Jin, Wentao Liu, Chen Qian, Mengxiang Lin, Wanli Ouyang, Ping Luo

• Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformers. [PDF] [Project] [Code]

Junhyeong Cho, Kim Youwang, Tae-Hyun Oh

2022 CVPR

• What's in your hands? 3D Reconstruction of Generic Objects in Hands. [PDF] [Project] [Code]

Yufei Ye, Abhinav Gupta, Shubham Tulsiani

• Mining Multi-View Information: A Strong Self-Supervised Framework for Depth-based 3D Hand Pose and Mesh Estimation. [PDF] [Code]

Pengfei Ren, Haifeng Sun, Jiachang Hao, Jingyu Wang, Qi Qi,Jianxin Liao

• HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Network. [PDF] [Code]

JoonKyu Park, Yeonguk Oh, Gyeongsik Moon, Hongsuk Choi, Kyoung Mu Lee

• Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimation. [PDF]

Shreyas Hampali, Sayan Deb Sarkar, Mahdi Rad, Vincent Lepetit

• Collaborative Learning for Hand and Object Reconstruction with Attention-guided Graph Convolution. [PDF] [Project]

Tze Ho Elden Tse, Kwang In Kim, Ales Leonardis, and Hyung Jin Chang

• Spatial-Temporal Parallel Transformer for Arm-Hand Dynamic Estimation. [PDF]

Shuying Liu, Wenbin Wu, Jiaxian Wu, Yue Lin

• D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions. [PDF] [Project]

Sammy Christen, Muhammed Kocabas, Emre Aksan, Jemin Hwangbo, Jie Song, Otmar Hilliges

• GOAL: Generating 4D Whole-Body Motion for Hand-Object Grasping. [PDF] [Project]

Omid Taheri, Vasileios Choutas, Michael J. Black, Dimitrios Tzionas

• OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interaction. [PDF] [Code]

Lixin Yang, Kailin Li Xinyu Zhan, Fei Wu, Anran Xu, Liu Liu, Cewu Lu

• ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesis. [PDF] [Code]

Kailin Li, Lixin Yang, Xinyu Zhan, Jun Lv, Wenqiang Xu, Jiefeng Li, Cewu Lu

• Interacting Attention Graph for Single Image Two-Hand Reconstruction. [PDF] [Project] [Code]

Mengcheng Li，Liang An, Hongwen Zhang, Lianpeng Wu, Feng Chen, Tao Yu, Yebin Liu

• MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Image. [PDF] [Code]

Xingyu Chen, Yufeng Liu, Yajiao Dong, Xiong Zhang, Chongyang Ma, Yanmin Xiong, Yuan Zhang, Xiaoyan Guo

• LISA: Learning Implicit Shape and Appearance of Hands. [PDF] [Project]

Enric Corona, Tomas Hodan, Minh Vo, Francesc Moreno-Noguer, Chris Sweeney, Richard Newcombe, Lingni Ma

2022 Others

• [2022 AAAI] Efficient Virtual View Selection for 3D Hand Pose Estimation. [PDF] [Project] [Code]

Jian Cheng, Yanguang Wan, Dexin Zuo, Cuixia Ma, Jian Gu, Ping Tan, Hongan Wang, Xiaoming Deng, Yinda Zhang

2021 ICCV

• Toward Human-Like Grasp: Dexterous Grasping via Semantic Representation of Object-Hand. [PDF]

Tianqiang Zhu, Rina Wu, Xiangbo Lin, Yi Sun

• Self-Supervised Transfer Learning for Hand Mesh Recovery From Binocular Images. [PDF]

Zheng Chen, Sihan Wang, Yi Sun, Xiaohong Ma

• Self-Supervised 3D Hand Pose Estimation from monocular RGB via Contrastive Learning. [PDF] [Code] (Oral)

Adrian Spurr, Aneesh Dahiya, Xucong Zhang, Xi Wang, Otmar Hilliges

• Towards Accurate Alignment in Real-time 3D Hand-Mesh Reconstruction. [PDF] [Code]

Xiao Tang, Tianyu Wang, Chi-Wing Fu

• EventHands: Real-Time Neural 3D Hand Reconstruction from an Event Stream. [PDF] [Project]

Viktor Rudnev, Vladislav Golyanik, Jiayi Wang, Hans-Peter Seidel, Franziska Mueller, Mohamed Elgharib, Christian Theobalt

• Reconstructing Hand-Object Interactions in the Wild. [PDF] [Project]

Zhe Cao*, Ilija Radosavovic*, Angjoo Kanazawa, Jitendra Malik

• HandFoldingNet: A 3D Hand Pose Estimation Network Using Multiscale-Feature Guided Folding of a 2D Hand Skeleton. [PDF] [Code]

Wencan Cheng, Jae Hyun Park, Jong Hwan Ko

• H2O: Two Hands Manipulating Objects for First Person Interaction Recognition. [PDF] [Project] [Code]

Taein Kwon, Bugra Tekin, Jan Stuhmer, Federica Bogo, Marc Pollefeys

• I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modeling. [PDF]

Ping Chen, Yujin Chen, Dong Yang, Fangyin Wu, Qin Li, Qingpei Xia, Yong Tan

• SemiHand: Semi-supervised Hand Pose Estimation with Consistency. [PDF]

Linlin Yang, Shicheng Chen, Angela Yao

• End-to-End Detection and Pose Estimation of Two Interacting Hands. [PDF]

Donguk Kim, Kwang In Kim, Seungryul Baek

• Hand-Object Contact Consistency Reasoning for Human Grasps Generation. [PDF] [Project] (Oral)

Hanwen Jiang, Shaowei Liu, Jiashun Wang, Xiaolong Wang

• Hand Image Understanding via Deep Multi-Task Learning. [PDF] [Code]

Xiong Zhang, Hongsheng Huang, Jianchao Tan, Hongmin Xu, Cheng Yang, Guozhu Peng, Lei Wang, Ji Liu

• CPF: Learning a Contact Potential Field to Model the Hand-object Interaction. [PDF] [Code]

Lixin Yang, Xinyu Zhan, Kailin Li, Wenqiang Xu, Jiefeng Li, Cewu Lu

• TravelNet: Self-supervised Physically Plausible Hand Motion Learning from Monocular Color Images. [PDF]

Zimeng Zhao, Xi Zhao and Yangang Wang

• Interacting Two-Hand 3D Pose and Shape Reconstruction from Single Color Image. [PDF] [Project] [Code]

Baowen Zhang, Yangang Wang, Xiaoming Deng, Yinda Zhang, Ping Tan, Cuixia Ma and Hongan Wang

• Removing the Bias of Integral Pose Regression. [PDF]

Kerui Gu, Linlin Yang, Angela Yao

[back to top]

2021 CVPR

• Monocular Real-time Full Body Capture with Inter-part Correlations. [PDF]

Yuxiao Zhou, Marc Habermann, Ikhsanul Habibie, Ayush Tewari, Christian Theobalt, Feng Xu

• End-to-End Human Pose and Mesh Reconstruction with Transformers. [PDF] [Code]

Kevin Lin, Lijuan Wang, Zicheng Liu

• DexYCB: A Benchmark for Capturing Hand Grasping of Objects. [PDF] [Project] [Code]

Yu-Wei Chao, Wei Yang, Yu Xiang, Pavlo Molchanov, Ankur Handa, Jonathan Tremblay, Yashraj S. Narang, Karl Van Wyk, Umar Iqbal, Stan Birchfield, Jan Kautz, Dieter Fox

• Body2Hands: Learning to Infer 3D Hands from Conversational Gesture Body Dynamics. [PDF] [Project]

Evonne Ng, Hanbyul Joo, Shiry Ginosar, Trevor Darrell

• Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registration. [PDF]

Xingyu Chen, Yufeng Liu, Chongyang Ma, Jianlong Chang, Huayan Wang, Tian Chen, Xiaoyan Guo, Pengfei Wan, Wen Zheng

• Model-based 3D Hand Reconstruction via Self-Supervised Learning. [PDF]

Yujin Chen, Zhigang Tu, Di Kang, Linchao Bao, Ying Zhang, Xuefei Zhe, Ruizhi Chen, Junsong Yuan

• Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time. [PDF] [Project] [Code]

Shaowei Liu*, Hanwen Jiang*, Jiarui Xu, Sifei Liu, Xiaolong Wang

[back to top]

2021 Others

• [2021 3DV] A Skeleton-Driven Neural Occupancy Representation for Articulated Hands. [PDF] [Project] [Code] (Oral)

Korrawe Karunratanakul, Adrian Spurr, Zicong Fan, Otmar Hilliges, Siyu Tang

• [2021 3DV] Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentation. [PDF] [Project] [Code] (Oral)

Zicong Fan, Adrian Spurr, Muhammed Kocabas, Siyu Tang, Michael J. Black, Otmar Hilliges

• [2021 DICTA] Semi-Supervised 3D Hand Shape and Pose Estimation with Label Propagation. [PDF]

Samira Kaviani, Amir Rahimi, Richard Hartley

• [2021 BMVC] Joint-Aware Regression: Rethinking Regression-Based Method for 3D Hand Pose Estimation. [PDF]

Xiaozheng Zheng, Pengfei Ren, Haifeng Sun, Jingyu Wang, Qi Qi and Jianxin Liao

• [2021 BMVC] Local and Global Point Cloud Reconstruction for 3D Hand Pose Estimation. [PDF] [Data]

Ziwei Yu, Linlin Yang, Shicheng Chen and Angela Yao

• [2021 BMVC] HandTailor: Towards High-Precision Monocular 3D Hand Recovery. [PDF] [Code]

Jun Lv, Wenqiang Xu, Lixin Yang, Sucheng Qian, Chongzhao Mao, Cewu Lu

• [2021 BMVC] Multi-view Image-based Hand Geometry Refinement using Differentiable Monte Carlo Ray Tracing. [PDF]

Giorgos Karvounas, Nikolaos Kyriazis, Iason Oikonomidis, Aggeliki Tsoli, Antonis A. Argyros

• [2021 SIGGRAPH] ManipNet: Neural Manipulation Synthesis with a Hand-Object Spatial Representation. [PDF] [Code]

He Zhang, Yuting Ye, Takaaki Shiratori, Taku Komura

• [2021 SIGGRAPH] Single Depth View-Based Real-time Reconstruction of Hand-object Interactions. [PDF]

Hao Zhang, Yuxiao Zhou, Yifei Tian, Jun-Hai Yong, Feng Xu

• [2021 IROS] Dynamic Modeling of Hand-Object Interactions via Tactile Sensing. [PDF] [Project]

Qiang Zhang, Yunzhu Li, Yiyue Luo, Wan Shou, Michael Foshey, Junchi Yan, Joshua B. Tenenbaum, Wojciech Matusik, Antonio Torralba

• [2021 AAAI] Exploiting Learnable Joint Groups for Hand Pose Estimation. [PDF] [Code]

Moran Li, Yuan Gao, Nong Sang

• [2021 WACV] Active Learning for Bayesian 3D Hand Pose Estimation. [PDF] [Code]

Razvan Caramalau, Binod Bhattarai, Tae-Kyun Kim

• [2021 WACV] Two-hand Global 3D Pose Estimation Using Monocular RGB. [PDF] [Code]

Fanqing Lin, Connor Wilhelm, Tony Martinez

• [2021 WACV] MVHM: A Large-Scale Multi-View Hand Mesh Benchmark for Accurate 3D Hand Pose Estimation. [PDF]

Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Xiaohui Xie

• [2021 WACV] Temporal-Aware Self-Supervised Learning for 3D Hand Pose and Mesh Estimation in Videos. [PDF]

Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Xiaohui Xie

• [2021 PETRA] Weakly-supervised hand part segmentation from depth images. [PDF]

Mohammad Rezaei, Farnaz Farahanipad, Alex Dillhoff, Ramez Elmasri, Vassilis Athitsos

• [2021 PETRA] A Pipeline for Hand 2-D Keypoint Localization Using Unpaired Image to Image Translation. [PDF]

Farnaz Farahanipad, Mohammad Rezaei, Alex Dillhoff, Farhad Kamangar, Vassilis Athitsos

[back to top]

2020 ECCV

• GRAB: A Dataset of Whole-Body Human Grasping of Objects. [PDF] [Project] [Code]

Omid Taheri, Nima Ghorbani, Michael J. Black, Dimitrios Tzionas

• Monocular Expressive Body Regression through Body-Driven Attention. [PDF] [Project] [Code]

Vasileios Choutas, Georgios Pavlakos, Timo Bolkart, Dimitrios Tzionas , Michael J. Black

• The Phong Surface: Efficient 3D Model Fitting using Lifted Optimization. [PDF] (Oral)

Jingjing Shen, Thomas J. Cashman, Qi Ye, Tim Hutton, Toby Sharp, Federica Bogo, Andrew William Fitzgibbon, Jamie Shotton

• Whole-Body Human Pose Estimation in the Wild. [PDF] [Code]

Sheng Jin, Lumin Xu, Jin Xu, Can Wang, Wentao Liu, Chen Qian, Wanli Ouyang, Ping Luo

• Dual Grid Net: hand mesh vertex regression from single depth maps. [PDF]

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

• Hand-Transformer: Non-Autoregressive Structured Modeling for 3D Hand Pose Estimation. [PDF]

Lin Huang, Jianchao Tan, Ji Liu, and Junsong Yuan

• ContactPose: A Dataset of Grasps with Object Contact and Hand Pose. [PDF] [Project] [Code]

Samarth Brahmbhatt, Chengcheng Tang, Chris Twigg, Charles C. Kemp, and James Hays

• SeqHAND: RGB-Sequence-Based 3D Hand Pose and Shape Estimation. [PDF]

John Yang, Hyung Jin Chang, Seungeui Lee, Nojun Kwak

• HTML: A Parametric Hand Texture Model for 3D Hand Reconstruction and Personalizationm. [PDF] [Project]

Neng Qian, Jiayi Wang, Franziska Mueller, Florian Bernard, Vladislav Golyanik, Christian Theobalt

• JGR-P2O: Joint Graph Reasoning based Pixel-to-Offset Prediction Network for 3D Hand Pose Estimation from a Single Depth Image. [PDF] [Code] (Spotlight)

Linpu Fang, Xingyan Liu, Li Liu, Hang Xu, Wenxiong Kang

• Adaptive Computationally Efficient Network for Monocular 3D Hand Pose Estimation. [PDF] (Spotlight)

Zhipeng Fan, Jun Liu, Yao Wang

• Collaborative Learning of Gesture Recognition and 3D Hand Pose Estimation with Multi-Order Feature Analysis. [PDF] (Spotlight)

Siyuan Yang, Jun Liu, Shijian Lu, Meng Hwa Er, Alex C. Kot

• DeepHandMesh: Weakly-supervised Deep Encoder-Decoder Framework for High-fidelity Hand Mesh Modeling from a Single RGB Image. [PDF] [Project] (Oral)

Gyeongsik Moon, Takaaki Shiratori, Kyoung Mu Lee

• InterHand2.6M: A New Large-scale Dataset and Baseline for 3D Single and Interacting Hand Pose Estimation from a Single RGB Image. [PDF] [Project] [Code]

Gyeongsik Moon, Shoou-i Yu, He Wen, Takaaki Shiratori, Kyoung Mu Lee

• I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image. [PDF] [Code]

Gyeongsik Moon, Kyoung Mu Lee

• Weakly-Supervised 3D Hand Pose Estimation via Biomechanical Constraints. [PDF]

Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Otmar Hilliges, Jan Kautz

• Measuring Generalisation to Unseen Viewpoints, Articulations, Shapes and Objects for 3D Hand Pose Estimation under Hand-Object Interaction. [PDF] [Code]

Anil Armagan, Guillermo Garcia-Hernando, Seungryul Baek, Shreyas Hampali, Mahdi Rad, Zhaohui Zhang, Shipeng Xie, MingXiu Chen, Boshen Zhang, Fu Xiong, Yang Xiao, Zhiguo Cao, Junsong Yuan, Pengfei Ren, Weiting Huang, Haifeng Sun, Marek Hrúz, Jakub Kanis, Zdeněk Krňoul, Qingfu Wan, Shile Li, Linlin Yang, Dongheui Lee, Angela Yao, Weiguo Zhou, Sijia Mei, Yunhui Liu, Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Philippe Weinzaepfel, Romain Brégier, Gregory Rogez, Vincent Lepetit, Tae-Kyun Kim

[back to top]

2020 CVPR

• Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wild. [PDF] [Project] (Oral) (Paper Award Nominees)

Dominik Kulon, Riza Alp Güler, Iasonas Kokkinos, Michael Bronstein, Stefanos Zafeiriou

• Weakly-supervised Domain Adaptation via GAN and Mesh Model for Estimating 3D Hand Poses Interacting Objects. [PDF] [Code] (Oral) (Paper Award Nominees)

Seungryul Baek, Kwang In Kim, Tae-Kyun Kim

• GanHand: Predicting Human Grasp Affordances in Multi-Object Scenes. [PDF]

Enric Corona, Albert Pumarola, Guillem Alenya, Francesc Moreno-Noguer, Gregory Rogez

• Cross-Modal Variational Alignment of Latent Spaces. [PDF]

Thomas Theodoridis, Theocharis Chatzis, Vassilios Solachidis, Kosmas Dimitropoulos, Petros Daras

• HUMBI: A Large Multiview Dataset of Human Body Expressions. [PDF] [Project]

Zhixuan Yu*, Jae Shin Yoon*, Prashanth Venkatesh, Jaesik Park, Jihun Yu, Hyun Soo Park

• Epipolar Transformers. [PDF] [Code]

Yihui He*, Rui Yan*, Shoou-I Yu, Katerina Fragkiadaki

• HandVoxNet: Deep Voxel-Based Network for 3D Hand Shape and Pose Estimation from a Single Depth Map. [PDF]

Jameel Malik, Ibrahim Abdelaziz, Ahmed Elhayek, Soshi Shimada, Sk Aziz Ali, Vladislav Golyanik, Christian Theobalt, Didier Stricker

• Knowledge as Priors: Cross-Modal Knowledge Generalization for Datasets without Superior Knowledge. [PDF]

Long Zhao, Xi Peng, Yuxiao Chen, Mubbasir Kapadia, Dimitris N. Metaxas

• Leveraging Photometric Consistency over Time for Sparsely Supervised Hand-Object Reconstruction. [PDF] [Project] [Code]

Yana Hasson, Bugra Tekin, Federica Bogo, Ivan Laptev, Marc Pollefeys, Cordelia Schmid

• Monocular Real-time Hand Shape and Motion Capture using Multi-modal Data. [PDF] [Project] [Code]

Yuxiao Zhou, Marc Habermann, Weipeng Xu, Ikhsanul Habibie, Christian Theobalt, Feng Xu

• HOPE-Net: A Graph-based Model for Hand-Object Pose Estimation. [PDF] [Code]

Bardia Doosti, Shujon Naha, David Crandall, Majid Mirbagheri

• HOnnotate: A method for 3D Annotation of Hand and Objects Poses. [PDF] [Project] [Code]

Shreyas Hampali, Mahdi Rad, Markus Oberweger, Vincent Lepetit

[back to top]

2020 Others

• [2020 ICRA] Robust, Occlusion-aware Pose Estimation for Objects Grasped by Adaptive Hands . [PDF] [Code]

Bowen Wen, Chaitanya Mitash, Sruthi Soorian, Andrew Kimmel, Avishai Sintov, Kostas E. Bekris

• [2020 CVPRW] MediaPipe Hands: On-device Real-time Hand Tracking. [PDF]

Fan Zhang, Valentin Bazarevsky, Andrey Vakunov, Andrei Tkachenka, George Sung, Chuo-Ling Chang, Matthias Grundmann

• [2020 ISMAR] 3D Hand Pose Estimation with a Single Infrared Camera via Domain Transfer Learning. [PDF]

Gabyong Park, Tae-Kyun Kim, Woontack Woo

• [2020 ISMAR] Bare-hand Depth Inpainting for 3D Tracking of Hand Interacting with Object. [PDF]

Woojin Cho, Gabyong Park, Woontack Woo

• [2020 3DV] Grasping Field: Learning Implicit Representations for Human Grasps. [PDF] [Code] (Best Paper Award)

Korrawe Karunratanakul, Jinlong Yang, Yan Zhang, Michael Black, Krikamol Muandet, Siyu Tang

• [2020 UIST] DeepFisheye: Near-Surface Multi-Finger Tracking Technology Using Fisheye Camera. [PDF] [Project] [Code]

Keunwoo Park, Sunbum Kim, Youngwoo Yoon, Tae-Kyun Kim, Geehyuk Lee

• [2020 SIGGRAPH Asia] Constraining Dense Hand Surface Tracking With Elasticity. [PDF] [Project]

Breannan Smith, Chenglei Wu, He Wen, Patrick Peluse, Yaser Sheikh, Jessica Hodgins, Takaaki Shiratori

• [2020 SIGGRAPH Asia] RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Video. [PDF] [Project]

Jiayi Wang, Franziska Mueller, Florian Bernard, Suzanne Sorli, Oleksandr Sotnychenko, Neng Qian, Miguel A. Otaduy, Dan Casas, and Christian Theobalt

• [2020 SIGGRAPH] MEgATrack: Monochrome Egocentric Articulated Hand-Tracking for Virtual Reality. [PDF]

Shangchen Han, Beibei Liu, Randi Cabezas, Christopher D. Twigg, Peizhao Zhang, Jeff Petkau, Tsz-Ho Yu, Chun-Jung Tai, Muzaffer Akbay, Zheng Wang, Asaf Nitzan, Gang Dong, Yuting Ye, Lingling Tao, Chengde Wan, Robert Wang

• [2020 MM] MM-Hand: 3D-Aware Multi-Modal Guided Hand Generation for 3D Hand Pose Synthesis. [PDF] [Code]

Zhenyu Wu, Duc Hoang, Shih-Yao Lin, Yusheng Xie, Liangjian Chen, Yen-Yu Lin, Zhangyang Wang, Wei Fan

• [2020 MM] Adaptive Wasserstein Hourglass for Weakly Supervised Hand Pose Estimation from Monocular RGB. [PDF]

Yumeng Zhang, Li Chen, Yufeng Liu, Junhai Yong, Wen Zheng

• [2020 MM] HOT-Net: Non-Autoregressive Transformer for 3D Hand-Object Pose Estimation. [PDF]

Lin Huang, Jianchao Tan, Jingjing Meng, Ji Liu, and Junsong Yuan

• [2020 BMVC] PMD-Net: Privileged Modality Distillation Network for 3D Hand Pose Estimation from a Single RGB Image. [PDF]

Kewen Wang and Xilin Chen

• [2020 BMVC] SIA-GCN: A Spatial Information Aware Graph Neural Network with 2D Convolutions for Hand Pose Estimation. [PDF]

Deying Kong, Haoyu Ma and Xiaohui Xie

• [2020 BMVC] Explicit Knowledge Distillation for 3D Hand Pose Estimation from Monocular RGB. [PDF]

Yumeng Zhang, Li Chen, Yufeng Liu, Wen Zheng and JunHai Yong

• [2020 BMVC] BiHand: Recovering Hand Mesh with Multi-stage Bisected Hourglass Networks. [PDF] [Code]

Lixin Yang, Jiasen Li, Wenqiang Xu, Yiqun Diao, Cewu Lu

• [2020 Ubicomp] FingerTrak: Continuous 3D Hand Pose Tracking by Deep Learning Hand Silhouettes Captured by Miniature Thermal Cameras on Wrist. [PDF] (ECCV 2020 Demo Award Nominee)

Fang Hu, Peng He, Songlin Xu, Yin Li, Cheng Zhang

• [2020 FG] Hand tracking from monocular RGB with dense semantic labels. [PDF]

Peter Thompson, Aphrodite Galata

• [2020 FG] Generative Model-Based Loss to the Rescue: A Method to Overcome Annotation Errors for Depth-Based Hand Pose Estimation. [PDF]

Jiayi Wang, Franziska Mueller, Florian Bernard, Christian Theobalt

• [2020 IROS] Physics-Based Dexterous Manipulations with Estimated Hand Poses and Residual Reinforcement Learning. [PDF]

Guillermo Garcia-Hernando, Edward Johns, Tae-Kyun Kim

• [2020 CHI] Evaluation of Machine Learning Techniques for Hand Pose Estimation on Handheld Device with Proximity Sensor. [PDF]

Kazuyuki Arimatsu, Hideki Mori

• [2020 AAAI] AWR: Adaptive Weighting Regression for 3D Hand Pose Estimation. [PDF] [Code]

Weiting Huang, Pengfei Ren, Jingyu Wang, Qi Qi, Haifeng Sun

• [2020 WACV] Nonparametric Structure Regularization Machine for 2D Hand Pose Estimation. [PDF] [Code]

Yifei Chen*, Haoyu Ma*, Deying Kong, Xiangyi Yan, Jianbao Wu, Wei Fan, Xiaohui Xie

• [2020 WACV] 3D Hand Pose Estimation with Disentangled Cross-Modal Latent Space. [PDF]

Jiajun Gu, Zhiyong Wang, Wanli Ouyang, Weichen Zhang, Jiafeng Li, Li Zhuo

• [2020 WACV] DGGAN: Depth-image Guided Generative Adversarial Networks for Disentangling RGB and Depth Images in 3D Hand Pose Estimation. [PDF]

Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Wei Fan, Xiaohui Xie

• [2020 WACV] Rotation-invariant Mixed Graphical Model Network for 2D Hand Pose Estimation. [PDF]

Deying Kong, Haoyu Ma, Yifei Chen, Xiaohui Xie

• [2020 ICASSP] Weakly Supervised Segmentation Guided Hand Pose Estimation During Interaction With Unknown Objects. [PDF]

Cairong Zhang, Guijin Wang, Xinghao Chen, Pengwei Xie, Toshihiko Yamasaki

• [2020 ICASSP] Hand-3D-Studio: A New Multi-view System for 3D Hand Reconstruction. [PDF] [Project]

Zhengyi Zhao, Tianyao Wang, Siyu Xia, Yangang Wang

[back to top]

2019 ICCV

• FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images. [PDF] [Project] [Code]

Christian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan Russell, Max Argus, Thomas Brox

• A2J: Anchor-to-Joint Regression Network for 3D Articulated Pose Estimation from a Single Depth Image. [PDF] [Code]

Fu Xiong*, Boshen Zhang*, Yang Xiao, Zhiguo Cao, Taidong Yu, Joey Tianyi Zhou, and Junsong Yuan

• Exploiting Spatial-temporal Relationships for 3D Pose Estimation via Graph Convolutional Networks. [PDF]

Yujun Cai, Liuhao Ge, Jun Liu, Jianfei Cai, Tat-Jen Cham, Junsong Yuan, and Nadia Magnenat Thalmann

• Resolving 3D Human Pose Ambiguities with 3D Scene Constraints. [PDF] [Project]

Mohamed Hassan, Vasileios Choutas, Dimitrios Tzionas and Michael J. Black

• SO-HandNet: Self-Organizing Network for 3D Hand Pose Estimation with Semi-supervised Learning. [PDF] [Code]

Yujin Chen, Zhigang Tu, Liuhao Ge, Dejun Zhang, Ruizhi Chen, Junsong Yuan

• End-to-end Hand Mesh Recovery from a Monocular RGB Image. [PDF] [Code]

Xiong Zhang*, Qiang Li*, Wenbo Zhang, Wen Zheng

• Aligning Latent Spaces for 3D Hand Pose Estimation. [PDF]

Linlin Yang*, Shile Li*, Dongheui Lee, Angela Yao

• [HANDS19 Workshop] Disentangling Pose from Appearance in Monochrome Hand Images. [PDF]

Yikang Li, Chris Twigg, Yuting Ye, Lingling Tao, Xiaogang Wang

• [HANDS19 Workshop] RGB-based 3D Hand Pose Estimation via Privileged Learning with Depth Images. [PDF]

Shanxin Yuan, Bjorn Stenger, Tae-Kyun Kim

• [HANDS19 Workshop] Explicit Pose Deformation Learning for Tracking Human Poses. [PDF]

Xiao Sun, Chuankang Li, Stephen Lin

• [HANDS19 Workshop] Hand Pose Ensemble Learning based on Grouping Features of Hand Point Sets. [PDF]

Tianqiang Zhu, Yi Sun, Xiaohong Ma, Xiangbo Lin

2019 CVPR

• Disentangling Latent Hands for Image Synthesis and Pose Estimation. [PDF]

Linlin Yang, Angela Yao

• Point-to-Pose Voting based Hand Pose Estimation using Residual Permutation Equivariant Layer. [PDF]

Shile Li, Dongheui Lee

• H•O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactions. [PDF] (Oral)

Bugra Tekin, Federica Bogo, Marc Pollefeys

• Self supervised 3D hand pose estimation. [PDF] [Code] (Oral) (Best Paper Finalists)

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

• CrossInfoNet: Multi-Task Information Sharing Based Hand Pose Estimation. [PDF] [Code]

Kuo Du, Xiangbo Lin, Yi Sun, Xiaohong Ma

• Expressive Body Capture: 3D Hands, Face, and Body from a Single Image. [PDF] [Project] [Code] (Oral)

Georgios Pavlakos*, Vasileios Choutas*, Nima Ghorbani, Timo Bolkart, Ahmed A. A. Osman, Dimitrios Tzionas, Michael J. Black

• Learning joint reconstruction of hands and manipulated objects. [PDF] [Code] [Code] [Project]

Yana Hasson, Gül Varol, Dimitris Tzionas, Igor Kalevatykh, Michael J. Black, Ivan Laptev, and Cordelia Schmid

• 3D Hand Shape and Pose Estimation from a Single RGB Image. [PDF] [Project] [Code] (Oral)

Liuhao Ge, Zhou Ren, Yuncheng Li, Zehao Xue, Yingying Wang, Jianfei Cai, Junsong Yuan

• 3D Hand Shape and Pose from Images in the Wild. [PDF] [Code] (Oral)

Adnane Boukhayma, Rodrigo de Bem, Philip H.S. Torr

• Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Rendering. [PDF]

Seungryul Baek, Kwang In Kim, Tae-Kyun Kim

• Monocular Total Capture: Posing Face, Body, and Hands in the Wild. [PDF] [Project] [Code] (Oral)

Donglai Xiang, Hanbyul Joo, Yaser Sheikh

[back to top]

2019 Others

• [2019 SIGGRAPH] Interactive Hand Pose Estimation using a Stretch-Sensing Soft Glove. [PDF] [Project]

Oliver Glauser, Shihao Wu, Daniele Panozzo, Otmar Hilliges, Olga Sorkine-Hornung

• [2019 SIGGRAPH] InteractionFusion: Real-time Reconstruction of Hand Poses and Deformable Objects in Hand-object Interactions. [PDF]

Hao Zhang, Zi-Hao Bo, Jun-Hai Yong, Feng Xu

• [2019 SIGGRAPH] Real-time pose and shape reconstruction of two interacting hands with a single depth camera. [PDF] [Project]

Franziska Mueller, Micah Davis, Florian Bernard, Oleksandr Sotnychenko, Mickeal Verschoor, Miguel A. Otaduy, Dan Casas, Christian Theobalt

• [2019 FG] Deep Conditional Variational Estimation for Depth-Based Hand Poses. [PDF]

Lu Xu, Chen Hu, Yinqi Li, Ji’an Tao, Jianru Xue, Kuizhi Mei

• [2019 BMVC] Unified 2D and 3D Hand Pose Estimation from a Single Visible or X-ray Image. [PDF]

Akila Pemasiri, Kien Nguyen Thanh, Sridha Sridharan, Clinton Fookes

• [2019 BMVC] TAGAN: Tonality Aligned Generative Adversarial Networks for Realistic HandPose Synthesis. [PDF]

Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Hui Tang, Yufan Xue, Xiaohui Xie, Yen-Yu Lin, Wei Fan

• [2019 BMVC] Single Image 3D Hand Reconstruction with Mesh Convolutions. [PDF] [Code]

Dominik Kulon, Haoyang Wang, Riza Alp Güler, Michael Bronstein, Stefanos Zafeiriou

• [2019 BMVC] Adaptive Graphical Model Network for 2D Handpose Estimation. [PDF]

Deying Kong, Yifei Chen, Haoyu Ma, Xiangyi Yan, Xiaohui Xie

• [2019 BMVC] SRN: Stacked Regression Network for Real-time 3D Hand Pose Estimation. [PDF]

Pengfei Ren, Haifeng Sun, Jingyu Wang, Qi Qi, Weiting Huang

• [2019 BMVC] End-to-End 3D Hand Pose Estimation from Stereo Cameras. [PDF] (Oral)

Yuncheng Li, Zehao Xue, Yingying Wang, Liuhao Ge, Zhou Ren, Jonathan Rodriguez

• [2019 ACCV] Hand Pose Estimation Based on 3D Residual Network with Data Padding and Skeleton Steadying. [PDF]

Pai-Wen Ting, En-Te Chou, Ya-Hui Tang, Li-Chen Fu

• [2019 ICASSP] Cascaded Point Network for 3D Hand Pose Estimation. [PDF]

Yikun Dou, Xuguang Wang, Yuying Zhu, Xiaoming Deng, Cuixia Ma, Liang Chang, Hongan Wang

• [2019 ICASSP] A Novel Framework of Hand Localization and Hand Pose Estimation. [PDF]

Yunlong Che, Yuxiang Song, Yue Qi

• [2019 ICRA] Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Network. [PDF] [Code]

Shuang Li*, Xiaojian Ma*, Hongzhuo Liang, Michael Görner, Philipp Ruppel, Bing Fang, Fuchun Sun, Jianwei Zhang

• [2019 WACV] MURAUER: Mapping Unlabeled Real Data for Label AUstERity. [PDF] [Project] [Code]

Georg Poier, Michael Opitz, David Schinagl and Horst Bischof

[back to top]

2018 ECCV

• HandMap: Robust Hand Pose Estimation via Intermediate Dense Guidance Map Supervision. [PDF] [Project] [Code]

Xiaokun Wu, Daniel Finnegan, Eamonn O'Neill, Yongliang Yang

• HBE: Hand Branch Ensemble network for real time 3D hand pose estimation. [PDF]

Yidan Zhou, Jian Lu, Kuo Du, Xiangbo Lin, Yi Sun, Xiaohong Ma

• Point-to-Point Regression PointNet for 3D Hand Pose Estimation. [PDF]

Liuhao Ge, Zhou Ren, Junsong Yuan

• Weakly-supervised 3D Hand Pose Estimation from Monocular RGB Images. [PDF] (Oral)

Yujun Cai, Liuhao Ge, Jianfei Cai, Junsong Yuan

• Joint 3D tracking of a deformable object in interaction with a hand. [PDF] [Project]

Aggeliki Tsoli, Antonis A. Argyros

• Occlusion-aware Hand Pose Estimation Using Hierarchical Mixture Density Network. [PDF] (Oral)

Qi Ye, Tae-Kyun Kim

• Hand Pose Estimation via Latent 2.5D Heatmap Regression. [PDF]

Umar Iqbal, Pavlo Molchanov, Thomas Breuel, Juergen Gall, Jan Kautz

• [Hands18 Workshop] Adapting Egocentric Visual Hand Pose Estimation Towards a Robot-Controlled Exoskeleton. [PDF]

Gerald Baulig, Thomas Gulde, Cristobal Curio

• [Hands18 Workshop] Estimating 2D Multi-Hand Poses From Single Depth Images. [PDF]

Le Duan, Minmin Shen, Song Cui, Zhexiao Guo, Oliver Deussen

• [Hands18 Workshop] Task-Oriented Hand Motion Retargeting for Dexterous Manipulation Imitation. [PDF] [Project]

Dafni Antotsiou, Guillermo Garcia-Hernando, Tae-Kyun Kim

[back to top]

2018 CVPR

• First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations. [PDF] [Project] [Code]

Guillermo Garcia-Hernando, Shanxin Yuan, Seungryul Baek, Tae-Kyun Kim

• Learning Pose Specific Representations by Predicting Different Views. [PDF] [Project] [Code]

Georg Poier, David Schinagl, Horst Bischof

• Hand PointNet: 3D Hand Pose Estimation using Point Sets. [PDF] [Project] [Code] (Spotlight)

Liuhao Ge, Yujun Cai, Junwu Weng, Junsong Yuan

• Dense 3D Regression for Hand Pose Estimation. [PDF] [Code]

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

• Cross-modal Deep Variational Hand Pose Estimation. [PDF] [Project] [Code] (Spotlight)

Adrian Spurr, Jie Song, Seonwook Park, Otmar Hilliges

• Feature Mapping for Learning Fast and Accurate 3D Pose Inference from Synthetic Images. [PDF] [Project]

Mahdi Rad, Markus Oberweger, Vincent Lepetit

• GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB. [PDF] [Supp] [Project] (Spotlight)

Franziska Mueller, Florian Bernard, Oleksandr Sotnychenko, Dushyant Mehta, Srinath Sridhar, Dan Casas, Christian Theobalt

• V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Map. [PDF] [Code]

Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee

• Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals. [PDF] (Spotlight)

Shanxin Yuan, Guillermo Garcia-Hernando, Bjorn Stenger, Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee, Pavlo Molchanov, Jan Kautz, Sina Honari, Liuhao Ge, Junsong Yuan, Xinghao Chen, Guijin Wang, Fan Yang, Kai Akiyama, Yang Wu, Qingfu Wan, Meysam Madadi, Sergio Escalera, Shile Li, Dongheui Lee, Iason Oikonomidis, Antonis Argyros, Tae-Kyun Kim

• Augmented skeleton space transfer for depth-based hand pose estimation. [PDF] (Oral)

Seungryul Baek, Kwang In Kim, Tae-Kyun Kim

• [3D HUMANS Workshop] Monocular RGB Hand Pose Inference From Unsupervised Refinable Nets. [PDF]

Endri Dibra, Silvan Melchior, Ali Balkis, Thomas Wolf, Cengiz Oztireli, Markus Gross

[back to top]

2018 Others

• [2018 ISMAR] Hybrid 3D Hand Articulations Tracking Guided by Classification and Search Space Adaptation. [PDF]

Gabyong Park, Woontack Woo

• [2018 ACCV] Hand Pose Estimation based on 3D Residual Network with Data Padding and Skeleton Steadying. [PDF]

Pai-Wen Ting, En-Te Chou, Ya-Hui Tang, Li-Chen Fu

• [2018 ACCV] Partially Occluded Hands: A challenging new dataset for single-image hand pose estimation. [PDF] [Project] (Oral)

Battushig Myanganbayar, Cristina Mata, Gil Dekel, Boris Katz, Guy Ben-Yosef, Andrei Barbu

• [2018 ACCV] Domain Transfer for 3D Pose Estimation from Color Images without Manual Annotations. [PDF] (Oral)

Mahdi Rad, Markus Oberweger, Vincent Lepetit

• [2018 PCM] Hand Pose Estimation with Attention-and-Sequence Network. [PDF]

Tianping Hu*, Wenhai Wang*, Tong Lu

• [2018 PCM] Mutiple Transfer Net with Region Ensemble for Deep Hand Pose Estimation. [PDF]

Haoqian Wang, Da Li, Xingzheng Wang

• [2018 ICPR] Local Regression Based Hourglass Network for Hand Pose Estimation from a Single Depth Image. [PDF]

Jia Li, Zengfu Wang

• [2018 ICPR] Dynamic Projected Segmentation Networks for Hand Pose Estimation. [PDF]

Yunlong Che, Yue Qi

• [2018 3DV] DeepHPS: End-to-end Estimation of 3D Hand Pose and Shape by Learning from Synthetic Depth. [PDF]

Jameel Malik, Ahmed Elhayek, Fabrizio Nunnari, Kiran Varanasi, Kiarash Tamaddon, Alexis Heloir, Didier Stricker

• [2018 ICIP] Networks Effectively Utilizing 2D Spatial Information for Accurate 3D Hand Pose Estimation. [PDF]

Baoen Liu, Shiliang Huang, Zhongfu Ye

• [2018 ICIP] On the Fusion of RGB and Depth Information For Hand Pose Estimation. [PDF] [Code]

Evangelos Kazakos, Christophoros Nikou, Ioannis Kakadiaris

• [2018 ICIP] Fast Lifting for 3D Hand Pose Estimation in AR/VR Applications. [PDF]

Onur Guleryuz, Christine Kaeser-Chen

• [2018 BMVC] Structure-Aware 3D Hourglass Network for Hand Pose Estimation from Single Depth Image. [PDF]

Fuyang Huang, Ailing Zeng, Minhao Liu, Jing Qin, Qiang Xu

• [2018 BMVC] 3D Hand Pose Estimation using Simulation and Partial-Supervision with a Shared Latent Space. [PDF] [Code] (Oral)

Masoud Abdi, Ehsan Abbasnejad, Chee Peng Lim, Saeid Nahavandi

• [2018 FG] Kinematic Constrained Cascaded Autoencoder for Real-time Hand Pose Estimation. [PDF]

Yushun Lin, Xiujuan Chai, Xilin Chen

• [2018 WACV] Using a single RGB frame for real time 3D hand pose estimation in the wild. [PDF] [Project] [Code]

Paschalis Panteleris, Iason Oikonomidis, Antonis Argyros

[back to top]

2017 ICCV

• Learning to Estimate 3D Hand Pose from Single RGB Images. [PDF] [Project] [Code]

Christian Zimmermann, Thomas Brox

• Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor. [PDF] [Project]

Franziska Mueller, Dushyant Mehta, Oleksandr Sotnychenko, Srinath Sridhar, Dan Casas, Christian Theobalt

• Robust Hand Pose Estimation during the Interaction with an Unknown Object. [PDF] [Supp] [Project]

Chiho Choi, Sang Ho Yoon, Chin-Ning Chen, Karthik Ramani

• Learning Hand Articulations by Hallucinating Heat Distribution. [PDF] [Supp] [Project]

Chiho Choi, Sangpil Kim, Karthik Ramani

• Low-Dimensionality Calibration through Local Anisotropic Scaling for Robust Hand Model Personalization. [PDF] [Project] [Code]

Edoardo Remelli*, Anastasia Tkach*, Andrea Tagliasacchi, Mark Pauly

• [Hands17 Workshop] Back to RGB: 3D tracking of hands and hand-object interactions based on short-baseline stereo. [PDF]

Paschalis Panteleris, Antonis Argyros

• [Hands17 Workshop] DeepPrior++: Improving Fast and Accurate 3D Hand Pose Estimation. [PDF] [Project] [Code]

Markus Oberweger and Vincent Lepetit

• [Hands17 Workshop] Hand Pose Estimation Using Deep Stereovision and Markov-chain Monte Carlo. [PDF]

Rilwan Remilekun Basaru, Chris Child, Eduardo Alonso, Greg Slabaugh

[back to top]

2017 CVPR

• Hand Keypoint Detection in Single Images using Multiview Bootstrapping. [PDF] [Project] [Code]

Tomas Simon, Hanbyul Joo, Iain Matthews, Yaser Sheikh

• Crossing Nets: Combining GANs and VAEs with a Shared Latent Space for Hand Pose Estimation. [PDF] [Code]

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

• Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis. [PDF]

Shanxin Yuan*, Qi Ye*, Bjorn Stenger, Siddhand Jain, Tae-Kyun Kim

• 3D Convolutional Neural Networks for Efficient and Robust Hand Pose Estimation from Single Depth Images. [PDF] [Project]

Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann

[back to top]

2017 Others

• [2017 3DV] Simultaneous Hand Pose and Skeleton Bone-Lengths Estimation from a Single Depth Image. [PDF]

Jameel Malik, Ahmed Elhayek, Didier Stricker

• [2017 3DV] How to Refine 3D Hand Pose Estimation from Unlabelled Depth Data? [PDF]

Endri Dibra*, Thomas Wolf*, Cengiz Öztireli, Markus Gross

• [2017 ICIP] Region Ensemble Network: Improving Convolutional Network for Hand Pose Estimation. [PDF] [Code]

Hengkai Guo, Guijin Wang, Xinghao Chen, Cairong Zhang, Fei Qiao, Huazhong Yang

• [2017 ICIP] A Hand Pose Tracking Benchmark from Stereo Matching. [PDF] [Project]

Jiawei Zhang, Jianbo Jiao, Mingliang Chen, Liangqiong Qu, Xiaobin Xu, and Qingxiong Yang

• [2017 SIGGRAPH Asia] Articulated distance fields for ultra-fast tracking of hands interacting. [PDF]

Jonathan Taylor*, Vladimir Tankovich*, Danhang Tang*, Cem Keskin*, David Kim, Philip Davidson, Adarsh Kowdle, Shahram Izadi

• [2017 SIGGRAPH Asia] Online Generative Model Personalization for Hand Tracking. [PDF] [Project]

Anastasia Tkach*, Andrea Tagliasacchi*, Edoardo Remelli, Mark Pauly, Andrew Fitzgibbon

• [2017 SIGGRAPH Asia] Embodied Hands: Modeling and Capturing Hands and Bodies Together. [PDF] [Project]

Javier Romero*, Dimitrios Tzionas* and Michael J. Black

• [2017 BMVC] Hand Pose Learning: Combining Deep Learning and Hierarchical Refinement for 3D Hand Pose Estimation. [PDF]

Min-Yu Wu, Ya Hui Tang, Pai-Wei Ting and Li-Chen Fu

• [2017 BMVC] Generative 3D Hand Tracking with Spatially Constrained Pose Sampling. [PDF] [Project]

Konstantinos Roditakis, Alexandros Makris and Antonis Argyros

• [2017 ICRA] Learning a deep network with spherical part model for 3D hand pose estimation. [PDF]

Tzu-Yang Chen, Pai-Wen Ting, Min-Yu Wu, Li-Chen Fu

• [2017 FG] Occlusion aware hand pose recovery from sequences of depth images. [PDF] [Slide]

Meysam Madadi, Sergio Escalera, Alex Carruesco Llorens, Carlos Andujar, Xavier Baro, Jordi Gonzalez

• [2017 FG] 3D Hand-Object Pose Estimation from Depth with Convolutional Neural Networks. [PDF] [Project]

Duncan Goudie, Aphrodite Galata

[back to top]

2016 ECCV

• Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation. [PDF] [Project]

Qi Ye*, Shanxin Yuan*, Tae-Kyun Kim

• Hand Pose Estimation from Local Surface Normals. [PDF]

Chengde Wan, Angela Yao, and Luc Van Gool

• Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input. [PDF] [Project]

Srinath Sridhar, Franziska Mueller, Michael Zollhöfer, Dan Casas, Antti Oulasvirta, Christian Theobalt

[back to top]

2016 CVPR

• Robust 3D Hand Pose Estimation in Single Depth Images: From Single-View CNN to Multi-View CNNs. [PDF] [Project] [Code]

Liuhao Ge, Hui Liang, Junsong Yuan, Daniel Thalmann

• DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed With Deep Features. [PDF][Project]

Ayan Sinha*, Chiho Choi*, Karthik Ramani

• Efficiently Creating 3D Training Data for Fine Hand Pose Estimation. [PDF] [Project] [Code]

Markus Oberweger, Gernot Riegler, Paul Wohlhart, Vincent Lepetit

• Fits Like a Glove: Rapid and Reliable Hand Shape Personalization. [PDF] [Project]

David Joseph Tan, Thomas Cashman, Jonathan Taylor, Andrew Fitzgibbon, Daniel Tarlow, Sameh Khamis, Shahram Izadi, Jamie Shotton

[back to top]

2016 Others

• [2016 NIPS] DISCO Nets : Dissimilarity Coefficient Networks. [PDF] [Project] [Code]

Diane Bouchacourt, M. Pawan Kumar, Sebastian Nowozin

• [2016 ACCV] Hand Pose Regression via A Classification-guided Approach. [PDF]

Hongwei Yang, Juyong Zhang

• [2016 ICPR] Deep learning for integrated hand detection and pose estimation. [PDF]

Tzu-Yang Chen, Min-Yu Wu, Yu-Hsun Hsieh, Li-Chen Fu

• [2016 ICPR] Depth-based 3D hand pose tracking. [PDF]

Kha Gia Quach, Chi Nhan Duong, Khoa Luu, and Tien D. Bui.

• [2016 IJCAI] Model-based Deep Hand Pose Estimation. [PDF] [Project] [Code]

Xingyi Zhou, Qingfu Wan, Wei Zhang, Xiangyang Xue, Yichen Wei

• [2016 SIGGRAPH] Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. [PDF]

Jonathan Taylor et al.

• [2016 SIGGRAPH Asia] Sphere-Meshes for Real-Time Hand Modeling and Tracking. [PDF] [Project] [Code]

Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi

[back to top]

2015 ICCV

• Training a Feedback Loop for Hand Pose Estimation. [PDF] [Project]

Markus Oberweger, Paul Wohlhart, Vincent Lepetit

• Opening the Black Box: Hierarchical Sampling Optimization for Estimating Human Hand Pose. [PDF]

Danhang Tang, Jonathan Taylor, Pushmeet Kohli, Cem Keskin, Tae-Kyun Kim, Jamie Shotton

• Depth-based hand pose estimation: data, methods, and challenges. [PDF] [Project] [Code]

James Supancic III, Deva Ramanan, Gregory Rogez, Yi Yang, Jamie Shotton

• 3D Hand Pose Estimation Using Randomized Decision Forest with Segmentation Index Points. [PDF]

Peiyi Li, Haibin Ling

• A collaborative filtering approach to real-time hand pose estimation. [PDF] [Project]

Chiho Choi, Ayan Sinha, Joon Hee Choi, Sujin Jang, Karthik Ramani

• Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions. [PDF]

Sven Bambach, Stefan Lee, David Crandall, Chen Yu

• Understanding Everyday Hands in Action from RGB-D Images. [PDF]

Gregory Rogez, James Supancic III, Deva Ramanan

[back to top]

2015 CVPR

• Cascaded Hand Pose Regression. [PDF]

Xiao Sun, Yichen Wei, Shuang Liang, Xiaoou Tang, and Jian Sun

• Fast and Robust Hand Tracking Using Detection-Guided Optimization. [PDF] [Project]

Srinath Sridhar, Franziska Mueller, Antti Oulasvirta, Christian Theobalt

• Learning an Efficient Model of Hand Shape Variation from Depth Images. [PDF]

Sameh Khamis, Jonathan Taylor, Jamie Shotton, Cem Keskin, Shahram Izadi, Andrew Fitzgibbon

[back to top]

2015 Others

• [2015 BMVC] Hybrid One-Shot 3D Hand Pose Estimation by Exploiting Uncertainties. [PDF] [Project]

Georg Poier, Konstantinos Roditakis, Samuel Schulter, Damien Michel, Horst Bischof and Antonis A. Argyros

• [2015 BMVC] Rule of Thumb: Deep Derotation for Improved Fingertip Detection. [PDF] [Project]

Aaron Wetzler, Ron Slossberg and Ron Kimmel

• [2015 CHI] Accurate, Robust, and Flexible Real-time Hand Tracking. [PDF] [Project]

Toby Sharp, Cem Keskin, Duncan Robertson, Jonathan Taylor, Jamie Shotton, David Kim, Christoph Rhemann, Ido Leichter, Alon Vinnikov, Yichen Wei, Daniel Freedman, Pushmeet Kohli, Eyal Krupka, Andrew Fitzgibbon, Shahram Izadi

• [2015 CVWW] Hands Deep in Deep Learning for Hand Pose Estimation. [PDF] [Project] [Code]

Markus Oberweger, Paul Wohlhart, Vincent Lepetit

• [2015 FG] Combining Discriminative and Model Based Approaches for Hand Pose Estimation. [PDF] [Project]

Philip Krejov, Andrew Gilbert, Richard Bowden

• [2015 SGP] Robust Articulated-ICP for Real-Time Hand Tracking. [PDF] [Project] [Code]

Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi

[back to top]

2014 CVPR

• Realtime and robust hand tracking from depth. [PDF] [Project]

Chen Qian, Xiao Sun, Yichen Wei, Xiaoou Tang and Jian Sun

• Latent regression forest: Structured estimation of 3d articulated hand posture. [PDF] [Project]

Danhang Tang, Hyung Jin Chang, Alykhan Tejani, T-K. Kim

• User-specific hand modeling from monocular depth sequences. [PDF] [Project]

Jonathan Taylor, Richard Stebbing, Varun Ramakrishna, Cem Keskin, Jamie Shotton, Shahram Izadi, Aaron Hertzmann, Andrew Fitzgibbon

• Evolutionary Quasi-random Search for Hand Articulations Tracking. [PDF] [Project]

Iason Oikonomidis, Manolis IA Lourakis, Antonis A Argyros

[back to top]

2014 Others & Before

• [2014 SIGGRAPH] Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks. [PDF] [Project]

Jonathan Tompson, Murphy Stein, Yann Lecun and Ken Perlin

• [2013 ICCV] Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forests. [PDF] [Project]

Danhang Tang, Tsz Ho Yu and T-K. Kim

• [2013 ICCV] Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data. [PDF] [Project]

Srinath Sridhar, Antti Oulasvirta, Christian Theobalt

• [2013 ICCV] Efficient Hand Pose Estimation from a Single Depth Image. [PDF] [Project]

Chi Xu, Li Cheng

• [2012 ECCV] Motion Capture of Hands in Action using Discriminative Salient Points. [PDF] [Project]

Ballan, L. and Taneja, A. and Gall, J. and van Gool, L. and Pollefeys, M.

• [2012 ECCV] Hand pose estimation and hand shape classification using multi-layered randomized decision forests.

Cem KeskinFurkan, KıraçYunus Emre, KaraLale Akarun

• [2011 CVPRW] Real Time Hand Pose Estimation using Depth Sensors. [PDF]

Cem Keskin, Furkan Kırac, Yunus Emre Kara, Lale Akarun

• [2011 BMVC] Efficient Model-based 3D Tracking of Hand Articulations using Kinect. [PDF] [Project] [Code]

Iason Oikonomidis, Nikolaos Kyriazis, Antonis A. Argyros

[back to top]

Theses

• [2020] Learning without Labeling for 3D Hand Pose Estimation. [PDF]

Georg Poier, Graz University of Technology

• [2018] Computational Learning for Hand Pose Estimation. [PDF]

Chiho Choi, Purdue University

• [2018] 3D hand pose estimation: methods, datasets, and challenges. [PDF]

Shanxin Yuan, Imperial College London

• [2018] 3D hand pose estimation using convolutional neural networks. [PDF]

Qi Ye, Imperial College London

• [2018] 3D Hand Pose Estimation from Images for Interactive Applications. [PDF]

Markus Oberweger, Graz University of Technology

• [2018] Articulated Human Pose Estimation in Unconstrained Images and Videos. [PDF]

Umar Iqbal, University of Bonn

• [2018] Real-Time Generative Hand Modeling and Tracking. [PDF]

Anastasia Tkach, EPFL

• [2018] Recovery of the 3D Virtual Human: Monocular Estimation of 3D Shape and Pose with Data Driven Priors. [PDF] [Project]

Endri Dibra, ETH Zürich

• [2017] Human Segmentation, Pose Estimation and Applications. [PDF] [Slides]

Meysam Madadi, Universitat Autònoma de Barcelonato

• [2017] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects. [PDF] [Project]

Dimitrios Tzionas, University of Bonn

• [2016] Tracking Hands in Action for Gesture-based Computer Input. [PDF]

Srinath Sridhar, Max Planck Institute for Informatics

• [2016] 3D hand pose regression with variants of decision forests. [PDF] [Project]

Danhang Tang, Imperial College London

• [2016] Deep Learning for Human Motion Analysis. [PDF] [Project]

Natalia Neverova, National Institut of Applied Science (INSA de Lyon), France

• [2016] Real time hand pose estimation for human computer interaction. [PDF] [Project]

Philip Krejov, University of Surrey

• [2015] Efficient Tracking of the 3D Articulated Motion of Human Hands. [PDF]

Iason Oikonomidis, University of Crete

• [2015] Vision-based hand pose estimation and gesture recognition. [PDF]

Hui Liang, Nanyang Technological University

• [2015] Localization of Humans in Images Using Convolutional Networks. [PDF]

Jonathan Tompson, New York University

[back to top]

Datasets

• S/R: Synthetic (S) or Real (R) or Both (B)
• C/D: Color (RGB) or Depth (D)
• Obj: Interaction with objects or not
• #J: No. of joints or Mesh (M)
• V: view (3rd or egocentric)
• #S: No. of subjects
• #F: No. of frames (train/test)
• Mesh: Mesh annotations

Depth

RGB+Depth

RGB

Credits:

• [1] Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis, CVPR 2017 [PDF]
• [2] Depth-based hand pose estimation: methods, data, and challenges, ICCV 2015 Link
• [3] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects, IJCV 2016 [PDF]
• [4] MPI Hand Tracking Central

[back to top]

Workshops

[1] Workshops on Observing and Understanding Hands in Action:

• HANDS 2019, In conjunction with ICCV 2019

• HANDS 2018, In conjunction with ECCV 2018

• HANDS18: Methods, Techniques and Applications for Hand Observation. [PDF]

• HANDS 2017, In conjunction with ICCV 2017

• Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals. [PDF]

• HANDS 2016, In conjunction with CVPR 2016

• HANDS 2015, In conjunction with CVPR 2015

[2] Workshops on Capturing and modeling human bodies, faces and hands:

• PeopleCap 2018, In conjunction with ECCV 2018

• PeopleCap 2017, In conjunction with ICCV 2017

[back to top]

Challenges

[1] HANDS19 Challenge

HANDS 2019, ICCV 2019

• Submission Website: Depth-Based Task, Depth-Based Hand-Object Task, RGB-Based Hand-Object Task
• Documents
  • Measuring Generalisation to Unseen Viewpoints, Articulations, Shapes and Objects for 3D Hand Pose Estimation under Hand-Object Interaction, ECCV 2020

[2] The 2017 Hands in the Million Challenge on 3D Hand Pose Estimation

HANDS 2017, ICCV 2017

• Submission Website: Frame and Tracking Task, Hand-Object Task
• Documents
  • The 2017 Hands in the Million Challenge on 3D Hand Pose Estimation, arXiv 2017
  • Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals., CVPR 2018

[back to top]

Other Related Papers

• [arXiv 2011.07252] Ego2Hands: A Dataset for Egocentric Two-hand Segmentation and Detection. [PDF] [Code]

Fanqing Lin, Tony Martinez

• [2020 IJCV] Learning Multi-Human Optical Flow. [PDF] [Project] [Code]

Anurag Ranjan, David T. Hoffmann, Dimitrios Tzionas, Siyu Tang, Javier Romero, and Michael J. Black

• [2019 ICCV] Contextual Attention for Hand Detection in the Wild. [PDF] [Project] [Code]

Supreeth Narasimhaswamy*, Zhengwei Wei*, Yang Wang, Justin Zhang, Minh Hoai

• [2018 SIGGRAPH] Online Optical Marker-based Hand Tracking with Deep Labels. [PDF] [Code]

Shangchen Han, Beibei Liu, Robert Wang, Yuting Ye, Christopher D. Twigg, Kenrick Kin

• [2018 CVPRW] HandyNet: A One-stop Solution to Detect, Segment, Localize & Analyze Driver Hands. [PDF] [Code]

Akshay Rangesh, Mohan M. Trivedi

• [2018 CVPR] DensePose: Dense Human Pose Estimation In The Wild. [PDF] [Project] [Code]

Rıza Alp Güler, Natalia Neverova, Iasonas Kokkinos

• [2018 CVPR] Analysis of Hand Segmentation in the Wild. [PDF] [Code]

Aisha Urooj Khan, Ali Borji

• [2018 CVPR] Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies. [PDF] [Project] (CVPR Best Student Paper Award)

Hanbyul Joo, Tomas Simon, Yaser Sheikh

• [2017 CVPR] SurfNet: Generating 3D shape surfaces using deep residual networks. [PDF]

Ayan Sinha, Asim Unmesh, Qixing Huang, Karthik Ramani

• [2017 CVPR] Learning from Simulated and Unsupervised Images through Adversarial Training. [PDF] [Project] [Code-Tensorflow] [Code-Keras] [Code-Tensorflow-NYU-Hand] (CVPR Best Paper Award)

Ashish Shrivastava, Tomas Pfister, Oncel Tuzel, Josh Susskind, Wenda Wang, Russ Webb

• [2016 3DV] Learning to Navigate the Energy Landscape. [PDF] [Project]

Julien Valentin, Angela Dai, Matthias Niessner, Pushmeet Kohli, Philip H.S. Torr, Shahram Izadi

• [2015 ICCV] 3D Object Reconstruction from Hand-Object Interactions. [PDF] [Project]

Dimitrios Tzionas and Juergen Gall

[back to top]

Contribute

Contributions welcome! Read the contribution guidelines first.

Please feel free to pull requests, open an issue or send me email ([email protected]) to add awesome papers.

License

To the extent possible under law, xinghaochen has waived all copyright and related or neighboring rights to this work.