awesome digital human

A collection of resources on clothed people: full body recontruction, head reconstruction, digital human related projects, etc.

Contributing

Feedback and contributions are welcome! If you think I have missed out on something (or) have any suggestions (papers, implementations and other resources), feel free to pull a request. You could manually edit items or use the script to produce them in the markdown format provided below.

**Here is the Paper Name.**<br>
*[Author 1](homepage), Author 2, and Author 3.*<br>
Conference or Journal Year. [[PDF](link)] [[Project](link)] [[Github](link)] [[Data](link)]

Industry Demo or Product

Highavenue: Turn yourself into a 3D model.

3D Human Avatar Generation and Animation

Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization.
Connor Z. Lin, Koki Nagano, Jan Kautz, Eric R. Chan, Umar Iqbal, Leonidas Guibas, Gordon Wetzstein, Sameh Khamis.
SIGGRAPH 2023. [PDF] [Project] [Github]

Learning Locally Editable Virtual Humans.
Hsuan-I Ho, Lixin Xue, Jie Song, Otmar Hilliges.
CVPR 2023. [PDF] [Project] [Github]

PersonNeRF: Personalized Reconstruction from Photo Collections.
Chung-Yi Weng, Pratul P. Srinivasan, Brian Curless, Ira Kemelmacher-Shlizerman.
CVPR 2023. [PDF] [Project] [Github]

Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures.
Gal Metzer, Elad Richardson, Or Patashnik, Raja Giryes, Daniel Cohen-Or.
CVPR 2023. [PDF] [Github]

EVA3D: Compositional 3D Human Generation from 2D Image Collections.
Fangzhou Hong, Zhaoxi Chen, Yushi Lan, Liang Pan, Ziwei Liu.
ICLR 2023. [PDF] [Project] [Github]

CLIP-Actor: Text-Driven Recommendation and Stylization for Animating Human Meshes.
Kim Youwang, Kim Ji-Yeon, Tae-Hyun Oh.
ECCV 2022. [PDF] [Project] [Github]

AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars.
Fangzhou Hong, Mingyuan Zhang, Liang Pan, Zhongang Cai, Lei Yang, Ziwei Liu.
SIGGRAPH (TOG) 2022. [PDF] [Project] [Github]

AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationt.
Yifei Zeng, Yuanxun Lu, Xinya Ji, Yao Yao, Hao Zhu, Xun Cao.
arXiv 2023. [PDF] [Project] [Github]

DreamHuman: Animatable 3D Avatars from Text.
Nikos Kolotouros, Thiemo Alldieck, Andrei Zanfir, Eduard Gabriel Bazavan, Mihai Fieraru, Cristian Sminchisescu.
arXiv 2023. [PDF] [Project] [Avatar Gallery]

AG3D: Learning to Generate 3D Avatars from 2D Image Collections.
Zijian Dong, Xu Chen, Jinlong Yang, Michael J. Black, Otmar Hilliges, Andreas Geiger.
arXiv 2023. [PDF] [Project] [Github]

ZeroAvatar: Zero-shot 3D Avatar Generation from a Single Image.
Zhenzhen Weng, Zeyu Wang, Serena Yeung.
arxiv 2023. [PDF]

StyleAvatar3D: Leveraging Image-Text Diffusion Models for High-Fidelity 3D Avatar Generation.
Chi Zhang, Yiwen Chen, Yijun Fu, Zhenglin Zhou, Gang YU, Billzb Wang, Bin Fu, Tao Chen, Guosheng Lin, Chunhua Shen.
arXiv 2023. [PDF] [Github]

Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priors.
Zhangyang Xiong, Di Kang, Derong Jin, Weikai Chen, Linchao Bao, Xiaoguang Han.
arxiv 2023. [PDF]

AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control.
Ruixiang Jiang, Can Wang, Jingbo Zhang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao.
arxiv 2023. [PDF] [Project] [Code] [Data]

DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models.
Yukang Cao, Yan-Pei Cao, Kai Han, Ying Shan, Kwan-Yee K. Wong.
arxiv 2023. [PDF] [Project]

3D Head Animatable Avatar (from 2D Image Collections)

CLIPFace: Text-guided Editing of Textured 3D Morphable Models.
Shivangi Aneja, Justus Thies, Angela Dai, Matthias Nießner.
SIGGRAPH 2023. [PDF] [Project] [Github]

DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidance.
Longwen Zhang, Qiwei Qiu, Hongyang Lin, Qixuan Zhang, Cheng Shi, Wei Yang, Ye Shi, Sibei Yang, Lan Xu, Jingyi Yu.
SIGGRAPH 2023. [PDF] [Project] [Demo] [HuggingFace]

StyleAvatar: Real-time Photo-realistic Neural Portrait Avatar from a Single Video.
Lizhen Wang, Xiaochen Zhao, Jingxiang Sun, Yuxiang Zhang, Hongwen Zhang, Tao Yu✝, Yebin Liu.
SIGGRAPH 2023. [PDF]

NeRSemble: Multi-view Radiance Field Reconstruction of Human Heads.
Tobias Kirschstein, Shenhan Qian, Simon Giebenhain, Tim Walter, Matthias Nießner.
SIGGRAPH 2023. [PDF] [Project] [Video]

GANHead: Towards Generative Animatable Neural Head Avatars.
[Sijing Wu]((https://wsj-sjtu.github.io), Yichao Yan, Yunhao Li, Yuhao Cheng, Wenhan Zhu, Ke Gao, Xiaobo Li, Guangtao Zhai.
CVPR 2023. [PDF] [Project]

FitMe: Deep Photorealistic 3D Morphable Model Avatars.
Alexandros Lattas, Stylianos Moschoglou, Stylianos Ploumpis, Baris Gecer, Jiankang Deng, Stefanos Zafeiriou.
CVPR 2023. [PDF] [Project]

Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars.
Jingxiang Sun, Xuan Wang, Lizhen Wang, Xiaoyu Li, Yong Zhang, Hongwen Zhang, Yebin Liu.
CVPR 2023 (Highlight). [PDF] [Project] [Github]

BlendFields: Few-Shot Example-Driven Facial Modeling.
Kacper Kania, Stephan J. Garbin, Andrea Tagliasacchi, Virginia Estellers, Kwang Moo Yi, Julien Valentin, Tomasz Trzciński, Marek Kowalski.
CVPR 2023. [PDF] [Project]

OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Rendering.
Zhiyuan Ma, Xiangyu Zhu, Guojun Qi, Zhen Lei, Lei Zhang.
CVPR 2023. [PDF] [Github] [Demo]

PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360∘.
Sizhe An, Hongyi Xu, Yichun Shi, Guoxian Song, Umit Ogras, Linjie Luo.
CVPR 2023. [PDF [Project]

Efficient Meshy Neural Fields for Animatable Human Avatars.
Xiaoke Huang, Yiji Cheng, Yansong Tang, Xiu Li, Jie Zhou, Jiwen Lu .
CVPR 2023. [PDF] [Project]

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion.
Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, Baining Guo.
CVPR 2023. [PDF] [Project]

OmniAvatar: Geometry-Guided Controllable 3D Head Synthesis.
Hongyi Xu, Guoxian Song, Zihang Jiang, Jianfeng Zhang, Yichun Shi, Jing Liu, Wanchun Ma, Jiashi Feng, Linjie Luo.
CVPR 2023. [PDF]

PointAvatar: Deformable Point-based Head Avatars from Videos.
Yufeng Zheng, Wang Yifan, Gordon Wetzstein, Michael J. Black, Otmar Hilliges.
CVPR 2023. [PDF] [Project] [Github]

MEGANE: Morphable Eyeglass and Avatar Network.
Junxuan Li, Shunsuke Saito, Tomas Simon, Stephen Lombardi, Hongdong Li, Jason Saragih.
CVPR 2023. [PDF] [Project]

H3D-Net: Few-Shot High-Fidelity 3D Head Reconstruction.
Eduard Ramon, Gil Triginer, Janna Escur, Albert Pumarola, Jaime Garcia, Xavier Giro-i-Nieto, Francesc Moreno-Noguer.
ICCV 2021. [PDF] [Project] [H3DS Dataset]

AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild".
Alexandros Lattas, Stylianos Moschoglou, Baris Gecer, Stylianos Ploumpis, Vasileios Triantafyllou, Abhijeet Ghosh, Stefanos Zafeiriou.
CVPR 2020. [PDF] [Github]

AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANs.
Alexandros Lattas, Stylianos Moschoglou, Stylianos Ploumpis, Baris Gecer, Abhijeet Ghosh, Stefanos Zafeiriou.
TPAMI 2021. [PDF] [Github]

Generalizable One-shot Neural Head Avatar.
Xueting Li, Shalini De Mello, Sifei Liu, Koki Nagano, Umar Iqbal, Jan Kautz.
arXiv 2023. [PDF] [Project]

AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars.
Mohit Mendiratta. Xingang Pan, Mohamed Elgharib, Kartik Teotia, Mallikarjun B R, Ayush Tewari, Vladislav Golyanik, Adam Kortylewski, Christian Theobalt.
arXiv 2023. [PDF] [Project]

AlteredAvatar: Stylizing Dynamic 3D Avatars with Fast Style Adaptation.
Thu Nguyen-Phuoc, Gabriel Schwartz, Yuting Ye, Stephen Lombardi, Lei Xiao.
arXiv 2023. [PDF] [Project]

Towards Realistic Generative 3D Face Models.
Aashish Rai, Hiresh Gupta, Ayush Pandey, Francisco Vicente Carrasco, Shingo Jason Takagi, Amaury Aubel, Daeil Kim, Aayush Prakash, Fernando de la Torre.
arxiv 2023. [PDF] [Project] [Github]

HQ3DAvatar: High Quality Controllable 3D Head Avatar.
Kartik Teotia, Mallikarjun B R, Xingang Pan, Hyeongwoo Kim, Pablo Garrido, Mohamed Elgharib, Christian Theobalt.
arxiv 2023. [PDF] [Project] [Github]

NeRFEditor: Differentiable Style Decomposition for Full 3D Scene Editing.
Chunyi Sun, Yanbin Liu, Junlin Han, Stephen Gould.
arxiv 2022. [PDF] [Project]

ManVatar: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxels.
Yuelang Xu, Lizhen Wang, Xiaochen Zhao, Hongwen Zhang, Yebin Liu.
arXiv 2022. [PDF] [Project]

(Clothed) Human Motion Generation

HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion.
Mustafa Işık, Martin Rünz, Markos Georgopoulos, Taras Khakhulin, Jonathan Starck, Lourdes Agapito, Matthias Nießner.
SIGGRAPH 2023. [PDF] [Project] [Github] [Data]

GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latents.
Tenglong Ao, Zeyi Zhang, Libin Liu.
SIGGRAPH 2023 (Journal Track). [PDF] [Project] [Github]

MDM: Human Motion Diffusion Model.
Guy Tevet, Sigal Raab, Brian Gordon, Yonatan Shafir, Daniel Cohen-Or, Amit H. Bermano.
ICLR 2023. [PDF] [Project] [Github]

MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis.
Rishabh Dabral, Muhammad Hamza Mughal, Vladislav Golyanik, Christian Theobalt.
CVPR 2023. [PDF] [Project]

MotionCLIP: Exposing Human Motion Generation to CLIP Space.
Guy Tevet, Brian Gordon, Amir Hertz, Amit H. Bermano, Daniel Cohen-Or.
ECCV 2022. [PDF] [Project] [Github]

TEMOS: Generating diverse human motions from textual descriptions.
Mathis Petrovich, Michael J. Black, Gül Varol.
ECCV 2022. [PDF] [Project] [Github]

TEACH: Temporal Action Composition for 3D Human.
Nikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül Varol.
3DV 2022. [PDF] [Project] [Github]

TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis.
Mathis Petrovich, Michael J. Black and Gül Varol.
arxiv 2023. [PDF] [Project] [Github]

SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation.
Nikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül Varol.
arxiv 2023. [PDF] [Project] [Github]

ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model.
Mingyuan Zhang, Xinying Guo, Liang Pan, Zhongang Cai, Fangzhou Hong, Huirong Li, Lei Yang, Ziwei Liu.
arxiv 2023. [PDF] [Project] [Github]

MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model.
Mingyuan Zhang, Zhongang Cai, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, Ziwei Liu.
arxiv 2022. [PDF] [Project] [Github]

Clothed Human Digitalization

Project Splinter: Human Digitalization with Implicit Representation.

Recovering 3D Human Mesh from Monocular Images: A Survey.
Yating Tian, Hongwen Zhang, Yebin Liu, Limin Wang.
arxiv 2022. [PDF] [Project] [Dataset] [Benchmarks]

HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion.
Mustafa Işık, Martin Rünz, Markos Georgopoulos, Taras Khakhulin, Jonathan Starck, Lourdes Agapito, Matthias Nießner.
SIGGRAPH 2023. [PDF] [Project] [Github] [Data]

AvatarReX: Real-time Expressive Full-body Avatars.
Zerong Zheng, Xiaochen Zhao, Hongwen Zhang, Boning Liu, Yebin Liu.
SIGGRAPH 2023 [PDF] [Project]

PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modeling.
Zhe Li, Zerong Zheng, Yuxiao Liu, Boyao Zhou, Yebin Liu.
SIGGRAPH 2023 [PDF] [Project]

SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstruction.
Yukang Cao, Kai Han, Kenneth Kwan-Yee K. Wong.
CVPR 2023. [PDF] [Project] [Github]

Reconstructing Animatable Categories from Videos.
Gengshan Yang, Chaoyang Wang, N Dinesh Reddy, Deva Ramanan.
CVPR 2023. [PDF] [Project] [Github]

Representing Volumetric Videos as Dynamic MLP Maps.
Sida Peng, Yunzhi Yan, Qing Shuai, Hujun Bao, Xiaowei Zhou.
CVPR 2023. [PDF] [Project] [Github]

Learning Neural Volumetric Representations of Dynamic Humans in Minutes.
Chen Geng, Sida Peng, Zhen Xu, Hujun Bao, Xiaowei Zhou.
CVPR 2023. [PDF] [Project] [Github]

CloSET: Modeling Clothed Humans on Continuous Surface with Explicit Template Decomposition.
Hongwen Zhang, Siyou Lin, Ruizhi Shao, Yuxiang Zhang, Zerong Zheng, Han Huang, Yandong Guo, Yebin Liu.
CVPR 2023. [PDF] [Project]

MonoHuman: Animatable Human Neural Field from Monocular Video.
Zhengming Yu, Wei Cheng, Xian Liu, Wayne Wu, Kwan-Yee Lin.
CVPR 2023. [PDF] [Project]

FlexNeRF: Photorealistic Free-viewpoint Rendering of Moving Humans from Sparse Views.
Vinoj Jayasundara, Amit Agrawal, Nicolas Heron, Abhinav Shrivastava, Larry S. Davis.
CVPR 2023. [PDF]

High-fidelity 3D Human Digitization from Single 2K Resolution Images.
Sang-Hun Han, Min-Gyu Park, Ju Hong Yoon, Ju-Mi Kang, Young-Jae Park, Hae-Gon Jeon.
CVPR 2023 (Highlight). [PDF] [Github]

Learning Neural Volumetric Representations of Dynamic Humans in Minutes.
Chen Geng, Sida Peng, Zhen Xu, Hujun Bao, Xiaowei Zhou.
CVPR 2023. [PDF] [Project]

Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition.
Chen Guo, Tianjian Jiang, Xu Chen, Jie Song, Otmar Hilliges.
CVPR 2023. [PDF] [Project]

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion.
Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, Baining Guo.
CVPR 2023. [PDF] [Project]

ECON: Explicit Clothed humans Obtained from Normals.
Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, Michael J. Black.
CVPR 2023. [PDF] [Project] [Github]

X-Avatar: Expressive Human Avatars.
Kaiyue Shen, Chen Guo, Manuel Kaufmann, Juan Jose Zarate, Julien Valentin, Jie Song, Otmar Hilliges.
CVPR 2023. [PDF] [Project] [Github]

InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds.
Tianjian Jiang, Xu Chen, Jie Song, Otmar Hilliges.
CVPR 2022. [PDF] [Project] [Github]

Learning Visibility Field for Detailed 3D Human Reconstruction and Relighting.
Ruichen Zheng, Peng Li, Haoqian Wang, Tao Yu.
CVPR 2023. [PDF]

HumanGen: Generating Human Radiance Fields with Explicit Priors.
Suyi Jiang, Haoran Jiang, Ziyu Wang, Haimin Luo, Wenzheng Chen, Lan Xu.
CVPR 2023. [PDF]

NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objects.
Taeksoo Kim, Shunsuke Saito, Hanbyul Joo.
arxiv 2023. [PDF] [Project]

Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models.
Byungjun Kim, Patrick Kwon, Kwangho Lee, Myunggi Lee, Sookwan Han, Daesik Kim, Hanbyul Joo.
arxiv 2023. [PDF] [Project]

SHERF: Generalizable Human NeRF from a Single Image.
Shoukang Hu, Fangzhou Hong, Liang Pan, Haiyi Mei, Lei Yang, Ziwei Liu.
arxiv 2023. [PDF] [Project] [Github]

High-Fidelity Clothed Avatar Reconstruction from a Single Image.
Tingting Liao, Xiaomei Zhang, Yuliang Xiu, Hongwei Yi, Xudong Liu, Guo-Jun Qi, Yong Zhang, Xuan Wang, Xiangyu Zhu, Zhen Lei.
arxiv 2023. [PDF]

SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling.
Zhitao Yang, Zhongang Cai, Haiyi Mei, Shuai Liu, Zhaoxi Chen, Weiye Xiao, Yukun Wei, Zhongfei Qing, Chen Wei, Bo Dai, Wayne Wu, Chen Qian, Dahua Lin, Ziwei Liu, Lei Yang.
arxiv 2023. [PDF] [Project]

GNeuVox: Generalizable Neural Voxels for Fast Human Radiance Fields.
Taoran Yi, Jiemin Fang, Xinggang Wang, Wenyu Liu.
arxiv 2023. [PDF] [Project] [Github]

3D Magic Mirror: Clothing Reconstruction from a Single Image via a Causal Perspective.
Zhedong Zheng, Jiayin Zhu, Wei Ji, Yi Yang, and Tat-Seng Chua.
arxiv 2022. [PDF] [Project] [Github)]

Structured 3D Features for Reconstructing Relightable and Animatable Avatars.
Enric Corona, Mihai Zanfir, Thiemo Alldieck, Eduard Gabriel Bazavan, Andrei Zanfir, Cristian Sminchisescu.
arxiv 2022. [PDF] [Project]

HumanDiffusion: a Coarse-to-Fine Alignment Diffusion Framework for Controllable Text-Driven Person Image Generation.
Kaiduo Zhang, Muyi Sun, Jianxin Sun, Binghao Zhao, Kunbo Zhang, Zhenan Sun, Tieniu Tan.
arXiv 2022. [PDF]

HDHumans: A Hybrid Approach for High-fidelity Digital Humans.
Marc Habermann, Lingjie Liu, Weipeng Xu, Gerard Pons-Moll, Michael Zollhoefer, Christian Theobalt.
arxiv 2022. [PDF]

PIFu for the Real World: A Self-supervised Framework to Reconstruct Dressed Human from Single-view Images.
Zhangyang Xiong, Dong Du, Yushuang Wu, Jingqi Dong, Di Kang, Linchao Bao, Xiaoguang Han.
arxiv 2022. [PDF]

AvatarGen: a 3D Generative Model for Animatable Human Avatars.
Jianfeng Zhang, Zihang Jiang, Dingdong Yang, Hongyi Xu, Yichun Shi, Guoxian Song, Zhongcong Xu, Xinchao Wang, Jiashi Feng.
arxiv 2022. [PDF] [Project] [Github]

DRaCoN: Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars.
Amit Raj, Umar Iqbal, Koki Nagano, Sameh Khamis, Pavlo Molchanov, James Hays, Jan Kautz.
arxiv 2022. [PDF] [Project]

Animatable Neural Implicit Surfaces for Creating Avatars from Videos.
Sida Peng, Shangzhan Zhang, Zhen Xu, Chen Geng, Boyi Jiang, Hujun Bao, Xiaowei Zhou.
arxiv 2022. [PDF] [Project]

NeuVV: Neural Volumetric Videos with Immersive Rendering and Editing.
Jiakai Zhang, Liao Wang, Xinhang Liu, Fuqiang Zhao, Minzhang Li, Haizhao Dai, Boyuan Zhang, Wei Yang, Lan Xu, Jingyi Yu.
arxiv 2022. [PDF]

Learning Animatable Avatar with Barycentric Mapping and Variation Mining.
Yihao Zhi, Shenhan Qian, Xinhao Yan, Shenghua Gao.
arxiv 2021. [PDF]

Animatable Neural Radiance Fields from Monocular RGB Videos.
Jianchuan Chen, Ying Zhang, Di Kang, Xuefei Zhe, Linchao Bao, Xu Jia, Huchuan Lu.
arxiv 2021. [PDF] [Github]

Geometry-aware Two-scale PIFu Representation for Human Reconstruction.
Zheng Dong, Ke Xu, Ziheng Duan, Hujun Bao, Weiwei Xu, Rynson W.H. Lau.
NeurIPS 2022. [PDF]

TotalSelfScan: Learning Full-body Avatars from Self-Portrait Videos of Faces, Hands, and Bodies.
Junting Dong, Qi Fang, Yudong Guo, Sida Peng, Qing Shuai, Hujun Bao, Xiaowei Zhou.
NeurIPS 2022. [PDF] [Data]

FOF: Learning Fourier Occupancy Field for Monocular Real-time Human Reconstruction.
Qiao Feng, Yebin Liu, Yu-Kun Lai, Jingyu Yang, Kun Li.
NeurIPS 2022. [PDF] [Project] [Github]

Dual-Space NeRF: Learning Animatable Avatars and Scene Lighting in Separate Spaces Yihao Zhi, Shenhan Qian, Xinhao Yan, Shenghua Gao 3DV 2022. [PDF] [Github]

Neural Point-based Shape Modeling of Humans in Challenging Clothing.
Qianli Ma, Jinlong Yang, Michael J. Black, Siyu Tang.
3DV 2022. [PDF]

HVTR: Hybrid Volumetric-Textural Rendering for Human Avatars.
Tao Hu, Tao Yu, Zerong Zheng, He Zhang, Yebin Liu, Matthias Zwicker.
3DV 2022. [PDF] [Project]

Human Performance Modeling and Rendering via Neural Animated Mesh.
Fuqiang Zhao, Yuheng Jiang, Kaixin Yao, Jiakai Zhang, Liao Wang, Haizhao Dai, Yuhui Zhong, Yingliang Zhang, Minye Wu, Lan Xu, Jingyi Yu.
SIGGRAPH Asia 2022. [PDF] [Project]

FloRen: Real-time High-quality Human Performance Rendering via Appearance Flow Using Sparse RGB Cameras.
Ruizhi Shao, Liliang Chen, Zerong Zheng, Hongwen Zhang, Yuxiang Zhang, Han Huang, Yandong Guo, Yebin Liu.
SIGGRAPH Asia 2022. [PDF]

Occupancy Planes for Single-view RGB-D Human Reconstruction.
Xiaoming Zhao, Yuan-Ting Hu, Zhongzheng Ren, Alexander G. Schwing.
AAAI 2023. [PDF] [Github]

HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modeling.
Zhongang Cai, Daxuan Ren, Ailing Zeng, Zhengyu Lin, Tao Yu, Wenjia Wang, Xiangyu Fan, Yang Gao, Yifan Yu, Liang Pan, Fangzhou Hong, Mingyuan Zhang, Chen Change Loy, Lei Yang, Ziwei Liu.
ECCV 2022 (Oral). [PDF] [Project]

Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representations.
Atsuhiro Noguchi, Xiao Sun, Stephen Lin, Tatsuya Harada.
ECCV 2022. [PDF] [Project] [Github]

NeuMan: Neural Human Radiance Field from a Single Video.
Wei Jiang, Kwang Moo Yi, Golnoosh Samei, Oncel Tuzel, Anurag Ranjan.
ECCV 2022. [PDF] [Github]

ARAH: Animatable Volume Rendering of Articulated Human SDFs.
Shaofei Wang, Katja Schwarz, Andreas Geiger, Siyu Tang.
ECCV 2022. [PDF] [Project] [Github]

DiffuStereo: High Quality Human Reconstruction via Diffusion-based Stereo Using Sparse Cameras.
Ruizhi Shao, Zerong Zheng, Hongwen Zhang, Jingxiang Sun, Yebin Liu.
ECCV (Oral) 2022. [PDF] [Github]

LoRD: Local 4D Implicit Representation for High-Fidelity Dynamic Human Modeling.
Boyan Jiang, Xinlin Ren, Mingsong Dou, Xiangyang Xue, Yanwei Fu, Yinda Zhang.
ECCV 2022. [PDF] [Github]

Neural Capture of Animatable 3D Human from Monocular Video.
Gusi Te, Xiu Li, Xiao Li, Jinglu Wang, Wei Hu, Yan Lu.
ECCV 2022. [PDF]

The One Where They Reconstructed 3D Humans and Environments in TV Shows.
Georgios Pavlakos, Ethan Weber, Matthew Tancik, Angjoo Kanazawa.
ECCV 2022. [PDF] [Project]

UNIF: United Neural Implicit Functions for Clothed Human Reconstruction and Animation.
Shenhan Qian, Jiale Xu, Ziwei Liu, Liqian Ma, Shenghua Gao.
ECCV 2022. [PDF]

3D Clothed Human Reconstruction in the Wild.
Gyeongsik Moon, Hyeongjin Nam, Takaaki Shiratori, Kyoung Mu Lee.
ECCV 2022. [PDF] [Project]

NDF: Neural Deformable Fields for Dynamic Human Modelling.
Ruiqi Zhang, Jie Chen.
ECCV 2022. [PDF]

Animatable Volume Rendering of Articulated Human SDFs.
Shaofei Wang, Katja Schwarz, Andreas Geiger, Siyu Tang.
ECCV 2022. [PDF] [Project] [Project]

Learning Implicit Templates for Point-Based Clothed Human Modeling.
Siyou Lin, Hongwen Zhang, Zerong Zheng, Ruizhi Shao, Yebin Liu.
ECCV 2022. [PDF] [Project] [Project]

DANBO: Disentangled Articulated Neural Body Representations via Graph Neural Networks.
Shih-Yang Su, Timur Bagautdinov, and Helge Rhodin.
ECCV 2022. [PDF] [Project] [Github]

Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering.
Mingfei Chen, Jianfeng Zhang, Xiangyu Xu, Lijuan Liu, Jiashi Feng, Shuicheng Yan.
ECCV 2022. [PDF]

AvatarCap: Animatable Avatar Conditioned Monocular Human Volumetric Capture.
Zhe Li, Zerong Zheng, Hongwen Zhang, Chaonan Ji, Yebin Liu.
ECCV 2022. [PDF] [Project]

Authentic Volumetric Avatars From a Phone Scan.
Chen Cao, Tomas Simon, Jin Kyu Kim, Gabe Schwartz, Michael Zollhoefer, Shunsuke Saito, Stephen Lombardi, Shih-en Wei, Danielle Belko, Shoou-i Yu, Yaser Sheikh, Jason Saragih.
SIGGRAPH 2022. [PDF] [Project]

HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputs.
Fuqiang Zhao, Wei Yang, Jiakai Zhang, Pei Lin, Yingliang Zhang, Jingyi Yu, Lan Xu.
CVPR 2022. [PDF] [Project]

Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothing.
Thiemo Alldieck, Mihai Zanfir, Cristian Sminchisescu.
CVPR 2022. [PDF] [Project]

HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video.
Chung-Yi Weng, Brian Curless, Pratul Srinivasan,Jonathan T. Barron, Ira Kemelmacher-Shlizerman.
CVPR 2022. [PDF] [Project]

H4D: Human 4D Modeling by Learning Neural Compositional Representation.
Boyan Jiang, Yinda Zhang, Xingkui Wei, Xiangyang Xue, Yanwei Fu.
CVPR 2022. [PDF]

OcclusionFusion: Occlusion-aware Motion Estimation for Real-time Dynamic 3D Reconstruction.
Wenbin Lin, Chengwei Zheng, Jun-Hai Yong, Feng Xu.
CVPR 2022. [PDF] [Project]

PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequence.
Zijian Dong, Chen Guo, Jie Song, Xu Chen, Andreas Geiger, Otmar Hilliges.
CVPR 2022. [PDF] [Project]

SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Video.
Boyi Jiang, Yang Hong, Hujun Bao, Juyong Zhang.
CVPR 2022. [PDF] [Project]

Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-time.
Liao Wang, Jiakai Zhang, Xinhang Liu, Fuqiang Zhao, Yanshun Zhang, Yingliang Zhang, Minye Wu, Lan Xu, Jingyi Yu.
CVPR 2022. [PDF]

NeuralHOFusion: Neural Volumetric Rendering under Human-object Interactions.
Yuheng Jiang, Suyi Jiang, Guoxing Sun, Zhuo Su, Kaiwen Guo, Minye Wu, Jingyi Yu, Lan Xu.
CVPR 2022. [PDF] [Project]

JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstruction.
Yukang Cao, Guanying Chen, Kai Han, Wenqi Yang, Kwan-Yee K. Wong.
CVPR 2022 (oral). [PDF] [Project]

High-Fidelity Human Avatars from a Single RGB Camera.
Hao Zhao, Jinsong Zhang, Yu-Kun Lai, Zerong Zheng, Yingdi Xie, Yebin Liu, Kun Li.
CVPR 2022. [PDF] [Project] [Project] [Data]

ICON: Implicit Clothed humans Obtained from Normals.
Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, Michael J. Black.
CVPR 2022. [PDF] [Github]

DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Rendering.
Ruizhi Shao, Hongwen Zhang, He Zhang, Yanpei Cao, Tao Yu, Yebin Liu.
CVPR 2022. [PDF] [Project]

Structured Local Radiance Fields for Human Avatar Modeling.
Zerong Zheng, Han Huang, Tao Yu, Hongwen Zhang, Yandong Guo, Yebin Liu.
CVPR 2022. [PDF] [Project] [Github]

DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and Rendering.
Ruizhi Shao, Hongwen Zhang, He Zhang, Mingjia Chen, Yanpei Cao, Tao Yu, Yebin Liu.
CVPR 2022. [PDF] [Project]

I M Avatar: Implicit Morphable Head Avatars from Videos.
Yufeng Zheng, Victoria Fernández Abrevaya, Xu Chen, Marcel C. Bühler, Michael J. Black, Otmar Hilliges.
CVPR 2022. [PDF]

Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesis.
Tianhan Xu, Yasuhiro Fujita, Eiichi Matsumoto.
CVPR 2022. [PDF]

Neural Head Avatars from Monocular RGB Videos.
Philip-William Grassal, Malte Prinzler, Titus Leistner, Carsten Rother, Matthias Nießner, Justus Thies.
CVPR 2022. [PDF] [Project]

gDNA: Towards Generative Detailed Neural Avatars.
Xu Chen, Tianjian Jiang, Jie Song, Jinlong Yang, Michael J. Black, Andreas Geiger, Otmar Hilliges.
CVPR 2022. [PDF] [Project] [Github]

HumanNeRF: Generalizable Neural Human Radiance Field from Sparse Inputs.
Fuqiang Zhao, Wei Yang, Jiakai Zhang, Pei Lin, Yingliang Zhang, Jingyi Yu, Lan Xu.
CVPR 2022. [PDF] [Project]

PERGAMO: Personalized 3D Garments from Monocular Video.
Andrés Casado-Elvira, Marc Comino Trinidad, Dan Casas.
CFG 2022. [PDF] [Project]

Explicit Clothing Modeling for an Animatable Full-Body Avatar.
Donglai Xiang, Fabian Andres Prada, Timur Bagautdinov, Weipeng Xu, Yuan Dong, He Wen, Jessica Hodgins, Chenglei Wu.
SIGGRAPH Asia 2021. [PDF]

SHARP: Shape-Aware Reconstruction of People In Loose Clothing.
Sai Sagar Jinka, Rohan Chacko, Astitva Srivastava, Avinash Sharma, P.J. Narayanan.
IJCV 2023. [PDF]

Driving-Signal Aware Full-Body Avatars.
Timur Bagautdinov, Chenglei Wu, Tomas Simon, Fabian Prada, Takaaki Shiratori, Shih-En Wei, Weipeng Xu, Yaser Sheikh, Jason Saragih.
TOG 2021. [PDF]

Learning Implicit 3D Representations of Dressed Humans from Sparse Views.
Pierre Zins, Yuanlu Xu, Edmond Boyer, Stefanie Wuhrer, Tony Tung.
3DV 2021. [PDF]

PIXIE: Collaborative Regression of Expressive Bodies using Moderation.
Yao Feng, Vasileios Choutas, Timo Bolkart, Dimitrios Tzionas, Michael J. Black.
3DV 2021. [PDF] [Project]

A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Pose.
Shih-Yang Su, Frank Yu, Michael Zollhoefer, Helge Rhodin.
NeurIPS 2021. [PDF] [Project]

Class-agnostic Reconstruction of Dynamic Objects from Videos.
Zhongzheng Ren, Xiaoming Zhao, Alexander G. Schwing.
NeurIPS 2021. [PDF] [Project]

Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Rendering.
Youngjoong Kwon, Dahun Kim, Duygu Ceylan, Henry Fuchs.
NeurIPS 2021. [PDF]

MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images.
Shaofei Wang, Marko Mihajlovic, Qianli Ma, Andreas Geiger, Siyu Tang.
NeurIPS 2021. [PDF] [Project] [Github]

Garment4D: Garment Reconstruction from Point Cloud Sequences.
Fangzhou Hong, Liang Pan, Zhongang Cai, Ziwei Liu.
NeurIPS 2021. [PDF] [Project] [Github]

Learning Anchored Unsigned Distance Functions with Gradient Direction Alignment for Single-view Garment Reconstruction.
Fang Zhao, Wenhao Wang, Shengcai Liao, Ling Shao.
ICCV 2021. [PDF] [Github]

Dynamic Surface Function Networks for Clothed Human Bodies.
Andrei Burov, Matthias Nießner, Justus Thies.
ICCV 2021. [PDF] [Video] [Github]

THUNDR: Transformer-based 3D HUmaN Reconstruction with Markers.
Mihai Zanfir, Andrei Zanfir, Eduard Gabriel Bazavan, William T. Freeman, Rahul Sukthankar, Cristian Sminchisescu.
ICCV 2021. [PDF]

Neural Articulated Radiance Field.
Atsuhiro Noguchi, Xiao Sun, Stephen Lin, Tatsuya Harada.
ICCV 2021. [PDF]

3D Human Texture Estimation From a Single Image With Transformers.
Xiangyu Xu, Chen Change Loy.
ICCV 2021. [PDF]

ARCH++: Animation-Ready Clothed Human Reconstruction Revisited.
Tong He, Yuanlu Xu, Shunsuke Saito, Stefano Soatto, Tony Tung.
ICCV 2021. [PDF]

DeePSD: Automatic Deep Skinning and Pose Space Deformation for 3D Garment Animation.
Hugo Bertiche, Meysam Madadi, Emilio Tylson, Sergio Escalera.
ICCV 2021. [PDF]

EgoRenderer: Rendering Human Avatars From Egocentric Camera Images.
Tao Hu, Kripasindhu Sarkar, Lingjie Liu, Matthias Zwicker, Christian Theobalt.
ICCV 2021. [PDF]

SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes.
Xu Chen, Yufeng Zheng, Michael J. Black, Otmar Hilliges, Andreas Geiger.
ICCV 2021. [PDF] [[Project](https://xuchen-ethz.github.io/snarf/] [Github]

Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothing.
Garvita Tiwari, Nikolaos Sarafianos, Tony Tung, Gerard Pons-Moll.
ICCV 2021. [PDF] [Project]

The Power of Points for Modeling Humans in Clothing.
Qianli Ma, Jinlong Yang, Siyu Tang, Michael J. Black.
ICCV 2021. [PDF] [Project] [Github]

Learning to Regress Bodies from Images using Differentiable Semantic Rendering.
Sai Kumar Dwivedi, Nikos Athanasiou, Muhammed Kocabas, Michael J. Black.
ICCV 2021. [PDF] [Project]

imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Pose.
Thiemo Alldieck, Hongyi Xu, Cristian Sminchisescu.
ICCV 2021. [PDF]

DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Cameras.
Yang Zheng, Ruizhi Shao, Yuxiang Zhang, Zerong Zheng, Tao Yu, Yebin Liu.
ICCV 2021. [PDF] [Project]

M3D-VTON: A Monocular-to-3D Virtual Try-On Network.
Fuwei Zhao, Zhenyu Xie, Michael Kampffmeyer, Haoye Dong, Songfang Han, Tianxiang Zheng, Tao Zhang, Xiaodan Liang.
ICCV 2021. [PDF]

Animatable Neural Radiance Fields for Human Body Modeling.
Sida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang, Qing Shuai, Hujun Bao, Xiaowei Zhou.
ICCV 2021. [PDF] [Project] [Github]

High-Fidelity 3D Digital Human Head Creation from RGB-D Selfies.
Xiangkai Lin, Yajing Chen, Linchao Bao, Haoxian Zhang, Sheng Wang, Xuefei Zhe, Xinwei Jiang, Jue Wang, Dong Yu, Zhengyou Zhang.
TOG 2021. [PDF] [Github] [Project]

Real-time Deep Dynamic Characters.
Marc Habermann, Lingjie Liu, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt.
TOG 2021. [PDF] [Project]

Learning Skeletal Articulations with Neural Blend Shapes.
Peizhuo Li, Kfir Aberman, Rana Hanocka, Libin Liu, Olga Sorkine-Hornung, Baoquan Chen.
TOG 2021. [PDF] [Video] [Project]

Detailed Avatar Recovery from Single Image.
Hao Zhu, Xinxin Zuo, Haotian Yang, Sen Wang, Xun Cao, Ruigang Yang.
TPAMI 2021. [PDF]

RSC-Net: 3D Human Pose, Shape and Texture from Low-Resolution Images and Videos.
Xiangyu Xu, Hao Chen, Francesc Moreno-Noguer, Laszlo A. Jeni, Fernando De la Torre.
TPAMI 2021. [PDF] [Github] [Project]

A Deeper Look into DeepCap.
Marc Habermann, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt.
TPAMI 2021. [PDF] [Github] [Data]

Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensors.
Tao Yu, Zerong Zheng, Kaiwen Guo, Pengpeng Liu, Qionghai Dai, Yebin Liu.
CVPR 2021 (oral). [PDF] [Project] [THuman2.0 Dataset]

POSEFusion: Pose-guided Selective Fusion for Single-view Human Volumetric Capture.
Zhe Li, Tao Yu, Zerong Zheng, Kaiwen Guo, Yebin Liu.
CVPR 2021. [PDF] [Project]

SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networks.
Shunsuke Saito, Jinlong Yang, Qianli Ma, Michael J. Black.
CVPR 2021. [PDF] [Github]

Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinement.
Huiwen Luo, Koki Nagano, Han-Wei Kung, Qingguo Xu, Zejian Wang, Lingyu Wei, Liwen Hu, Hao Li.
CVPR 2021. [PDF]

DeepSurfels: Learning Online Appearance Fusion.
Marko Mihajlovic, Silvan Weder, Marc Pollefeys, Martin R. Oswald.
CVPR 2021. [PDF] [Project] [Github]

Semi-Supervised Synthesis of High-Resolution Editable Textures for 3D Humans.
Bindita Chaudhuri, Nikolaos Sarafianos, Linda Shapiro, Tony Tung.
CVPR 2021. [PDF]

StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision.
Yang Hong, Juyong Zhang, Boyi Jiang, Yudong Guo, Ligang Liu, Hujun Bao.
CVPR 2021. [PDF] [Project] [Github]

LASR: Learning Articulated Shape Reconstruction from a Monocular Video.
Gengshan Yang, Deqing Sun, Varun Jampani, Daniel Vlasic, Forrester Cole, Huiwen Chang, Deva Ramanan, William T. Freeman, Ce Liu.
CVPR 2021. [PDF] [Project]

Multi-person Implicit Reconstruction from a Single Image.
Armin Mustafa, Akin Caliskan, Lourdes Agapito, Adrian Hilton.
CVPR 2021. [PDF]

StylePeople: A Generative Model of Fullbody Human Avatars.
Artur Grigorev, Karim Iskakov, Anastasia Ianina, Renat Bashirov, Ilya Zakharkin, Alexander Vakhitov, Victor Lempitsky.
CVPR 2021. [PDF]

SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elements.
Qianli Ma, Shunsuke Saito, Jinlong Yang, Siyu Tang, Michael J. Black.
CVPR 2021. [PDF] [Project]

Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humans.
Bindita Chaudhuri, Nikolaos Sarafianos, Linda Shapiro, Tony Tung.
CVPR 2021. [PDF]

Monocular Real-time Full Body Capture with Inter-part Correlations.
Yuxiao Zhou, Marc Habermann, Ikhsanul Habibie, Ayush Tewari, Christian Theobalt, Feng Xu.
CVPR 2021. [PDF]

SMPLicit: Topology-aware Generative Model for Clothed People.
Enric Corona, Albert Pumarola, Guillem Alenyà, Gerard Pons-Moll, Francesc Moreno-Noguer.
CVPR 2021. [PDF] [Project]

A Deep Emulator for Secondary Motion of 3D Characters.
Mianlun Zheng, Yi Zhou, Duygu Ceylan, Jernej Barbic.
CVPR 2021. [PDF]

PVA: Pixel-aligned Volumetric Avatars.
Amit Raj, Michael Zollhoefer, Tomas Simon, Jason Saragih, Shunsuke Saito, James Hays, Stephen Lombardi.
CVPR 2021. [PDF] [Project]

ANR: Articulated Neural Rendering for Virtual Avatars.
Amit Raj, Julian Tanke, James Hays, Minh Vo, Carsten Stoll, Christoph Lassner.
CVPR 2021. [PDF] [Project]

SMPLpix: Neural Avatars from 3D Human Models.
Sergey Prokudin, Michael J. Black, Javier Romero.
WACV 2021. [PDF] [Github]

Synthetic Training for Monocular Human Mesh Recovery.
Yu Sun, Qian Bao, Wu Liu, Wenpeng Gao, Yili Fu, Chuang Gan, Tao Mei.
BMVC 2020. [PDF]

Realistic Virtual Humans from Smartphone Videos.
Stephan Wenninger, Jascha Achenbach, Andrea Bartl, Marc Erich Latoschik, Mario Botsch.
ACM VRST 2020 (Best Paper Award). [PDF] [Video] [Talk]

LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registration.
Bharat Lal Bhatnagar, Cristian Sminchisescu, Christian Theobalt, Gerard Pons-Moll.
NeurIPS 2020. [PDF] [Github]

3D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image Data.
Benjamin Biggs, Sébastien Ehrhadt, Hanbyul Joo, Benjamin Graham, Andrea Vedaldi, David Novotny.
NeurIPS 2020. [PDF]

HPBTT: Human Parsing Based Texture Transfer from Single Image to 3D Human via Cross-View Consistency.
Fang Zhao, Shengcai Liao, Kaihao Zhang, Ling Shao.
NeurIPS 2020. [PDF] [Github]

Neural3D: Light-weight Neural Portrait Scanning via Context-aware Correspondence Learning.
Xin Suo, Minye Wu, Yanshun Zhang, Yanshun Zhang, Yingliang Zhang, Yingliang Zhang, Lan Xu, Qiang Hu, Jingyi Yu.
ACM MM 2020. [PDF]

3DBooSTeR: 3D Body Shape and Texture Recovery.
Alexandre Saint, Anis Kacem, Kseniya Cherenkova, Djamila Aouada.
ECCV 2020 Workshop. [PDF]

BCNet: Learning Body and Cloth Shape from A Single Image.
Boyi Jiang, Juyong Zhang, Yang Hong, Jinhao Luo, Ligang Liu, Hujun Bao.
ECCV 2020. [PDF]

MonoPort: Monocular Real-Time Volumetric Performance Capture.
Ruilong Li, Yuliang Xiu, Shunsuke Saito, Zeng Huang, Kyle Olszewski, Hao Li.
ECCV 2020. [PDF] [Github]

3D Human Shape and Pose from a Single Low-Resolution Image with Self-Supervised Learning.
Xiangyu Xu, Hao Chen, Francesc Moreno-Noguer, Laszlo A. Jeni, Fernando De la Torre.
ECCV 2020. [PDF] [Project]

BLSM: A Bone-Level Skinned Model of the Human Mesh.
Haoyang Wang, Riza Alp Güler, Iasonas Kokkinos, George Papandreou, Stefanos Zafeiriou.
ECCV 2020. [pdf] [Supplement]

STAR: Sparse Trained Articulated Human Body Regressor.
Ahmed A. A. Osman, Timo Bolkart, Michael J. Black.
ECCV 2020. [PDF] [Project]

I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image.
Gyeongsik Moon, Kyoung Mu Lee.
ECCV 2020. [PDF] [Github]

Appearance Consensus Driven Self-Supervised Human Mesh Recovery.
Jogendra Nath Kundu, Mugalodi Rakesh, Varun Jampani, Rahul Mysore Venkatesh, R. Venkatesh Babu.
ECCV 2020. [PDF]

TexMesh: Reconstructing Detailed Human Texture and Geometry from RGB-D Video.
Tiancheng Zhi, Christoph Lassner, Tony Tung, Carsten Stoll, Srinivasa G. Narasimhan, Minh Vo.
ECCV 2020. [PDF]

NormalGAN: Learning Detailed 3D Human from a Single RGB-D Image.
Lizhen Wang, Xiaochen Zhao, Tao Yu, Songtao Wang, Yebin Liu.
ECCV 2020. [PDF] [Project]

Reconstructing NBA Players.
Luyang Zhu, Konstantinos Rematas, Brian Curless, Steve Seitz, Ira Kemelmacher-Shlizerman.
ECCV 2020. [PDF] [Github] [Project]

RobustFusion: Human Volumetric Capture with Data-driven Visual Cues using a RGBD Camera.
Zhuo Su, Xu Lan, Zerong Zheng, Tao Yu, Yebin Liu, Lu Fang.
ECCV 2020. [PDF]

IPNet: Combining Implicit Function Learning and Parametric Models for 3D Human Reconstruction.
Bharat Lal Bhatnagar, Cristian Sminchisescu, Christian Theobalt, Gerard Pons-Moll.
ECCV 2020. [PDF] [Project] [Github]

Neural Articulated Shape Approximation.
Boyang Deng, JP Lewis, Timothy Jeruzalski, Gerard Pons-Moll, Geoffrey Hinton, Mohammad Norouzi, Andrea Tagliasacchi.
ECCV 2020. [PDF]

SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothing.
Garvita Tiwari, Bharat Lal Bhatnagar, Tony Tung, Gerard Pons-Moll.
ECCV 2020. [PDF] [Data] [Github] [Project]

TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style.
Chaitanya Patel, Zhouyingcheng Liao, Gerard Pons-Moll.
CVPR 2020. [PDF] [Github] [Project] [Data]

Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstruction.
Tong He, John Collomosse, Hailin Jin, Stefano Soatto.
NeurIPS 2020. [PDF] [Github]

Self-Supervised Human Depth Estimation from Monocular Videos.
Feitong Tan, Hao Zhu, Zhaopeng Cui, Siyu Zhu, Marc Pollefeys, Ping Tan.
CVPR 2020. [PDF]

TetraTSDF: 3D human reconstruction from a single image with a tetrahedral outer shell.
Hayato Onizuka, Zehra Hayirci, Diego Thomas, Akihiro Sugimoto, Hideaki Uchiyama, Rin-ichiro Taniguchi.
arxiv 2020. [PDF]

ARCH: Animatable Reconstruction of Clothed Humans.
Zeng Huang, Yuanlu Xu, Christoph Lassner, Hao Li, Tony Tung.
CVPR 2020. [PDF]

pix2surf: Learning to Transfer Texture from Clothing Images to 3D Humans.
Aymen Mir, Thiemo Alldieck, Gerard Pons-Moll.
CVPR 2020. [PDF] [Github]

PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization.
Shunsuke Saito, Tomas Simon, Jason Saragih, Hanbyul Joo.
CVPR 2020. [PDF] [Project] [Github]

DeepCap: Monocular Human Performance Capture Using Weak Supervision.
Marc Habermann, Weipeng Xu, Michael Zollhoefer, erard Pons-Moll, Christian Theobalt.
CVPR 2020. [PDF] [Project]

EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Camera.
Lan XU, Weipeng Xu, Vladislav Golyanik, Marc Habermann, Lu Fang, Christian Theobalt.
CVPR 2020. [PDF] [Project]

PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstruction.
Zerong Zheng, Tao Yu, Yebin Liu, Qionghai Dai.
TPAMI 2020. [PDF] [Project]

MulayCap: Multi-layer Human Performance Capture Using A Monocular Video Camera.
Zhaoqi Su, Weilin Wan, Tao Yu, Lingjie Liu, Lu Fang, Wenping Wang and Yebin Liu.
TVCG 2020. [PDF] [Project]

Disentangled Human Body Embedding Based on Deep Hierarchical Neural Network.
Boyi Jiang, Juyong Zhang, Jianfei Cai, Jianmin Zheng.
TVCG 2020. [PDF]

SparseFusion: Dynamic Human Avatar Modeling from Sparse RGBD Images.
Xinxin Zuo, Sen Wang, Jiangbin Zheng, Weiwei Yu, Minglun Gong, Ruigang Yang, Li Cheng.
TMM 2020. [PDF]

UnstructuredFusion: Real-time 4D Geometry and Texture Reconstruction using Commercial RGBD Cameras.
Lan Xu, Zhuo Su, Lei Han, Tao Yu, Yebin Liu, Lu Fang.
TPAMI 2019. [PDF]

PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization.
Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima, Angjoo Kanazawa, Hao Li.
ICCV 2019. [PDF] [Project] [Github]

Multi-Garment Net_Learning to Dress 3D people from Images.
Bharat Lal Bhatnagar, Garvita Tiwari, Christian Theobalt, Gerard Pons-Moll.
ICCV 2019. [Github] [PDF]

Learning to Reconstruct People in Clothing from a Single RGB Camera.
Thiemo Alldieck, Marcus Magnor, Bharat Lal Bhatnagar, Christian Theobalt, Gerard Pons-Moll.
ICCV 2019. [PDF] [Github]

A Neural Network for Detailed Human Depth Estimation From a Single Image.
Sicong Tang, Feitong Tan, Kelvin Cheng, Zhaoyang Li, Siyu Zhu, Ping Tan.
ICCV 2019. [PDF]

TexturePose: Supervising Human Mesh Estimation with Texture Consistency.
Georgios Pavlakos, Nikos Kolotouros, Kostas Daniilidis.
ICCV 2019. [PDF] [Project] [Github]

3DPeople: Modeling the Geometry of Dressed Humans.
Albert Pumarola, Jordi Sanchez, Gary P. T. Choi, Alberto Sanfeliu, Francesc Moreno-Noguer.
ICCV 2019. [PDF] [3DPeople-Dataset]

DeepHuman: 3D Human Reconstruction from a Single Image.
Zerong Zheng, Tao Yu, Yixuan Wei, Qionghai Dai, Yebin Liu.
ICCV 2019. [PDF] [Project]

Tex2Shape: Detailed Full Human Body Geometry From a Single Image.
Thiemo Alldieck, Gerard Pons-Moll, Christian Theobalt, Marcus Magnor.
CVPR 2019. [PDF] [Github]

SimulCap : Single-View Human Performance Capture with Cloth Simulation.
Tao Yu, Zerong Zheng, Yuan Zhong, Jianhui Zhao, Qionghai Dai, Gerard Pons-moll, Yebin Liu.
CVPR 2019. [PDF] [Project]

SiCloPe: Silhouette-Based Clothed People.
Ryota Natsume, Shunsuke Saito, Zeng Huang, Weikai Chen, Chongyang Ma, Hao Li, Shigeo Morishima.
CVPR 2019. [PDF]

Textured Neural Avatars.
Aliaksandra Shysheya, Egor Zakharov, Kara-Ali Aliev, Renat Bashirov, Egor Burkov, Karim Iskakov, Aleksei Ivakhnenko, Yury Malkov, Igor Pasechnik, Dmitry Ulyanov, Alexander Vakhitov, Victor Lempitsky.
CVPR 2019 (oral). [PDF] [Project]

MonoClothCap: Towards Temporally Coherent Clothing Capture from Monocular RGB Video.
Donglai Xiang, Fabian Prada, Chenglei Wu, Jessica Hodgins.
3DV 2020 (Best Paper Honorable Mention, Oral). [PDF]

360-Degree Textures of People in Clothing from a Single Image.
Verica Lazova, Eldar Insafutdinov, Gerard Pons-Moll.
3DV 2019. [PDF] [Project]

Detailed Human Avatars from Monocular Video.
Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, Gerard Pons-Moll.
3DV 2018. [PDF] [Github]

BodyFusion: Real-time Capture of Human Motion and Surface Geometry Using a Single Depth Camera.
Tao Yu, Kaiwen Guo, Feng Xu, Yuan Dong, Zhaoqi Su, Jianhui Zhao, Jianguo Li, Qionghai Dai, Yebin Liu.
ICCV 2017. [PDF] [Project]

3D People Dressing, Cloth Draping and Simulation

REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videos.
Lingteng Qiu, Guanying Chen, Jiapeng Zhou, Mutian Xu, Junle Wang, Xiaoguang Han.
CVPR 2023. [PDF] [Project] [Github]

HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics.
Artur Grigorev, Bernhard Thomaszewski, Michael J. Black, Otmar Hilliges.
CVPR 2023. [PDF] [Project] [Github]

Motion Guided Deep Dynamic 3D Garments.
Meng Zhang, Duygu Ceylan, Niloy J. Mitra.
SIGGRAPH Asia 2022. [PDF] [Project]

DIG: Draping Implicit Garment over the Human Body.
Ren Li, Benoît Guillard, Edoardo Remelli, Pascal Fua.
ACCV 2022. [PDF]

Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networks.
Xiaoyu Pan, Jiaming Mai, Xinwei Jiang, Dongxue Tang, Jingxiang Li, Tianjia Shao, Kun Zhou, Xiaogang Jin, Dinesh Manocha.
SIGGRAPH 2022. [PDF] [Github]

DiffCloth: Differentiable Cloth Simulation with Dry Frictional Contact.
Yifei Li, Tao Du, Kui Wu, Jie Xu, Wojciech Matusik.
TOG 2022. [PDF] [Project] [Github]

SNUG: Self-Supervised Neural Dynamic Garments.
Igor Santesteban, Miguel A. Otaduy, Dan Casas.
CVPR 2022 (Oral). [PDF] [Project] [Github]

Registering Explicit to Implicit: Towards High-Fidelity Garment mesh Reconstruction from Single Images.
Heming Zhu, Lingteng Qiu, Yuda Qiu, Xiaoguang Han.
CVPR 2022. [PDF] [Project]

Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On.
Igor Santesteban, Nils Thuerey, Miguel A. Otaduy, Dan Casas.
CVPR 2021. [PDF]

Dynamic Neural Garments.
Meng Zhang, Duygu Ceylan, Tuanfeng Wang, Niloy J. Mitra.
TOG 2021. [PDF] [Project] [Github]

Deep Detail Enhancement for Any Garment.
Meng Zhang, Tuanfeng Wang, Duygu Ceylan, Niloy J. Mitra.
Eurographics 2021. [PDF]

Multi-View Consistency Loss for Improved Single-Image 3D Reconstruction of Clothed People.
Akin Caliskan, Adrian Hilton.
ACCV 2020. [PDF] [Github]

SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothing.
Garvita Tiwari, Bharat Lal Bhatnagar, Tony Tung, Gerard Pons-Moll.
ECCV 2020. [PDF]

GAN-based Garment Generation Using Sewing Pattern Images.
Yu Shen, Junbang Liang, Ming C. Lin.
ECCV 2020. [PDF] [Project] [Github]

GarNet++: Improving Fast and Accurate Static3D Cloth Draping by Curvature Loss.
Erhan Gundogdu, Victor Constantin, Shaifali Parashar, Amrollah Seifoddini, Minh Dang, Mathieu Salzmann, Pascal Fua.
TPAMI 2020. [PDF]

Homogenized Yarn-Level Cloth.
Georg Sperl, Rahul Narain, Chris Wojtan.
SIGGRAPH (TOG) 2020. [PDF] [Project] [Data & Code]

CLOTH3D: Clothed 3D Humans.
Hugo Bertiche, Meysam Madadi, Sergio Escalera.
ECCV 2020. [PDF]

CAPE: Learning to Dress 3D People in Generative Clothing.
Qianli Ma, Jinlong Yang, Anurag Ranjan, Sergi Pujades, Gerard Pons-Moll, Siyu Tang, Michael J. Black.
CVPR 2020. [PDF] [Project]

DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Data.
Aljaž Božič, Michael Zollhöfer, Christian Theobalt, Matthias Nießner.
CVPR 2020. [PDF] [Project] [Github] [DeepDeform Benchmark]

Implicit Functions in Feature Space for 3D Shape Reconstruction and Completion.
Julian Chibane, Thiemo Alldieck, Gerard Pons-Moll.
CVPR 2020. [PDF]

Learning to Dress 3D People in Generative Clothing.
Qianli Ma, Jinlong Yang, Anurag Ranjan, Sergi Pujades, Gerard Pons-Moll, Siyu Tang, Michael J. Black.
CVPR 2020. [PDF]

DeepCap: Monocular Human Performance Capture Using Weak Supervision.
Marc Habermann, Weipeng Xu, Michael and Zollhoefer, Gerard Pons-Moll, Christian Theobalt.
CVPR 2020. [PDF]

The Virtual Tailor: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style.
Chaitanya Patel, Zhouyingcheng Liao, Gerard Pons-Moll.
CVPR 2020. [PDF]

Learning to Transfer Texture from Clothing Images to 3D Humans.
Aymen Mir, Thiemo Alldieck, Gerard Pons-Moll.
CVPR 2020. [PDF] [Github]

GarNet: A Two-Stream Network for Fast and Accurate 3D Cloth Draping.
Erhan Gundogdu, Victor Constantin, Amrollah Seifoddini, Minh Dang, Mathieu Salzmann, Pascal Fua.
ICCV 2019. [PDF] [Supplementary Material] [Project] [Dataset]

Multi-Garment Net: Learning to Dress 3D People from Images.
Bharat Lal Bhatnagar, Garvita Tiwari, Christian Theobalt, Gerard Pons-Moll(REAL VIRTUAL HUMANS, MPII).
ICCV 2019. [PDF]

DRAPE: DRessing Any PErson.
Peng Guan, Loretta Reiss, David A. Hirshberg, Alexander Weiss, Michael J. Black.
ACM Transactions on Graphics (TOG) 2012. [PDF] [Project]

ISP: Multi-Layered Garment Draping with Implicit Sewing Patterns.
Ren Li, Benoît Guillard, Pascal Fua.
arXiv 2023. [PDF]

Towards Multi-Layered 3D Garments Animation.
Yidi Shao, Chen Change Loy, Bo Dai.
arxiv 2023. [PDF] [Project]

Garment Avatars: Realistic Cloth Driving using Pattern Registration.
Oshri Halimi, Fabian Prada, Tuur Stuyck, Donglai Xiang, Timur Bagautdinov, He Wen, Ron Kimmel, Takaaki Shiratori, Chenglei Wu, Yaser Sheikh.
arxiv 2022. [PDF]

Point-Based Modeling of Human Clothing.
Ilya Zakharkin, Kirill Mazur, Artur Grigoriev, Victor Lempitsky.
arxiv 2021. [PDF]

Deep Deformation Detail Synthesis for Thin Shell Models.
Lan Chen, Lin Gao, Jie Yang, Shibiao Xu, Juntao Ye, Xiaopeng Zhang, Yu-Kun Lai.
arxiv 2021. [PDF]

Neural 3D Clothes Retargeting from a Single Image.
Jae Shin Yoon, Kihwan Kim, Jan Kautz, Hyun Soo Park.
arxiv 2020. [PDF]

Physically Based Neural Simulator for Garment Animation.
Hugo Bertiche, Meysam Madadi, Sergio Escalera.
arxiv 2020. [PDF]

Deep Physics-aware Inference of Cloth Deformation for Monocular Human Performance Capture.
Yue Li, Marc Habermann, Bernhard Thomaszewski, Stelian Coros, Thabo Beeler, Christian Theobalt.
arxiv 2020. [PDF]

Neural Non-Rigid Tracking.
Aljaž Božič, Pablo Palafox, Michael Zollhöfer, Angela Dai, Justus Thies, Matthias Nießner.
arxiv 2020. [PDF]

Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images.
Heming Zhu, Yu Cao, Hang Jin, Weikai Chen, Dong Du, Zhangye Wang, Shuguang Cui, Xiaoguang Han.
arxiv 2020. [PDF] [Project]

Human Image and Video Generation

Cross Attention Based Style Distribution for Controllable Person Image Synthesis.
Xinyue Zhou, Mingyu Yin, Xinyuan Chen, Li Sun, Changxin Gao, Qingli Li.
ECCV 2022. [PDF]

StyleGAN-Human: A Data-Centric Odyssey of Human Generation.
Jianglin Fu, Shikai Li, Yuming Jiang, Kwan-Yee Lin, Chen Qian, Chen Change Loy, Wayne Wu, Ziwei Liu.
ECCV 2022. [PDF] [Github] [Project] [Colab Demo] [Hugging Face Demo]

Text2Human: Text-Driven Controllable Human Image Generation.
Yuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu, Chen Change Loy, Ziwei Liu.
SIGGRAPH 2022. [PDF] [Github] [Project]

Self-Supervised Correlation Mining Network for Person Image Generation.
Zijian Wang, Xingqun Qi, Kun Yuan, Muyi Sun.
CVPR 2022. [PDF]

BodyGAN: General-Purpose Controllable Neural Human Body Generation.
Chaojie Yang, Hanhui Li, Shengjie Wu, Shengkai Zhang, Haonan Yan, Nianhong Jiao, Jie Tang, Runnan Zhou, Xiaodan Liang, Tianxiang Zheng.
CVPR 2022. [PDF]

InsetGAN for Full-Body Image Generation.
Anna Frühstück, Krishna Kumar Singh, Eli Shechtman, Niloy J. Mitra, Peter Wonka, Jingwan Lu.
CVPR 2022. [PDF] [Project]

Neural Texture Extraction and Distribution for Controllable Person Image Synthesis.
Yurui Ren, Xiaoqing Fan, Ge Li, Shan Liu, Thomas H. Li.
CVPR 2022 (oral). [PDF] [Github]

Exploring Dual-task Correlation for Pose Guided Person Image Generation.
Pengze Zhang, Lingxiao Yang, Jianhuang Lai, Xiaohua Xie.
CVPR 2022. [PDF]

Structure-Transformed Texture-Enhanced Network for Person Image Synthesis.
Munan Xu, Yuanqi Chen, Shan Liu, Thomas H. Li, Ge Li.
ICCV 2021. [PDF]

PISE: Person Image Synthesis and Editing with Decoupled GAN.
Jinsong Zhang, Kun Li, Yu-Kun Lai, Jingyu Yang.
CVPR 2021. [PDF] [Project] [Github]

XingGAN for Person Image Generation.
Hao Tang, Song Bai, Li Zhang, Philip H. S. Torr, Nicu Sebe.
ECCV 2020. [Github]

Progressive Pose Attention Transfer for Person Image Generation.
Zhen Zhu, Tengteng Huang, Baoguang Shi, Miao Yu, Bofei Wang, Xiang Bai.
CVPR 2019 (oral). [PDF] [Github]

Generating Person Images with Appearance-aware Pose Stylizer.
Siyu Huang, Haoyi Xiong, Zhi-Qi Cheng, Qingzhong Wang, Xingran Zhou, Bihan Wen, Jun Huan, Dejing Dou.
IJCAI 2020. [PDF] [Github]

Text-guided 3D Human Generation from 2D Collections.
Tsu-Jui Fu, Wenhan Xiong, Yixin Nie, Jingyu Liu, Barlas Oğuz, William Yang Wang.
arXiv 2023. [PDF] [Project]

Text2Performer: Text-Driven Human Video Generation.
Yuming Jiang, Shuai Yang, Tong Liang Koh, Wayne Wu, Chen Change Loy, Ziwei Liu.
arxiv 2023. [PDF] [Project] [Github]

LEO: Generative Latent Image Animator for Human Video Synthesis.
Yaohui Wang, Xin Ma, Xinyuan Chen, Antitza Dantcheva, Bo Dai, Yu Qiao.
arXiv 2023. [PDF] [Project]

Image-Based Virtual Try-On

[Awesome Virtual Try-on (VTON)]

FashionTex: Controllable Virtual Try-on with Text and Texture.
Anran Lin, Nanxuan Zhao, Shuliang Ning, Yuda Qiu, Baoyuan Wang, Xiaoguang Han.
SIGGRAPH 2023. [PDF]

TryOnDiffusion: A Tale of Two UNets.
Luyang Zhu, Dawei Yang, Tyler Zhu, Fitsum Reda, William Chan, Chitwan Saharia, Mohammad Norouzi, Ira Kemelmacher-Shlizerman.
CVPR 2023. [PDF] [Project]

High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditions.
Sangyun Lee, Gyojung Gu, Sunghyun Park, Seunghwan Choi, Jaegul Choo.
ECCV 2022. [PDF] [Project] [Github]

Single Stage Virtual Try-on via Deformable Attention Flows.
Shuai Bai, Huiling Zhou, Zhikang Li, Chang Zhou, Hongxia Yang.
ECCV 2022. [PDF]

MGN: A Regional Mask Guided Network for Parser-free Virtual Try-on.
Chao Lin, Zhao Li, Sheng Zhou, Shichang Hu, Jialun Zhang, Linhao Luo, Jiarun Zhang, Longtao Huang, Yuan He.
IJCAI 2022. [PDF]

ClothFormer: Taming Video Virtual Try-on in All Module.
Jianbin Jiang, Tan Wang, He Yan, Junhui Liu.
CVPR 2022 (oral). [PDF] [Project]

Style-Based Global Appearance Flow for Virtual Try-On.
Sen He, Yi-Zhe Song, Tao Xiang.
CVPR 2022. [PDF]

Dressing in the Wild by Watching Dance Videos.
Xin Dong, Fuwei Zhao, Zhenyu Xie, Xijin Zhang, Daniel K. Du, Min Zheng, Xiang Long, Xiaodan Liang, Jianchao Yang.
CVPR 2022. [PDF] [Project]

CIT: Cloth Interactive Transformer for Virtual Try-On.
Bin Ren, Hao Tang, Fanyang Meng, Runwei Ding, Ling Shao, Philip H.S. Torr, Nicu Sebe.
CVPR 2022. [PDF] [Github]

WAS-VTON: Warping Architecture Search for Virtual Try-on Network.
Zhenyu Xie, Xujie Zhang, Fuwei Zhao, Haoye Dong, Michael C. Kampffmeyer, Haonan Yan, Xiaodan Liang.
ACM MM 2021. [PDF]

Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN.
Zhenyu Xie, Zaiyu Huang, Fuwei Zhao, Haoye Dong, Michael Kampffmeyer, Xiaodan Liang.
NeurIPS 2021. [PDF] [Github]

ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priors.
Ayush Chopra, Rishabh Jain, Mayur Hemani, Balaji Krishnamurthy.
ICCV 2021. [PDF]

Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-On and Outfit Editing.
Aiyu Cui, Daniel McKee, Svetlana Lazebnik.
ICCV 2021. [PDF]

FashionMirror: Co-Attention Feature-Remapping Virtual Try-On With Sequential Template Poses.
Chieh-Yun Chen, Ling Lo, Pin-Jui Huang, Hong-Han Shuai, Wen-Huang Cheng.
ICCV 2021. [PDF]

Shape Controllable Virtual Try-on for Underwear Models.
Xin Gao, Zhenjiang Liu, Zunlei Feng, Chengji Shen, Kairi Ou, Haihong Tang, Mingli Song.
ACM MM 2021. [PDF]

TryOnGAN: Body-aware Try-on via Layered Interpolation.
Kathleen M Lewis, Srivatsan Varadharajan, Ira Kemelmacher-Shlizerman.
TOG 2021. [PDF] [Project] [Demo]

VOGUE: Try-On by StyleGAN Interpolation Optimization.
Kathleen M Lewis, Srivatsan Varadharajan, Ira Kemelmacher-Shlizerman.
CVPR 2021. [PDF] [Project] [Github]

Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing.
Aiyu Cui, Daniel McKee, Svetlana Lazebnik.
CVPR 2021. [PDF] [Github]

Toward Accurate and Realistic Outfits Visualization With Attention to Details.
Kedan Li, Min Jin Chong, Jeffrey Zhang, Jingen Liu.
CVPR 2021. [PDF] [Demo]

VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization.
Seunghwan Choi, Sunghyun Park, Minsoo Lee, Jaegul Choo.
CVPR 2021. [PDF]

HumanGAN: A Generative Model of Humans Images.
Kripasindhu Sarkar, Lingjie Liu, Vladislav Golyanik, Christian Theobalt.
CVPR 2021. [PDF] [Project]

DCTON: Disentangled Cycle Consistency for Highly-realistic Virtual Try-On.
Chongjian Ge, Yibing Song, Yuying Ge, Han Yang, Wei Liu, and Ping Luo.
CVPR 2021. [PDF] [Github]

PF-AFN: Parser-Free Virtual Try-on via Distilling Appearance Flows.
Yuying Ge, Yibing Song, Ruimao Zhang, Chongjian Ge, Wei Liu, Ping Luo.
CVPR 2021. [PDF] [Github]

Template-Free Try-on Image Synthesis via Semantic-guided Optimization.
Chien-Lung Chou, Chieh-Yun Chen, Chia-Wei Hsieh, Hong-Han Shuai, Jiaying Liu, Wen-Huang Cheng.
TNNLS 2021. [PDF]

Unpaired Person Image Generation with Semantic Parsing Transformation.
Sijie Song, Wei Zhang, Jiaying Liuv, Zongming Guo, Tao Mei.
TPAMI 2020. [PDF] [CVPR 2019] [TPAMI 2020] [Github]

Do Not Mask What You Do Not Need to Mask: a Parser-Free Virtual Try-On.
Thibaut Issenhuth, Jérémie Mary, Clément Calauzènes.
ECCV 2020. [PDF]

Fully Convolutional Graph Neural Networks for Parametric Virtual Try-On.
Raquel Vidaurre, Igor Santesteban, Elena Garces, Dan Casas.
ACM MM 2020. [PDF] [Project]

Towards Photo-Realistic Virtual Try-On by Adaptively Generating Preserving Image Content.
Han Yang, Ruimao Zhang, Xiaobao Guo, Wei Liu, Wangmeng Zuo, Ping Luo.
CVPR 2020. [PDF] [Github]

PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfer.
Wentao Jiang, Si Liu, Chen Gao, Jie Cao, Ran He, Jiashi Feng, Shuicheng Yan.
CVPR 2020. [PDF]

ClothFlow: A Flow-Based Model for Clothed Person Generation.
Xintong Han, Xiaojun Hu, Weilin Huang, Matthew R. Scott.
ICCV 2019. [PDF]

VTNFP: An Image-Based Virtual Try-On Network With Body and Clothing Feature Preservation.
Ruiyun Yu, Xiaoqi Wang, Xiaohui Xie.
ICCV 2019. [PDF]

Toward Characteristic-Preserving Image-based Virtual Try-On Network.
Bochao Wang, Huabin Zheng, Xiaodan Liang, Yimin Chen, Liang Lin, Meng Yang.
ECCV 2018. [PDF]

Generating High-Resolution Fashion Model Images Wearing Custom Outfits.
Gökhan Yildirim, Nikolay Jetchev, Roland Vollgraf, Urs Bergmann.
Workshop on Computer Vision for Fashion, Art and Design, ICCV 2019. [PDF]

Dress Code: High-Resolution Multi-Category Virtual Try-On.
Davide Morelli, Matteo Fincato, Marcella Cornia, Federico Landi, Fabio Cesari, Rita Cucchiara.
arxiv 2022. [PDF] [Github] [Dress Code Dataset]

Weakly Supervised High-Fidelity Clothing Model Generation.
Ruili Feng, Cheng Ma, Chengji Shen, Xin Gao, Zhenjiang Liu, Xiaobo Li, Kairi Ou, Zhengjun Zha.
arxiv 2021. [PDF]

Style and Pose Control for Image Synthesis of Humans from a Single Monocular View.
Kripasindhu Sarkar, Vladislav Golyanik, Lingjie Liu, Christian Theobalt.
arxiv 2021. [PDF] [Project]

Imitation Learning for Fashion Style Based on Hierarchical Multimodal Representation.
Shizhu Liu, Shanglin Yang, Hui Zhou.
arxiv 2020. [PDF]

Toward Accurate and Realistic Virtual Try-on Through Shape Matching and Multiple Warps.
Kedan Li, Min Jin Chong, Jingen Liu, David Forsyth.
arxiv 2020. [PDF]

Learning Color Compatibility in Fashion Outfits.
Heming Zhang, Xuewen Yang, Jianchao Tan, Chi-Hao Wu, Jue Wang, C.-C. Jay Kuo.
arxiv 2020. [PDF]

GarmentGAN: Photo-realistic Adversarial Fashion Transfer.
Amir Hossein Raffiee, Michael Sollami.
arxiv 2020. [PDF]

TailorGAN: Making User-Defined Fashion Designs.
Lele Chen, Justin Tian, Guo Li, Cheng-Haw Wu, Erh-Kan King, Kuan-Ting Chen, Shao-Hang Hsieh.
arxiv 2019. [PDF] [Github]

SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On.
Surgan Jandial, Ayush Chopra, Kumar Ayush, Mayur Hemani, Abhijeet Kumar, Balaji Krishnamurthy.
arxiv 2019. [PDF] [Github]

Human Body Reshaping

Structure-Aware Flow Generation for Human Body Reshaping.
Jianqiang Ren, Yuan Yao, Biwen Lei, Miaomiao Cui, Xuansong Xie.
CVPR 2022. [PDF] [Github]

Real-Time Reshaping of Humans.
Michal Richter, Kiran Varanasi, Nils Hasler, Christian Theobalt.
International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission, 2012. [PDF]

MovieReshape: Tracking and Reshaping of Humans in Videos.
Arjun Jain, Thorsten Thormählen, Hans-Peter Seidel, Christian Theobalt.
SIGGRAPH Asia 2010. [PDF] [Project]

Parametric reshaping of human bodies in images.
Shizhe Zhou, Hongbo Fu, Ligang Liu, Daniel Cohen-Or, Xiaoguang Han.
SIGGRAPH 2010. [PDF]

NeuralReshaper: Single-image Human-body Retouching with Deep Neural Networks.
Beijia Chen, Hongbo Fu, Xiang Chen, Kun Zhou, Youyi Zheng.
arxiv 2022. [PDF]

Scene context-aware Human Body Generation

Putting People in Their Place: Affordance-Aware Human Insertion Into Scenes.
Sumith Kulal, Tim Brooks, Alex Aiken, Jiajun Wu, Jimei Yang, Jingwan Lu, Alexei A. Efros, Krishna Kumar Singh.
CVPR 2023. [PDF] [Project]

Generating 3D People in Scenes Without People.
Yan Zhang, Mohamed Hassan, Heiko Neumann, Michael J. Black, Siyu Tang.
CVPR 2020. [PDF] [Github]

Human Mesh Recovery

GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras.
Ye Yuan, Umar Iqbal, Pavlo Molchanov, Kris Kitani, Jan Kautz.
CVPR 2022 (Oral). [PDF] [Project] [Github]

Shapy: Accurate 3D Body Shape Regression Using Metric and Semantic Attributes.
Vasileios Choutas, Lea Muller, Chun-Hao P. Huang, Siyu Tang, Dimitrios Tzionas, Michael J. Black.
CVPR 2022. [PDF] [Project] [Github]

PoseScript: 3D Human Poses from Natural Language.
Ginger Delmas, Philippe Weinzaepfel, Thomas Lucas, Francesc Moreno-Noguer, Grégory Rogez.
ECCV 2022. [PDF] [Github]

Human-Centric Perception

Versatile Multi-Modal Pre-Training for Human-Centric Perception.
Fangzhou Hong, Liang Pan, Zhongang Cai, Ziwei Liu.
CVPR 2022. [PDF] [Github] [Project]

Challenge and workshop

• KDD Workshop on Fashion. [2019] [2018] [2017] [2016]
• Workshop on Computer Vision for Fashion, Art and Design. [CVPR 2020] [ICCV 2019] [ECCV 2018] [ICCV 2017]
• NeurlPS workshop on Machine Learning for Creativity and Design. [2019] [2018] [2017]
• SIGIR Workshop On eCommerce. [2019] [2018] [2017]
• CVPR Deep Learning for Content Creation Tutorial. [2019]
• iMaterialist Fashion Challenge. [CVPR 2019]
• iDesigner Challenge. [CVPR 2019]
• FashionGen Challenge. [ICCV 2019, ECCV 2018]
• JD AI Fashion Challenge. [ChinaMM 2018]
• Alibaba FashionAI Global Challenge. [Tianchi]
• Artificial Intelligence on Fashion and Textile Conference. [AIFT 2018]
• Fashion IQ Challenge. [CVPR 2020] [ICCV 2019]
• DeepFashion2 Challenge. [CVPR 2020] [ICCV 2019]

Datasets

• Fashionpedia. [Website]
• DeepFashion2 Dataset. [Website]
• DeepFashion Dataset. [Website]
• FashionGen. [Website]
• FashionAI. [Tianchi]
• TaobaoClothMatch. [Tianchi]
• Fashion-MNIST. [Fashion-MNIST]
• Fashion IQ. [Website]
• NTURGBD-Parsing-4K Dataset. [Website]

Garment Design

Knitting 4D Garment with Elasticity Controlled for Body Motion.
Zishun Liu, Xingjian Han, Yuchen Zhang, Xiangjia Chen, Yukun Lai, Eugeni L. Doubrovski, Emily Whiting, Charlie C.L. Wang.
TOG 2021. [PDF] [Project]

Garment Design with Generative Adversarial Networks.
Chenxi Yuan, Mohsen Moghaddam.
AdvML 2020, KDD workshop. [PDF]

Fashion Style Influences

From Paris to Berlin: Discovering Fashion Style Influences Around the World.
Ziad Al-Halah, Kristen Grauman.
CVPR 2020. [PDF]

From Culture to Clothing: Discovering the World Events Behind A Century of Fashion Images.
Wei-Lin Hsiao, Kristen Grauman.
arxiv 2021. [PDF]

Team and People

• Real Virtual Humans, Max Planck Institute for Informatics, by Gerard Pons-Moll.
• Perceiving Systems, Tubingen Compus, Max Planck Institute for Intelligent Systems, by Michael Black.
• Visual Computer Lab, Technical University Munich (TUM), by Prof. Dr. Matthias Nießner and his team.
• Broadband Network and Digital Media Lab, Department of Automation, Tsinghua University, by Yebin Liu.
• Vision and Graphics Lab, University of Southern California, by Hao Li.

Dataset

• SMPL. To download the SMPL-X, SMPL+H and SMPL (Male and Female, Gender Neural Model) model, go to this project website and register to get access to the downloads section. [Github]

• THUmanDataset. THUman is a 3D real-world human model dataset containing approximately 7000 models.

• AGORA. AGORA, proposed at CVPR 2021 paper, consists of 4240 scans spanning more than 350 unique subjects, all paired with SMPL-X fits.

Applications

Fitness Training

AIFit: Automatic 3D Human-Interpretable Feedback Models for Fitness Training.
Mihai Fieraru, Mihai Zanfir, Silviu-Cristian Pirlea, Vlad Olaru, Cristian Sminchisescu.
CVPR 2021. [PDF] [Project]