Upload New File
wang hongli authored
7415b39a
Name Last commit Last update
datasets Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
loss Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
models Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
train Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
utils Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
README.md Upload New File
config.py Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
constants.py Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
demo.py Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
demo_nr.py Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
eval.py Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
install_environment.sh Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...
train.py Update config.py, constants.py, demo.py, demo_nr.py, eval.py, install_environment.sh, train.py, datasets/__init__.py, datasets/base_dataset.py, datasets/mixed_dataset.py, datasets/__pycache__/__init__.cpython-37.pyc, datasets/__pycache__/base_dataset.cpython-37.pyc, datasets/__pycache__/mixed_dataset.cpython-37.pyc, loss/__init__.py, loss/PCB_PerLoss.py, loss/resnet_market1501.py, models/__init__.py, models/fast_hmr copy.py, models/fast_hmr.py, models/fast_scnn.py, models/hmr.py, models/smpl.py, models/__pycache__/__init__.cpython-37.pyc, models/__pycache__/fast_hmr.cpython-37.pyc, models/__pycache__/feat_queue.cpython-37.pyc, models/__pycache__/hmr.cpython-37.pyc, models/__pycache__/nt_xent.cpython-37.pyc, models/__pycache__/smpl.cpython-37.pyc, train/__init__.py, train/trainer.py, train/__pycache__/__init__.cpython-37.pyc, train/__pycache__/trainer.cpython-37.pyc, utils/__init__.pyc, utils/data_loader.pyc, utils/__init__.py, utils/base_trainer.py, utils/data_loader.py, utils/geometry.py, utils/imutils.py...

简介:

根据二维图像快速地恢复出人体三维模型在元宇宙、VR和AR等领域中有着广泛的应用。目前很多三维姿态估计算法主要是估计场景中人体的 SMPL 参数(pose、shape),进而可以利用SMPL恢复出三维人体模型。为了准确地恢复出人体姿态,往往需要较大的网络对图像进行编码。针对计算资源受限的智能手机等嵌入式设备,提出Fast-HMR方法,利用双分支网络同时快速地捕获图像的全局与局部信息,在融合特征的基础上回归出SMPL人体参数。

主要功能:

Fast-HMR算法基于Python3.6环境下的pytorch==1.4.0 torchvision==0.5.0 cudatoolkit=10.1、neural-renderer-pytorch==1.1.3、smplx==0.1.13等依赖库。算法输入为二维人体图像照片,输出为SMPL人体模型参数(包含10维shape向量、72维pose向量以及3维相机向量)。

算法名称 基于SMPL的轻量级三维人体重建算法
算法接口 python3 demo.py
算法输入 人体图像
算法输出 SMPL人体模型参数 10维shape向量 72维pose向量
依赖库 pytorch==1.4.0 torchvision==0.5.0 cudatoolkit=10.1、neural-renderer-pytorch==1.1.3、smplx==0.1.13
参考资源 https://github.com/xuxy09/RSC-Net、https://github.com/Tramac/Fast-SCNN-pytorch