CoolFace
Modelpublic

facebook/sapiens2-pointmap-5b

sourceHugging Faceotherupdated 3mo agoView on Hugging Face
4likes816downloads
Model Card

Sapiens2-5B-Pointmap

Per-pixel 3D pointmap (x, y, z coordinates per pixel in camera frame).

This repository contains the 5B Pointmap Estimation checkpoint, finetuned from the Sapiens2-5B pretrained backbone.

Model Details

  • โ€”Developed by: Meta
  • โ€”Model type: Vision Transformer
  • โ€”License: Sapiens2 License
  • โ€”Task: pointmap
  • โ€”Base model: facebook/sapiens2-pretrain-5b
  • โ€”Format: safetensors
  • โ€”File: sapiens2_5b_pointmap.safetensors

Quick Start

Install the Sapiens2 repo (pip install -e .), download the checkpoint, and run the demo:

bash
# 1. Download the checkpoint to $SAPIENS_CHECKPOINT_ROOT/pointmap/
hf download facebook/sapiens2-pointmap-5b sapiens2_5b_pointmap.safetensors \
    --local-dir ~/sapiens2_host/pointmap

# 2. Run the demo (edit INPUT, OUTPUT, and MODEL_NAME inside the script)
cd $SAPIENS_ROOT/sapiens/dense
./scripts/demo/pointmap.sh

See the Pointmap Estimation guide for details on inputs, outputs, and visualization options.

Model Card

FieldValue
ArchitectureSapiens2 ViT backbone + Pointmap Estimation head
Backbone parameters5.071 B
Backbone FLOPs15.722 T
Embedding dim2432
Layers56
Attention heads32
Inference resolution1024 ร— 768 (H ร— W)
Patch size16

Sapiens2-Pointmap Family

ModelParamsFLOPsEmbed dimLayersHeads
Sapiens2-0.4B0.398 B1.260 T10242416
Sapiens2-0.8B0.818 B2.592 T12803216
Sapiens2-1B1.462 B4.715 T15364024
Sapiens2-5B (this)5.071 B15.722 T24325632

See the Sapiens2 Collection for all variants and other downstream task checkpoints.

Intended Use

  • โ€”Pointmap Estimation on human-centric imagery
  • โ€”Research on human-centric vision

License

Released under the Sapiens2 License.

Citation

bibtex
@article{khirodkarsapiens2,
  title={Sapiens2},
  author={Khirodkar, Rawal and Wen, He and Martinez, Julieta and Dong, Yuan and Su, Zhaoen and Saito, Shunsuke},
  journal={arXiv preprint arXiv:2604.21681},
  year={2026}
}