Modelpublic

finetrainers/Wan2.1-T2V-1.3B-3dgs-v0

sourceHugging Faceotherupdated 2y agoView on Hugging Face

5likes45downloads

Model Card

This is a LoRA fine-tune of the Wan-AI/Wan2.1-T2V-1.3B-Diffusers model on the finetrainers/3dgs-dissolve dataset.

Code: https://github.com/a-r-r-o-w/finetrainers

[!IMPORTANT] This is an experimental checkpoint and its poor generalization is well-known.

Inference code:

python

import torch
from diffusers import WanPipeline
from diffusers.utils import export_to_video

pipe = WanPipeline.from_pretrained(
    "Wan-AI/Wan2.1-T2V-1.3B-Diffusers", torch_dtype=torch.bfloat16
).to("cuda")
pipe.load_lora_weights("finetrainers/Wan2.1-T2V-1.3B-3dgs-v0", adapter_name="wan-lora")
pipe.set_adapters(["wan-lora"], [0.5])

video = pipe("<my-awesome-prompt>").frames[0]
export_to_video(video, "output.mp4", fps=24)

Training logs are available on WandB here.