CoolFace
Modelpublic

NimVideo/cogvideox-2b-img2vid

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
80likes383downloads
Model Card

๐ŸŽฅ CogVideoX-2B-Img2Vid ๐Ÿš€

Fine-tuned on 10 million videos for high-quality generation at SBS levels comparable to CogVideoX-5B! ๐ŸŒŸ

Model Highlights ๐ŸŒŸ

  • โ€”Fine-tuned on 10 million videos for exceptional image-to-video generation quality.
  • โ€”Performance benchmarked to match SBS standards at CogVideoX-5B i2v level.

Usage Examples ๐Ÿ”ฅ

Try it for free on nim.video

<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/8vOYgS-Wm51BgOKv4Jnpp.mp4"></video>

CLI Inference ๐ŸŒ

bash
python -m inference.cli_demo \
    --video_path "resources/truck.jpg" \
    --prompt "A truck is driving through a dirt road, showcasing its capability for off-roading." \
    --model_path NimVideo/cogvideox-2b-img2vid

Gradio Inference with Web Demo ๐Ÿ–ฅ๏ธ

bash
python -m inference.gradio_web_demo \
    --model_path NimVideo/cogvideox-2b-img2vid

ComfyUI Example ๐Ÿ’ก

<p align="center"> <img src="cogvideox-2b-img2vid-workflow.png" width="800" height="400" alt="Workflow Preview" title="Workflow Example Preview"/> </p> <p align="center"> <a href="cogvideox-2b-img2vid-workflow.json">๐Ÿ”— JSON Workflow Example</a> </p>

๐Ÿ”ง Find the custom ComfyUI node here.

Quick Start ๐Ÿš€

1๏ธโƒฃ Clone the Repository

bash
git clone https://github.com/Nim-Video/cogvideox-2b-img2vid.git
cd cogvideox-2b-img2vid

2๏ธโƒฃ Set up a Virtual Environment

bash
python -m venv venv
source venv/bin/activate

3๏ธโƒฃ Install Requirements

bash
pip install -r requirements.txt

Acknowledgements ๐Ÿ™

This project builds on the foundational work of CogVideoX.