Modelpublic

LEAF-CLIP/CLIP-ViT-L-rho2-k2-constrained-FARE2

sourceHugging Facemitupdated 1y agoView on Hugging Face

0likes8downloads

Model Card

Model Initialized from openai/clip-vit-large-patch14. The image encoder is finetuned with FARE at $\epsilon=2/255$. The text encoder is finetuned with LEAF at $k=2$ with $\rho=2$ and semantic constraints.

To load this model use:

python

from transformers import CLIPProcessor, CLIPModel

model_name = "LEAF-CLIP/CLIP-ViT-L-rho2-k2-FARE2"
processor_name = "openai/clip-vit-large-patch14"

model = CLIPModel.from_pretrained(model_name)
processor = CLIPProcessor.from_pretrained(processor_name)