node5265/virtual-try-on

1from dataclasses import dataclass2from enum import Enum3 4@dataclass5class Task:6    benchmark: str7    metric: str8    col_name: str9 10 11# Select your tasks here12# ---------------------------------------------------13class Tasks(Enum):14    # task_key in the json file, metric_key in the json file, name to display in the leaderboard 15    task0 = Task("anli_r1", "acc", "ANLI")16    task1 = Task("logiqa", "acc_norm", "LogiQA")17 18NUM_FEWSHOT = 0 # Change with your few shot19# ---------------------------------------------------20 21 22 23# Your leaderboard name24TITLE = """<h1 align="center" id="space-title">Demo leaderboard</h1>"""25 26# What does your leaderboard evaluate?27INTRODUCTION_TEXT = """28Intro text29"""30 31# Which evaluations are you running? how can people reproduce what you have?32LLM_BENCHMARKS_TEXT = f"""33## How it works34 35## Reproducibility36To reproduce our results, here is the commands you can run:37 38"""39 40EVALUATION_QUEUE_TEXT = """41## Some good practices before submitting a model42 43### 1) Make sure you can load your model and tokenizer using AutoClasses:44```python45from transformers import AutoConfig, AutoModel, AutoTokenizer46config = AutoConfig.from_pretrained("your model name", revision=revision)47model = AutoModel.from_pretrained("your model name", revision=revision)48tokenizer = AutoTokenizer.from_pretrained("your model name", revision=revision)49```50If this step fails, follow the error messages to debug your model before submitting it. It's likely your model has been improperly uploaded.51 52Note: make sure your model is public!53Note: if your model needs `use_remote_code=True`, we do not support this option yet but we are working on adding it, stay posted!54 55### 2) Convert your model weights to [safetensors](https://huggingface.co/docs/safetensors/index)56It's a new format for storing weights which is safer and faster to load and use. It will also allow us to add the number of parameters of your model to the `Extended Viewer`!57 58### 3) Make sure your model has an open license!59This is a leaderboard for Open LLMs, and we'd love for as many people as possible to know they can use your model 🤗60 61### 4) Fill up your model card62When we add extra information about models to the leaderboard, it will be automatically taken from the model card63 64## In case of model failure65If your model is displayed in the `FAILED` category, its execution stopped.66Make sure you have followed the above steps first.67If everything is done, check you can launch the EleutherAIHarness on your model locally, using the above command without modifications (you can add `--limit` to limit the number of examples per task).68"""69 70CITATION_BUTTON_LABEL = "Copy the following snippet to cite these results"71CITATION_BUTTON_TEXT = r"""72"""73