vllm
Datasets
All datasets matching “vllm”vllm-control-arena
vLLM Main Tasks Dataset
AI coding tasks generated from vLLM git commits
Dataset Description
This dataset contains 6801 coding tasks automatically generated from git commits in the vLLM repository. Each task represents a real-world coding challenge derived from actual development work.
Dataset Structure
The dataset contains the following columns:
commit_hash: The git commit hash
parent_hash: The parent commit hash
commit_title: The original commit… See the full description on the dataset page: https://huggingface.co/datasets/RoganInglis/vllm-control-arena.VLLM_ChartQAvllm-0.28.0-wheels-py312ViLLM-Eval
ViLLM-Eval
We utilize the lm-eval-harness library to conduct evaluations.
This library allows us to efficiently evaluate language models, ensuring robustness and accuracy in our assessments.
Feel free to explore our project and discover the capabilities of the language models we employ.
Install
git clone https://huggingface.co/datasets/vlsp-2023-vllm/ViLLM-Eval
cd ViLLM-Eval
pip install -e .
Basic Usage
# Add trust_remote_code=True if your model is a custom… See the full description on the dataset page: https://huggingface.co/datasets/vlsp-2023-vllm/ViLLM-Eval.MIRB
Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning
File Structure
├── MIR
|── analogy.json
│── codeu.json
|── dataset_namex.json
└── Images
├── analogy
│ └── image_x.jpg
└──codeu
└── image_x.jpg
JSON Structure
{
"questions": " What is the expected kurtosis of the sequence created by`create_number_sequence(-10, 10)`?\n\n1.… See the full description on the dataset page: https://huggingface.co/datasets/VLLMs/MIRB.details_hosted_vllm____fsx__anton__deepseek-r1-checkpoint_private
Dataset Card for Evaluation run of hosted_vllm//fsx/anton/deepseek-r1-checkpoint
Dataset automatically created during the evaluation run of model hosted_vllm//fsx/anton/deepseek-r1-checkpoint.
The dataset is composed of 15 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 9 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always… See the full description on the dataset page: https://huggingface.co/datasets/SaylorTwift/details_hosted_vllm____fsx__anton__deepseek-r1-checkpoint_private.