datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
odyn-sharegpt-benchmarks
Odyn ShareGPT Benchmarks
This dataset repository contains fixed-size ShareGPT benchmark samples used for stress and orchestration testing.
Files
data/sharegpt_1000.jsonl (1,000 rows)
data/sharegpt_5000.jsonl (5,000 rows)
data/sharegpt_10000.jsonl (10,000 rows)
Source
Derived from RyokoAI/ShareGPT52K train split via deterministic sampling (seed = 7).
benchmark-dataset-different-gpu-workload
GPU catalog × LLM workload VRAM benchmark
Summary
Tabular benchmark in CSV form: each row pairs a catalog GPU (gpu_id, gpu_display_name, catalog_gpu_vram_gb) with a concrete LLM inference-style workload (model, parameter count, context length, precision, batch size, concurrent users). The file records math_engine VRAM component estimates (weights, KV cache, activations, overhead, totals, tier), a document_engine recommended VRAM value, a short comparison summary… See the full description on the dataset page: https://huggingface.co/datasets/odyn-network/benchmark-dataset-different-gpu-workload.finetune-tracker-v1merlinodyn-benchmarks
Odyn Benchmarks
Inference benchmark datasets and results for the Odyn Network — a distributed, OpenAI-compatible AI inference platform built on vLLM, Ray Serve, and FastAPI.
Dataset Structure
Prompt Profiles (data/)
Four load profiles covering the full input/output token distribution space, sourced from real Odyn traffic and augmented with ShareGPT Vicuna Unfiltered:
Profile
Description
Input tokens
Output tokens
Rows
A
Short input, Long output
avg… See the full description on the dataset page: https://huggingface.co/datasets/odyn-network/odyn-benchmarks.benchmark-finetune-dpo-v1
Odyn benchmark: DPO LoRA fine-tuning peak VRAM (V1)
Curated benchmark rows for validating GPU memory estimators during DPO + LoRA fine-tuning. Each row pairs a published or measured expected peak VRAM with inputs to a math engine (model size, context length, batch, LoRA rank, precision, parallelism) plus optional VRAM breakdown and provenance.
This dataset is not preference-pair training JSONL (UltraFeedback-style). It is evaluation ground truth for placement / scheduler memory… See the full description on the dataset page: https://huggingface.co/datasets/odyn-network/benchmark-finetune-dpo-v1.benchmark-finetune-lora-v1
Odyn benchmark: LoRA fine-tuning peak VRAM (V1)
Curated benchmark rows for validating GPU memory estimators during LoRA fine-tuning. Each row pairs a published or measured expected peak VRAM with inputs to a math engine (model size, context length, batch, LoRA rank, precision, parallelism) plus optional VRAM breakdown and provenance.
This dataset is not Alpaca-style training JSONL. It is evaluation ground truth for placement / scheduler memory models (Odyn Smart Digester math… See the full description on the dataset page: https://huggingface.co/datasets/odyn-network/benchmark-finetune-lora-v1.benchmark-dpo-hyperparameters-v1
Odyn benchmark: DPO LoRA fine-tuning hyperparameters (V1)
Curated benchmark of real, cited DPO + LoRA fine-tuning configurations for validating a hyperparameter advisor. Each row is a published or measured config (from a framework example, model card, or write-up) with its hyperparameters — learning rate, LoRA rank/alpha/dropout, epochs, batch, beta, loss type, gradient checkpointing — plus the dataset it trained on and per-field provenance.
Schema
Column… See the full description on the dataset page: https://huggingface.co/datasets/odyn-network/benchmark-dpo-hyperparameters-v1.benchmark-dataset-finetune
Fine-Tuning VRAM Benchmark Dataset
Benchmark dataset for evaluating the accuracy of the Odyn Smart Digester VRAM Math Engine for fine-tuning workloads.
Compares the V1 (initial) and V2 (updated) engine estimates against expected peak VRAM values sourced from published research papers and hardware measurements.
Dataset Details
10 workload rows — all with gradient checkpointing enabled
Methods covered — LoRA (bf16) and QLoRA (NF4)
Models — Llama 2 7B, Llama… See the full description on the dataset page: https://huggingface.co/datasets/odyn-network/benchmark-dataset-finetune.lora-hyperparameter-benchmark-v1
Odyn benchmark: LoRA fine-tuning hyperparameter configs (V1)
Curated benchmark of real, cited LoRA and QLoRA fine-tuning configurations for validating a hyperparameter advisor. Each row is a published or measured supervised (SFT) LoRA config with its hyperparameters (learning rate, LoRA rank/alpha/dropout, epochs, batch, sequence length, gradient checkpointing), the dataset it trained on, and per-field provenance.
Schema
Column
Type
Description
id… See the full description on the dataset page: https://huggingface.co/datasets/odyn-network/lora-hyperparameter-benchmark-v1.
