auditkit
Datasets
All datasets matching “auditkit”auditkit-testrun-lmeval
auditkit-testrun-lmeval
Built using AuditKIT — evaluate any model on any dataset and any task.
Method
evaluate
Model
vllm:Qwen/Qwen2.5-0.5B-Instruct
Artifact
run
Published
2026-09-02 06:19 UTC
Usage
from datasets import load_dataset
ds = load_dataset("ram-lexsi/auditkit-testrun-lmeval")
auditkit-testrun-compare
auditkit-testrun-compare
Built using AuditKIT — evaluate any model on any dataset and any task.
Method
compare_models
Model
—
Artifact
compare
Published
2026-09-02 06:50 UTC
Usage
from datasets import load_dataset
ds = load_dataset("ram-lexsi/auditkit-testrun-compare")
auditkit-testrun-encoder-judge
auditkit-testrun-encoder-judge
Built using AuditKIT — evaluate any model on any dataset and any task.
Method
evaluate
Model
<auditkit.model.vllm_gen.VLLMModel object at 0x7a6694415010>
Artifact
run
Published
2026-09-01 14:16 UTC
Usage
from datasets import load_dataset
ds = load_dataset("ram-lexsi/auditkit-testrun-encoder-judge")
auditkit-testrun-llm-judge
auditkit-testrun-llm-judge
Built using AuditKIT — evaluate any model on any dataset and any task.
Method
evaluate
Model
<auditkit.model.CallableModel object at 0x7a775a2bf9d0>
Artifact
run
Published
2026-09-01 14:05 UTC
Usage
from datasets import load_dataset
ds = load_dataset("ram-lexsi/auditkit-testrun-llm-judge")
auditkit-testrun-metrics-embedding
auditkit-testrun-metrics-embedding
Built using AuditKIT — evaluate any model on any dataset and any task.
Method
evaluate
Model
<auditkit.model.vllm_gen.VLLMModel object at 0x7a62da714980>
Artifact
run
Published
2026-09-01 14:41 UTC
Usage
from datasets import load_dataset
ds = load_dataset("ram-lexsi/auditkit-testrun-metrics-embedding")
auditkit-testrun-redteam
auditkit-testrun-redteam
Built using AuditKIT — evaluate any model on any dataset and any task.
Method
redteam
Model
<auditkit.model.EchoModel object at 0x781f13372e40>
Artifact
redteam
Published
2026-09-01 12:49 UTC
Usage
from datasets import load_dataset
ds = load_dataset("ram-lexsi/auditkit-testrun-redteam")
