Datasetpublic

kaaloo/evalap-comparing-openweight-with-atlaaiselene-1-mini-llama-31-8b-115

Comparing openweight with AtlaAI/Selene-1-Mini-Llama-3.1-8B (ID: 115) Comparing openweight Albert-API with specific judge AtlaAI/Selene-1-Mini-Llama-3.1-8B Overview This dataset contains 24 experiments from the EvalAP evaluation platform. Datasets: Assistant IA - QA, MFS_questions_v01 Models evaluated: openweight-large, openweight-medium, openweight-small Metrics: energy_consumption, generation_time, gwp_consumption, judge_notator, judge_precision… See the full description on the dataset page: https://huggingface.co/datasets/kaaloo/evalap-comparing-openweight-with-atlaaiselene-1-mini-llama-31-8b-115.

sourceHugging Faceupdated 9mo agoView on Hugging Face

0likes10downloads

Dataset Card

Comparing openweight with AtlaAI/Selene-1-Mini-Llama-3.1-8B (ID: 115)

Comparing openweight Albert-API with specific judge AtlaAI/Selene-1-Mini-Llama-3.1-8B

Overview

This dataset contains 24 experiments from the EvalAP evaluation platform.

Datasets: Assistant IA - QA, MFSquestionsv01

Models evaluated: openweight-large, openweight-medium, openweight-small

Metrics: energyconsumption, generationtime, gwpconsumption, judgenotator, judgeprecision, nbtokenscompletion, nbtokens_prompt

Scores

MFSquestionsv01

model	energy_consumption	generation_time	gwp_consumption	judge_notator	judge_precision	nb_tokens_completion	nb_tokens_prompt
openai/gpt-oss-120b Albert	0.02 ± 0.01	13.78 ± 4.63	0.00 ± 0.00	7.91 ± 0.43	0.21 ± 0.40	1780.77 ± 644.35	38.90 ± 9.26
Mistral small	0.00 ± 0.00	10.93 ± 5.14	0.00 ± 0.00	7.77 ± 0.60	0.19 ± 0.39	453.78 ± 148.62	38.90 ± 9.26
Qwen/Qwen3-VL-8B-Thinking	0.00 ± 0.00	6.51 ± 2.82	0.00 ± 0.00	7.88 ± 0.47	0.15 ± 0.35	1389.65 ± 612.34	38.90 ± 9.26

Assistant IA - QA

model	energy_consumption	generation_time	gwp_consumption	judge_notator	judge_precision	nb_tokens_completion	nb_tokens_prompt
openai/gpt-oss-120b Albert	0.01 ± 0.01	9.56 ± 4.56	0.00 ± 0.00	7.66 ± 0.96	0.19 ± 0.39	1186.32 ± 703.42	29.59 ± 7.05
Mistral small	0.00 ± 0.00	7.86 ± 4.78	0.00 ± 0.00	7.57 ± 0.82	0.16 ± 0.37	342.87 ± 153.17	29.59 ± 7.05
Qwen/Qwen3-VL-8B-Thinking	0.00 ± 0.00	4.80 ± 3.10	0.00 ± 0.00	7.67 ± 0.63	0.18 ± 0.39	1036.54 ± 676.48	29.59 ± 7.05

Usage

Use the dropdown above to select an experiment configuration.