Datasetpublic

AgentPublic/evalap-comparing-albert-api-models-v11-12-2025-with-sysprompt-108

Comparing Albert-API models v11-12-2025 (with sysprompt) (ID: 108) Comparing albert models on MFS-AIA datasets (with sysprompt) Overview This dataset contains 20 experiments from the EvalAP evaluation platform. Datasets: Assistant IA - QA, MFS_questions_v01 Models evaluated: albert-large, albert-small, openweight-large, openweight-medium, openweight-small Metrics: generation_time, judge_notator, judge_precision, nb_tokens_completion, nb_tokens_prompt… See the full description on the dataset page: https://huggingface.co/datasets/AgentPublic/evalap-comparing-albert-api-models-v11-12-2025-with-sysprompt-108.

sourceHugging Faceupdated 8mo agoView on Hugging Face

0likes35downloads

Dataset Card

Comparing Albert-API models v11-12-2025 (with sysprompt) (ID: 108)

Comparing albert models on MFS-AIA datasets (with sysprompt)

Overview

This dataset contains 20 experiments from the EvalAP evaluation platform.

Datasets: Assistant IA - QA, MFSquestionsv01

Models evaluated: albert-large, albert-small, openweight-large, openweight-medium, openweight-small

Metrics: generationtime, judgenotator, judgeprecision, nbtokenscompletion, nbtokensprompt, outputlength

Scores

Assistant IA - QA

model	generation_time	judge_notator	judge_precision	nb_tokens_completion	nb_tokens_prompt	output_length
albert-large	0.93 ± 0.92	5.33 ± 2.89	0.03 ± 0.18	28.54 ± 36.87	28.59 ± 7.05	18.74 ± 25.54
albert-small	3.73 ± 25.95	3.55 ± 3.03	0.10 ± 0.30	51.70 ± 66.13	28.59 ± 7.05	34.30 ± 43.20
openweight-large	1.68 ± 0.81	6.14 ± 3.11	0.38 ± 0.49	60.11 ± 72.68	28.59 ± 7.05	37.82 ± 45.77
openweight-medium	0.45 ± 0.67	5.45 ± 2.84	0.03 ± 0.18	27.46 ± 34.94	28.59 ± 7.05	17.93 ± 24.15
openweight-small	0.29 ± 0.52	5.09 ± 3.01	0.14 ± 0.35	60.62 ± 79.09	28.59 ± 7.05	30.55 ± 40.17

MFSquestionsv01

model	generation_time	judge_notator	judge_precision	nb_tokens_completion	nb_tokens_prompt	output_length
albert-large	1.35 ± 1.11	6.47 ± 2.09	0.17 ± 0.37	41.45 ± 36.58	37.90 ± 9.26	27.72 ± 23.56
albert-small	14.03 ± 54.24	4.78 ± 2.52	0.13 ± 0.33	70.76 ± 66.24	37.90 ± 9.26	50.38 ± 47.97
openweight-large	1.74 ± 0.78	6.86 ± 2.26	0.46 ± 0.50	95.62 ± 72.85	37.90 ± 9.26	56.85 ± 41.96
openweight-medium	0.69 ± 0.69	6.44 ± 2.23	0.18 ± 0.38	39.32 ± 36.83	37.90 ± 9.26	26.22 ± 23.99
openweight-small	0.53 ± 0.50	6.67 ± 2.18	0.32 ± 0.47	77.13 ± 53.72	37.90 ± 9.26	38.13 ± 27.00

Usage

Use the dropdown above to select an experiment configuration.