Datasetpublic

AgentPublic/evalap-comparing-mistral-medium-on-piaf-109

Comparing Mistral-Medium on piaf (ID: 109) Comparing Mistral-Medium in different instances on piaf dataset Overview This dataset contains 6 experiments from the EvalAP evaluation platform. Datasets: piaf-v1.2 Models evaluated: mistral-medium-2508 Metrics: energy_consumption, generation_time, gwp_consumption, judge_notator, judge_precision, nb_tokens_completion, nb_tokens_prompt Scores piaf-v1.2 model energy_consumption… See the full description on the dataset page: https://huggingface.co/datasets/AgentPublic/evalap-comparing-mistral-medium-on-piaf-109.

sourceHugging Faceupdated 8mo agoView on Hugging Face

0likes38downloads

Dataset Card

Comparing Mistral-Medium on piaf (ID: 109)

Comparing Mistral-Medium in different instances on piaf dataset

Overview

This dataset contains 6 experiments from the EvalAP evaluation platform.

Datasets: piaf-v1.2

Models evaluated: mistral-medium-2508

Metrics: energyconsumption, generationtime, gwpconsumption, judgenotator, judgeprecision, nbtokenscompletion, nbtokens_prompt

Scores

piaf-v1.2

model	energy_consumption	generation_time	gwp_consumption	judge_notator	judge_precision	nb_tokens_completion	nb_tokens_prompt
mistral-medium Cloud	0.00 ± 0.00	1.07 ± 1.97	0.00 ± 0.00	3.88 ± 3.63	0.09 ± 0.29	15.57 ± 19.52	29.93 ± 4.75
mistral-medium Oustcale	0.00 ± 0.00	0.31 ± 0.56	0.00 ± 0.00	3.89 ± 3.63	0.10 ± 0.30	15.93 ± 20.23	29.93 ± 4.75
mistral-medium Albert	0.00 ± 0.00	2.01 ± 6.36	0.00 ± 0.00	3.89 ± 3.62	0.10 ± 0.30	14.49 ± 20.15	25.94 ± 4.70

Usage

Use the dropdown above to select an experiment configuration.