CoolFace
Datasetpublic

Shaer-AI-2/shaer-eval-raw-fanar-diwan-prefix

Shaer Evaluation Results Models: fanar_2_diwan_prefix Source dataset: Shaer-AI/shaer-sft-test-generations-k5 Rows: 3481 Validation passed: True Scored rows included: True Dataset repo: Shaer-AI/shaer-eval-raw-fanar-diwan-prefix Files generations.jsonl: raw generation rows generations.csv: raw generation rows in CSV generations_scored.jsonl: raw rows plus meter/count evaluation validation.json: validation summary generations_scored.csv: scored rows in CSV… See the full description on the dataset page: https://huggingface.co/datasets/Shaer-AI-2/shaer-eval-raw-fanar-diwan-prefix.

sourceHugging Faceupdated 4mo agoView on Hugging Face
0likes18downloads
Dataset Card

Shaer Evaluation Results

  • —Models: fanar_2_diwan_prefix
  • —Source dataset: Shaer-AI/shaer-sft-test-generations-k5
  • —Rows: 3481
  • —Validation passed: True
  • —Scored rows included: True
  • —Dataset repo: Shaer-AI/shaer-eval-raw-fanar-diwan-prefix

Files

  • —generations.jsonl: raw generation rows
  • —generations.csv: raw generation rows in CSV
  • —generations_scored.jsonl: raw rows plus meter/count evaluation
  • —validation.json: validation summary
  • —generations_scored.csv: scored rows in CSV
  • —aggregate.json: aggregate metrics

Aggregate

  • —Meter mean: 0.021058
  • —Count adherence mean: 0.123917
  • —Exact count rate: 0.007182