CoolFace
Modelpublic

promotion/Llama-3.1-8B-TLDR-SurplusMaxMin-baseline

sourceHugging Facellama3.1updated 22d agoView on Hugging Face
0likes281downloads
Model Card

SurplusMaxMin on TL;DR

Matched game-aggregation control: same response pool, temperatures, disagreement point and optimiser budget as NBPO, differing only in how the objective weights are chosen.

  • —Panel: TL;DR
  • —Objectives: coverage, faithfulness, conciseness, helpfulness
  • —Backbone / reference policy: meta-llama/Llama-3.1-8B-Instruct
  • —Training budget: 300 optimiser updates, global batch 16
  • —Reported in: Nash Bargaining Preference Optimization (NBPO), Table 2 (primary cross-method evaluation)

Evaluation protocol: independent objective-wise win rate against the common reference, judged by Llama-3.3-70B-Instruct on prompt-disjoint held-out prompts, both presentation orders.