theblackcat102/electra-large-reward-model

Reward Model pretrained on openai/webgpt_comparison and humanfeedback summary. Unlike the other electra-large model this model is trained using rank loss with one more datasets.

On validation dataset the result is much more stable than usual.

You can refer to this wandb for more details

Slightly better than previous webgpt only model : electra-large