namesarnav/causal-judge-bert

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

results

This model is a fine-tuned version of bert-base-uncased on maveriq/bigbenchhard/causal_judgement.

Model description

This model is trained for 50 epochs

TrainOutput(globalstep=300, trainingloss=0.2707221074899038, metrics={'trainruntime': 857.2913, 'trainsamplespersecond': 10.906, 'trainstepspersecond': 0.35, 'totalflos': 2460088367616000.0, 'train_loss': 0.2707221074899038, 'epoch': 50.0})

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• —learning_rate: 5e-05
• —trainbatchsize: 32
• —evalbatchsize: 8
• —seed: 42
• —optimizer: Use OptimizerNames.ADAMWTORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
• —lrschedulertype: linear
• —num_epochs: 50

Training results

Framework versions

• —Transformers 4.52.4
• —Pytorch 2.6.0+cu124
• —Datasets 3.6.0
• —Tokenizers 0.21.1