bogdancazan/t5-base-newsela-biendata-with-domain-adaptation

trainingargs = TrainingArguments( outputdir='t5-base-wikilarge-newsela-with-domain-adaptation', numtrainepochs=20, warmupsteps=250, perdevicetrainbatchsize=BATCHSIZE, weightdecay=0.01, learningrate=2e-4, # fp16=True, optim="adafactor", )

Step Training Loss 500 4.184500 1000 2.470900 1500 2.128900 2000 1.951600 2500 1.834400 3000 1.755800 3500 1.701800 4000 1.656300 4500 1.628800 TrainOutput(globalstep=4640, trainingloss=2.1286644540984057, metrics={'trainruntime': 4090.6694, 'trainsamplespersecond': 72.526, 'trainstepspersecond': 1.134, 'totalflos': 0.0, 'train_loss': 2.1286644540984057, 'epoch': 20.0})