usakha/Prophetnet_GovReport_model
023
Hyperparameters
learningrate=2e-5 perdevicetrainbatchsize=14 perdeviceevalbatchsize=14 weightdecay=0.01 savetotallimit=3 numtrainepochs=3 predictwithgenerate=True fp16=True
Training Output
globalstep=3003, trainingloss=2.5178213735600132, metrics={'trainruntime': 8703.174, 'trainsamplespersecond': 4.83, 'trainstepspersecond': 0.345, 'totalflos': 9.272950245870797e+16, 'train_loss': 2.5178213735600132, 'epoch': 3.0}