CoolFace
Modelpublic

nlile/PE-12b-pythia

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face
0likes14downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

PE-12b-pythia

This model is a fine-tuned version of EleutherAI/pythia-12b-deduped on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.1421
  • —Rewards/chosen: 3.5045
  • —Rewards/rejected: -2.3171
  • —Rewards/accuracies: 0.9441
  • —Rewards/margins: 5.8216
  • —Logps/rejected: -95.5639
  • —Logps/chosen: -116.1507
  • —Logits/rejected: -0.4604
  • —Logits/chosen: -0.4355

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 3e-07
  • —trainbatchsize: 1
  • —evalbatchsize: 2
  • —seed: 42
  • —distributed_type: multi-GPU
  • —num_devices: 8
  • —gradientaccumulationsteps: 8
  • —totaltrainbatch_size: 64
  • —totalevalbatch_size: 16
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —lrschedulerwarmup_ratio: 0.1
  • —num_epochs: 3

Training results

Training LossEpochStepValidation LossRewards/chosenRewards/rejectedRewards/accuraciesRewards/marginsLogps/rejectedLogps/chosenLogits/rejectedLogits/chosen
0.88250.051000.88720.18840.12040.50560.0680-90.6889-122.7830-0.5017-0.4522
0.91360.092000.83250.32530.07140.58940.2540-90.7870-122.5091-0.4960-0.4447
0.75070.143000.78160.57410.27970.56700.2944-90.3703-122.0116-0.4909-0.4426
0.61420.184000.64351.07530.44040.63690.6348-90.0489-121.0092-0.4793-0.4322
0.5190.235000.51961.72130.56240.74301.1590-89.8050-119.7171-0.4559-0.4084
0.48580.276000.43512.20850.59230.78771.6162-89.7450-118.7428-0.4592-0.4138
0.40480.327000.38782.61050.57360.83242.0369-89.7825-117.9388-0.4398-0.3953
0.36230.378000.33832.70550.46100.85202.2446-90.0078-117.7487-0.4492-0.4046
0.3080.419000.31452.97420.35060.85202.6236-90.2285-117.2114-0.4381-0.3971
0.30920.4610000.31253.15410.26870.83522.8854-90.3922-116.8515-0.4276-0.3926
0.27650.511000.29393.12080.14750.86032.9733-90.6347-116.9181-0.4615-0.4216
0.30580.5512000.27722.9861-0.13710.87713.1232-91.2038-117.1875-0.4249-0.3887
0.27020.5913000.25923.3217-0.06390.87153.3856-91.0574-116.5163-0.4497-0.4113
0.23160.6414000.24913.3560-0.29340.88553.6494-91.5165-116.4477-0.4234-0.3869
0.23440.6815000.25063.2223-0.22420.86873.4464-91.3780-116.7152-0.4515-0.4151
0.23320.7316000.23503.2137-0.40700.88553.6207-91.7436-116.7324-0.4299-0.3936
0.22580.7817000.24773.0894-0.55900.89393.6484-92.0476-116.9809-0.4316-0.3960
0.25260.8218000.22773.2845-0.55270.87713.8373-92.0351-116.5907-0.4420-0.4076
0.20250.8719000.21823.2061-0.81000.90224.0160-92.5496-116.7476-0.4319-0.3974
0.22530.9120000.21493.2765-0.97560.90784.2521-92.8809-116.6067-0.4391-0.4023
0.20840.9621000.22233.1160-1.06590.89394.1820-93.0615-116.9277-0.4283-0.3954
0.18961.022000.21003.1835-1.01310.89114.1966-92.9559-116.7927-0.4517-0.4154
0.22941.0523000.20703.1205-1.08730.89394.2078-93.1043-116.9187-0.4412-0.4051
0.18971.124000.20113.1553-1.08750.90504.2428-93.1047-116.8492-0.4483-0.4136
0.19431.1425000.19533.3317-1.22610.90224.5578-93.3819-116.4964-0.4488-0.4137
0.17491.1926000.19753.2186-1.32320.89114.5419-93.5761-116.7225-0.4500-0.4160
0.18811.2327000.18383.3207-1.33230.92744.6530-93.5944-116.5184-0.4262-0.3962
0.16111.2828000.18333.2881-1.35880.91064.6469-93.6472-116.5835-0.4404-0.4091
0.16531.3229000.19593.2545-1.61430.91904.8688-94.1584-116.6508-0.4252-0.3996
0.16131.3730000.17793.3926-1.51900.92184.9117-93.9678-116.3744-0.4374-0.4071
0.17851.4231000.18403.4053-1.62860.92465.0339-94.1868-116.3491-0.4280-0.3987
0.15441.4632000.16863.5029-1.63890.92185.1418-94.2075-116.1539-0.4624-0.4309
0.14921.5133000.17063.2854-1.80940.93305.0948-94.5485-116.5889-0.4148-0.3943
0.17191.5534000.16913.5148-1.74570.92745.2605-94.4210-116.1301-0.4542-0.4253
0.19051.635000.17193.4941-1.74540.92465.2395-94.4204-116.1715-0.4479-0.4189
0.13541.6436000.17493.5351-1.70240.91065.2375-94.3345-116.0895-0.4608-0.4303
0.16441.6937000.15973.5736-1.65800.92465.2316-94.2457-116.0126-0.4469-0.4192
0.15981.7338000.16133.6646-1.70350.90785.3681-94.3367-115.8306-0.4631-0.4349
0.13371.7839000.15833.5502-1.84440.91345.3946-94.6184-116.0593-0.4658-0.4368
0.15341.8340000.15723.5076-1.91370.91905.4213-94.7571-116.1446-0.4610-0.4328
0.13271.8741000.16073.5711-1.91430.92185.4854-94.7583-116.0175-0.4404-0.4153
0.1621.9242000.15653.4852-2.01360.93305.4988-94.9568-116.1893-0.4641-0.4373
0.14711.9643000.15243.5639-1.97660.92465.5406-94.8830-116.0319-0.4627-0.4338
0.13332.0144000.14183.6173-1.97100.91625.5883-94.8717-115.9251-0.4608-0.4328
0.132.0545000.14853.6275-1.98650.93585.6140-94.9027-115.9047-0.4604-0.4319
0.13112.146000.15033.4735-2.11940.91345.5928-95.1684-116.2128-0.4405-0.4123
0.13292.1547000.14313.5793-2.10590.92185.6852-95.1415-116.0012-0.4519-0.4229
0.13462.1948000.14943.6059-2.06420.92745.6701-95.0581-115.9479-0.4639-0.4332
0.14622.2449000.14553.4721-2.16480.92185.6369-95.2593-116.2156-0.4553-0.4258
0.12212.2850000.15383.6293-2.14720.93855.7764-95.2240-115.9012-0.4525-0.4268
0.13292.3351000.14863.4734-2.17780.93585.6512-95.2853-116.2130-0.4578-0.4301
0.12842.3752000.15273.4805-2.16700.90785.6474-95.2636-116.1988-0.4611-0.4329
0.12382.4253000.14333.4570-2.17680.92745.6338-95.2832-116.2457-0.4451-0.4191
0.13172.4654000.14213.5647-2.22320.93305.7880-95.3761-116.0303-0.4565-0.4342
0.1312.5155000.14783.4211-2.26810.91905.6892-95.4659-116.3175-0.4444-0.4147
0.12352.5656000.14283.5292-2.27980.94135.8089-95.4892-116.1014-0.4485-0.4234
0.11222.657000.14453.6102-2.23630.93305.8465-95.4023-115.9393-0.4473-0.4233
0.11722.6558000.14153.5813-2.18990.92465.7712-95.3095-115.9972-0.4648-0.4357
0.12572.6959000.14283.4075-2.30470.92185.7122-95.5390-116.3447-0.4553-0.4269
0.14412.7460000.14263.4287-2.32100.91905.7497-95.5717-116.3024-0.4673-0.4401
0.13592.7861000.14793.4833-2.29930.93585.7826-95.5282-116.1931-0.4409-0.4173
0.13322.8362000.14423.4741-2.27260.93305.7466-95.4748-116.2116-0.4512-0.4262
0.14542.8863000.13973.4410-2.29110.93585.7320-95.5118-116.2778-0.4604-0.4355
0.13552.9264000.14713.3740-2.37390.93305.7479-95.6775-116.4117-0.4473-0.4225
0.11142.9765000.13973.4854-2.32220.93025.8076-95.5740-116.1889-0.4595-0.4345

Framework versions

  • —Transformers 4.35.0
  • —Pytorch 2.1.1+cu121
  • —Datasets 2.14.6
  • —Tokenizers 0.14.1