NeuronDS/CL_forecasting_foundation_model

1---2tags:3- generated_from_trainer4model-index:5- name: output6  results: []7---8 9<!-- This model card has been generated automatically according to the information the Trainer had access to. You10should probably proofread and complete it, then remove this comment. -->11 12# output13 14This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.15It achieves the following results on the evaluation set:16- Loss: 0.154217 18## Model description19 20More information needed21 22## Intended uses & limitations23 24More information needed25 26## Training and evaluation data27 28More information needed29 30## Training procedure31 32### Training hyperparameters33 34The following hyperparameters were used during training:35- learning_rate: 0.00136- train_batch_size: 6437- eval_batch_size: 6438- seed: 4239- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0840- lr_scheduler_type: linear41- num_epochs: 10042 43### Training results44 45| Training Loss | Epoch | Step  | Validation Loss |46|:-------------:|:-----:|:-----:|:---------------:|47| 0.2823        | 1.0   | 384   | 0.1897          |48| 0.2134        | 2.0   | 768   | 0.1762          |49| 0.1961        | 3.0   | 1152  | 0.1714          |50| 0.1855        | 4.0   | 1536  | 0.1693          |51| 0.1777        | 5.0   | 1920  | 0.1738          |52| 0.1713        | 6.0   | 2304  | 0.1674          |53| 0.1664        | 7.0   | 2688  | 0.1681          |54| 0.1613        | 8.0   | 3072  | 0.1733          |55| 0.1578        | 9.0   | 3456  | 0.1698          |56| 0.1542        | 10.0  | 3840  | 0.1622          |57| 0.1505        | 11.0  | 4224  | 0.1666          |58| 0.1475        | 12.0  | 4608  | 0.1655          |59| 0.1451        | 13.0  | 4992  | 0.1651          |60| 0.1426        | 14.0  | 5376  | 0.1646          |61| 0.1409        | 15.0  | 5760  | 0.1618          |62| 0.1385        | 16.0  | 6144  | 0.1617          |63| 0.1366        | 17.0  | 6528  | 0.1591          |64| 0.1347        | 18.0  | 6912  | 0.1628          |65| 0.1325        | 19.0  | 7296  | 0.1598          |66| 0.1313        | 20.0  | 7680  | 0.1606          |67| 0.1295        | 21.0  | 8064  | 0.1573          |68| 0.1285        | 22.0  | 8448  | 0.1587          |69| 0.1276        | 23.0  | 8832  | 0.1639          |70| 0.1258        | 24.0  | 9216  | 0.1608          |71| 0.1244        | 25.0  | 9600  | 0.1599          |72| 0.1234        | 26.0  | 9984  | 0.1584          |73| 0.1225        | 27.0  | 10368 | 0.1604          |74| 0.1214        | 28.0  | 10752 | 0.1570          |75| 0.1207        | 29.0  | 11136 | 0.1575          |76| 0.1195        | 30.0  | 11520 | 0.1563          |77| 0.1186        | 31.0  | 11904 | 0.1602          |78| 0.1177        | 32.0  | 12288 | 0.1595          |79| 0.1167        | 33.0  | 12672 | 0.1582          |80| 0.1159        | 34.0  | 13056 | 0.1556          |81| 0.1149        | 35.0  | 13440 | 0.1564          |82| 0.114         | 36.0  | 13824 | 0.1567          |83| 0.1132        | 37.0  | 14208 | 0.1551          |84| 0.1125        | 38.0  | 14592 | 0.1560          |85| 0.1113        | 39.0  | 14976 | 0.1537          |86| 0.1114        | 40.0  | 15360 | 0.1518          |87| 0.1103        | 41.0  | 15744 | 0.1585          |88| 0.1098        | 42.0  | 16128 | 0.1552          |89| 0.1094        | 43.0  | 16512 | 0.1533          |90| 0.1087        | 44.0  | 16896 | 0.1542          |91| 0.1081        | 45.0  | 17280 | 0.1505          |92| 0.1085        | 46.0  | 17664 | 0.1535          |93| 0.1075        | 47.0  | 18048 | 0.1526          |94| 0.1069        | 48.0  | 18432 | 0.1521          |95| 0.1067        | 49.0  | 18816 | 0.1532          |96| 0.1063        | 50.0  | 19200 | 0.1522          |97| 0.1056        | 51.0  | 19584 | 0.1522          |98| 0.1048        | 52.0  | 19968 | 0.1538          |99| 0.1048        | 53.0  | 20352 | 0.1534          |100| 0.1051        | 54.0  | 20736 | 0.1519          |101| 0.1045        | 55.0  | 21120 | 0.1542          |102 103 104### Framework versions105 106- Transformers 4.37.2107- Pytorch 2.2.0+cu121108- Datasets 2.17.0109- Tokenizers 0.15.2110