michaelhhl/python-code-generate

1---2license: mit3base_model: gpt24tags:5- generated_from_trainer6model-index:7- name: python-code-generate8  results: []9---10 11<!-- This model card has been generated automatically according to the information the Trainer had access to. You12should probably proofread and complete it, then remove this comment. -->13 14# python-code-generate15 16This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.17 18## Model description19 20More information needed21 22## Intended uses & limitations23 24More information needed25 26## Training and evaluation data27 28More information needed29 30## Training procedure31 32### Training hyperparameters33 34The following hyperparameters were used during training:35- learning_rate: 0.000536- train_batch_size: 1037- eval_batch_size: 838- seed: 4239- gradient_accumulation_steps: 840- total_train_batch_size: 8041- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0842- lr_scheduler_type: cosine43- lr_scheduler_warmup_steps: 100044- num_epochs: 145 46### Training results47 48 49 50### Framework versions51 52- Transformers 4.31.053- Pytorch 2.0.1+cu11854- Datasets 2.14.455- Tokenizers 0.13.356