eljavatar/dynamtests_01_codet5p_src_fm_fc_dctx

1---2license: bsd-3-clause3base_model: Salesforce/codet5p-220m4tags:5- generated_from_trainer6model-index:7- name: dynamtests_01_codet5p_src_fm_fc_dctx8  results: []9---10 11<!-- This model card has been generated automatically according to the information the Trainer had access to. You12should probably proofread and complete it, then remove this comment. -->13 14# dynamtests_01_codet5p_src_fm_fc_dctx15 16This model is a fine-tuned version of [Salesforce/codet5p-220m](https://huggingface.co/Salesforce/codet5p-220m) on an unknown dataset.17 18## Model description19 20More information needed21 22## Intended uses & limitations23 24More information needed25 26## Training and evaluation data27 28More information needed29 30## Training procedure31 32### Training hyperparameters33 34The following hyperparameters were used during training:35- learning_rate: 2e-0536- train_batch_size: 837- eval_batch_size: 3238- seed: 4239- gradient_accumulation_steps: 840- total_train_batch_size: 6441- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0842- lr_scheduler_type: linear43- lr_scheduler_warmup_steps: 197444- num_epochs: 445- mixed_precision_training: Native AMP46 47### Framework versions48 49- Transformers 4.40.050- Pytorch 2.1.051- Datasets 3.0.052- Tokenizers 0.19.153