RadAlienware/outputs

1---2license: mit3library_name: peft4tags:5- trl6- sft7- unsloth8- generated_from_trainer9base_model: unsloth/phi-3-mini-4k-instruct-bnb-4bit10model-index:11- name: outputs12  results: []13---14 15<!-- This model card has been generated automatically according to the information the Trainer had access to. You16should probably proofread and complete it, then remove this comment. -->17 18# outputs19 20This model is a fine-tuned version of [unsloth/phi-3-mini-4k-instruct-bnb-4bit](https://huggingface.co/unsloth/phi-3-mini-4k-instruct-bnb-4bit) on an unknown dataset.21 22## Model description23 24More information needed25 26## Intended uses & limitations27 28More information needed29 30## Training and evaluation data31 32More information needed33 34## Training procedure35 36### Training hyperparameters37 38The following hyperparameters were used during training:39- learning_rate: 0.000240- train_batch_size: 241- eval_batch_size: 842- seed: 340743- gradient_accumulation_steps: 444- total_train_batch_size: 845- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0846- lr_scheduler_type: linear47- lr_scheduler_warmup_steps: 548- training_steps: 6049 50### Training results51 52 53 54### Framework versions55 56- PEFT 0.11.157- Transformers 4.42.358- Pytorch 2.2.1+cu12159- Datasets 2.19.260- Tokenizers 0.19.1