raincandy-u/Coder1.8-ORPO-TEST

Coder1.8-ORPO-TEST

Model Description

Test model for ORPO finetune method, trained on ~20k code examples for 1 epoch on 2 x A40 cards with 4-bit QLora (lora rank=lora alpha=16).

Disclaimer

This is a test model and may generate incorrect responses. Use at your own risk.

Train Details

• —Base: Qwen1.5-1.8B
• —Training Data: ~20k code examples
• —Epochs: 1
• —Method: ORPO
• —Hardware: 2 x A40
• —Quantization: 4-bit QLora
• —Lora Rank/Alpha: 16

Limitations

Limited training data and quantization may impact performance.

Join the Discussion

Have questions or feedback? Join our Discord server Here.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here