goaiguru/mistral-technical-docs

# Mistral Fine-tuned for Technical Documentation

This model is a fine-tuned version of Mistral-7B optimized for generating technical documentation.

## Model Details

• —Base model: mistralai/mistral-7b-v0.1
• —Fine-tuning: LoRA adaptation
• —Training data: Technical documentation from PyTorch, TensorFlow, scikit-learn, and pandas

## Usage

    from transformers import AutoModelForCausalLM, AutoTokenizer
    
    model = AutoModelForCausalLM.from_pretrained("goaiguru/mistral-technical-docs")
    tokenizer = AutoTokenizer.from_pretrained("goaiguru/mistral-technical-docs")

## Training Details

• —LoRA rank: 16
• —LoRA alpha: 32
• —Training epochs: 3
• —Batch size: 4
• —Learning rate: 2e-4