dastrix/gemma-3-12b-lithology-ru

Gemma-3-12B Lithology Description (Russian)

LoRA adapter for google/gemma-3-12b-it fine-tuned on geological core lithology descriptions in Russian.

Model Description

This model generates professional lithological descriptions of drill core samples for mining/drilling operations. Trained on expert geological descriptions from the Zhosabay (Жосабай) deposit in Kazakhstan.

Training Details

Metrics

Usage

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import PeftModel

# Load base model and adapter
base_model = "google/gemma-3-12b-it"
adapter = "tauken/gemma-3-12b-lithology-ru"

tokenizer = AutoTokenizer.from_pretrained(base_model)
model = AutoModelForCausalLM.from_pretrained(
    base_model,
    torch_dtype=torch.bfloat16,
    device_map="auto"
)
model = PeftModel.from_pretrained(model, adapter)
model.eval()

# Generate description
prompt = "Ты опытный геолог-эксперт. Опиши литологию керна. Скважина: ZHS_028_25, интервал: 94.5-101.9м."
messages = [{"role": "user", "content": prompt}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)

with torch.no_grad():
    outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.7, do_sample=True)

response = tokenizer.decode(outputs[0][inputs['input_ids'].shape[1]:], skip_special_tokens=True)
print(response)

Example Output

Input: Скважина ZHS02825, интервал 94.5-101.9м

Output:

В интервале 94.5-101.9м: Андезитовые порфириты от темно-коричнево-зеленого до серого цвета
с зеленоватым оттенком. Структура порфировая, текстура массивная. Основная масса
скрытокристаллическая, порфировые включения выполнены плагиоклазом таблитчатых,
полуокруглых форм размерами до 5х12мм, составляющие около 40-50% от общей массы.

Породы слабо, умеренно трещиноватые в количестве до 5-7 трещин на п.м., преимущественно
ориентированные под углом 30-70° к оси керна. Вторичные изменения представлены слабым
окварцеванием и серицитизацией по массе.

Рудная минерализация выполнена пиритом в виде вкраплений по массе.

Output Structure

The model follows standard geological description format:

1. 1.Lithotype & Color - Rock type identification (андезитовые порфириты)
2. 2.Texture & Structure - Porphyritic structure, phenocryst description
3. 3.Fracturing - Fracture density per running meter, angles to core axis
4. 4.Secondary Alterations - Veining, alteration minerals (окварцевание, серицитизация)
5. 5.Mineralization - Ore minerals if present (пирит)
6. 6.Contacts - Description of boundaries with other intervals

Limitations

⚠️ Important limitations:

• —Text-only model - Does not process images (for VLM version, see upcoming release)
• —May occasionally hallucinate depth intervals outside the requested range
• —Quantitative estimates (sizes, percentages) may be approximate
• —Best used as an assistant with mandatory expert verification
• —Not production-ready for autonomous use

Training Data

Geological descriptions from Zhosabay copper-gold deposit (Kazakhstan):

• —Well intervals with detailed lithological descriptions in Russian
• —Expert-written by professional geologists
• —Rock types: andesite porphyrites, metasomatites, weathering crusts
• —Features: fracturing, veining, alteration, mineralization

Intended Use

✅ Recommended uses:

• —Drafting lithological descriptions for geologist review
• —Accelerating core logging workflows
• —Training geological terminology

❌ Not recommended:

• —Autonomous geological reporting without expert review
• —Critical mining decisions based solely on model output

License

This model inherits the Gemma license from the base model.

Citation

@misc{tauken-lithology-2025,
  author = {Tauken Team},
  title = {Gemma-3-12B Lithology Description Model},
  year = {2025},
  publisher = {HuggingFace},
  url = {https://huggingface.co/tauken/gemma-3-12b-lithology-ru}
}

Framework Versions

• —PEFT: 0.18.1
• —Transformers: 4.51+
• —PyTorch: 2.11.0
• —TRL: 0.27.0