cs-file-uploads/ie-balanced-adapter

General-IE Baseline Adapter — Balanced (NER + RE + EE) (Gemma 3 27B)

LoRA adapter for google/gemma-3-27b-it trained with an IEInstruct-style balanced NER + relation + event extraction objective. Released as a general information-extraction baseline for the anonymous submission "From Lengthy Narrative to Structured Data: Instruction Fine-Tuning Open-Weight LLMs for Information Extraction from Corporate Disclosures."

On the paper's compensation-consultant task this generic-IE adapter reaches F1 85.2%, well below the domain-specific adapters (up to 96.1%) — evidence that task-specific fine-tuning outperforms generic IE instruction-tuning for this domain.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base = "google/gemma-3-27b-it"
tok = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(base, device_map="auto", load_in_4bit=True)
model = PeftModel.from_pretrained(model, "cs-file-uploads/ie-balanced-adapter")

License

Derived from Google Gemma 3; use is subject to the Gemma Terms of Use. Adapter weights are released for research use.

Citation

@misc{anonymous2026fromlengthy,
  title={From Lengthy Narrative to Structured Data: Instruction Fine-Tuning Open-Weight LLMs for Information Extraction from Corporate Disclosures},
  author={Anonymous},
  year={2026},
  note={Under review}
}