rir-i/legacyagent-qwen3-asr-lora
LegacyAgent — Qwen3-ASR LoRA
A domain-adapted automatic speech recognition (ASR) model based on Qwen/Qwen3-ASR-1.7B-hf, fine-tuned with QLoRA on U.S. Supreme Court oral-argument audio.
The model focuses on improving transcription quality for legal and entity-heavy courtroom speech while keeping the number of trainable parameters small through parameter-efficient LoRA adaptation.
Model Details
Model Description
This model is a QLoRA fine-tuned version of Qwen/Qwen3-ASR-1.7B-hf for English courtroom speech.
The model was trained on U.S. Supreme Court oral-argument audio using a case-disjoint train/validation setup. The evaluation focuses both on overall transcription quality and entity-span recognition, where errors in names, organizations, legal terminology, and other important spans are particularly costly.
Model Details
- Developed by: Riri
- Funded by: Personal project
- Shared by: Riri
- Model type: Automatic Speech Recognition (ASR)
- Language(s): English
- License: See the base model license
- Finetuned from model:
Qwen/Qwen3-ASR-1.7B-hf
Model Sources
- Repository: https://github.com/Rupinder51120/LegacyAgent
- Paper: N/A
- Demo: N/A
Uses
Direct Use
The adapter can be used with the base Qwen3-ASR model for automatic transcription of English courtroom and legal-domain speech.
It is primarily intended for research and experimentation with domain-adapted ASR.
Downstream Use
The model can be integrated into ASR pipelines for:
- Legal and courtroom transcription
- Speech-to-text research
- Domain-specific ASR evaluation
- Entity-aware transcription systems
- Legal AI research workflows
Out-of-Scope Use
This model should not be used:
- As a replacement for official court transcripts
- As a source of authoritative legal records
- For making legal decisions without human verification
- In safety-critical applications without appropriate validation
- As a general-purpose ASR system for domains substantially different from courtroom speech
Bias, Risks, and Limitations
ASR systems can produce transcription errors caused by accents, speaker variation, recording quality, background noise, domain-specific terminology, and uncommon names.
Errors in legal names, organizations, citations, numbers, and other entities can be particularly consequential.
Performance outside U.S. Supreme Court oral-argument speech may differ from the reported benchmark results.
The reported evaluation should therefore be interpreted as a domain-specific benchmark rather than a guarantee of performance on unseen domains.
Recommendations
Users should verify important transcriptions against the original audio, particularly when the output contains names, legal terminology, numbers, quotations, or other legally significant information.
The model should be evaluated on the target deployment domain before being used in production.
How to Get Started with the Model
Install the required libraries:
pip install transformers peft bitsandbytes