VextLabsinc/gem-ruby

1---2license: apache-2.03base_model: VextLabsinc/juwel-beryl4library_name: peft5pipeline_tag: text-generation6tags:7  - juwel8  - gem9  - gem-ruby10  - code11  - lora12  - vext13---14 15> **Both halves of this model are on the Hub.** The adapter weights live in this repo and the required base is [`VextLabsinc/juwel-beryl`](https://huggingface.co/VextLabsinc/juwel-beryl) (80-layer, BF16). Load the base with `AutoModelForImageTextToText`, then apply this adapter.16 17# GEM Ruby · code specialist18 19<!--20Template for every public open-weight release.21Fill on the GPU pod before huggingface-cli upload.22Never claim first/all weights / AGI / never-forgets / cheapest-ever.23-->24 25**Model id:** `VextLabsinc/gem-ruby`  26**Org:** Vext Labs, Inc.  27**License:** Apache-2.0 (see `LICENSE`) — **AS IS, no warranty**  28**Library:** `peft`  <!-- peft | transformers -->  29**Pipeline:** text-generation  30 31## Base model32 33- **Required base:** `VextLabsinc/juwel-beryl`  34- **Architecture notes:** Base = JUWEL Beryl (80-layer, hidden 5120, 64 heads, intermediate 25600; internal lineage theron-base-v9 + one CIP rung). This PEFT LoRA is **native to that 80-layer geometry** (`layers_to_transform` 0-79, r=64, alpha=128) — it is not padded and not drop-in on any other JUWEL base. Base architecture is `Qwen3VLForConditionalGeneration` (image-text-to-text), so load it with `AutoModelForImageTextToText`, not `AutoModelForCausalLM`.  35- **Base license / attribution:** see `NOTICE`  36 37If this is a **LoRA / PEFT adapter**, load base first, then:38 39```python40from transformers import AutoModelForImageTextToText41from peft import PeftModel42base = AutoModelForImageTextToText.from_pretrained("VextLabsinc/juwel-beryl", torch_dtype="auto", device_map="auto")43model = PeftModel.from_pretrained(base, "VextLabsinc/gem-ruby")44```45 46## Intended use47 48- Research, education, and **authorized** professional workflows in the **code** domain.  49- Integration into systems where a human remains responsible for outcomes.  50 51## Out of scope / prohibited uses52 53You may **not** use this model for:54 55- Unauthorized access to computer systems, networks, or accounts  56- Development or deployment of malware, ransomware, or fraud  57- Child sexual abuse material or any illegal content  58- Weapons development or violent crime  59- Any use that violates applicable law or third-party rights  60- For security-related models: testing only on systems you **own** or have **explicit written permission** to assess  61 62Vext Labs does **not** endorse misuse. Publishing weights is **not** permission to break the law.63 64## Limitations65 66- Outputs can be wrong, biased, or unsafe if misused.  67- Not a substitute for licensed professionals (medical, legal, financial, security).  68- Not guaranteed to refuse harmful requests; apply your own filters and policies.  69- Domain specialist adapter; quality varies by prompt.70 71## Training data (summary)72 73- Domain specialist continued training / LoRA on Theron lineage; see lab training docs. No customer confidential data intended.  74- **No** customer confidential data is intentionally included in this release package.  75- Downstream fine-tunes by third parties are **not** controlled by Vext Labs.76 77## Evaluation78 79- **Status:** PENDING — no reproducible benchmark published yet. Evals run on our OWN BF16 weights on a GPU pod (never a hosted API), then posted here with a full audit trail (raw responses, test cases, timestamps, model version). We publish no score we cannot reproduce on our own stack.  <!-- e.g. internal rubric 2026-04-02 | pending | public harness -->  80- **Numbers:** None yet — honest placeholder, not a hidden result. Benchmarks were blocked until 2026-07-28 by a base-identity error: these cards named a 144-layer base for an 80-layer adapter, so the adapter was not loadable as trained. The base identity is now corrected and evaluation is under way.  81- Do **not** treat internal rubrics as standardized public leaderboards (MMLU/HELM/etc.) unless re-run under a named public harness.82 83## Files / integrity84 85- Weight files: see repository file list  86- Checksums: `SHA256SUMS`  87- R2 source (internal): `s3://vext-theron-fleet/v10_loras_v9_padded/code/` (not a public download URL)88 89## Liability90 91These weights are provided **AS IS** under the `LICENSE`.  92To the maximum extent permitted by law, Vext Labs, Inc. disclaims all warranties and is **not liable** for damages arising from use or misuse of this model.  93You are solely responsible for compliance with law and for authorized use only.  94See also `USE_POLICY.md`.95 96## Contact97 98- Product / lab: https://vextlabs.ai · https://juwel.ai  99- Disclosure / questions: info@vextlabs.ai  100 101 102<!-- legal_tier: T1 -->103 104## Weights — download105 106- **Adapter (this model):** hosted in this HF repo — `adapter_model.safetensors` + `adapter_config.json`. Loads with `PeftModel.from_pretrained(base, "VextLabsinc/gem-ruby")`. (R2 mirror: https://pub-a6ae0476e46849f98f1746a61dc4c106.r2.dev/gem-ruby/)107- **Base (`juwel-beryl`, 80L, BF16):** on the Hub at https://huggingface.co/VextLabsinc/juwel-beryl — loads directly by repo id, no manual download needed.108