nico248000000000/Qwen3.8-27B-Uncensored-FP8-nuclei

Qwen3.8-27B-Uncensored-FP8-nuclei

Instruction-tuned nuclei assistant to generate from CVE / exploit a nuclei script

LoRA/QLoRA fine-tune of the base model on a nuclei SFT dataset.

What changed vs the reference

Reference = the published base checkpoint `orcarouter/Qwen3.8-27B-Uncensored-FP8`, plus the first in-run loss (LoRA ≈ 0 at step 0).

The first logged train loss is the closest in-run proxy for the base model (LoRA starts near zero). Option F, when executed, adds an independent holdout comparison against the frozen merged base.

Training data

• —File: dataset_nuclei.jsonl
• —Split: 0.01 holdout, seed 42
• —Format: chat-templated SFT (messages / instruction+output / ### Instruction + ### Response)

Training procedure

Intended use

Domain Q&A and drafting in the training domain.

Out of scope: Anything outside the training domain or that requires certification.

Multimodal

Kept towers: vision, video. Vision/audio layers were frozen during text SFT (vision=False, audio=False). Load the merged Transformers folder (or GGUF + mmproj) to keep image / video / audio.

How to use

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

repo = "nico248000000000/Qwen3.8-27B-Uncensored-FP8-nuclei"
tok = AutoTokenizer.from_pretrained(repo, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    repo, torch_dtype=torch.bfloat16, device_map="auto", trust_remote_code=True,
)
messages = [{"role": "user", "content": 'How do you design a reliable Zero Trust infrastructure? Answer with a concrete control list.'}]
inputs = tok.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
print(tok.decode(model.generate(inputs, max_new_tokens=256)[0], skip_special_tokens=True))

Limitations

• —Domain shift: quality drops outside the SFT topics.
• —Eval above is holdout loss (and optional targeted checks). It is not a public leaderboard.
• —The base model license and acceptable-use policy still apply.

License

other — inherit and respect the license of orcarouter/Qwen3.8-27B-Uncensored-FP8.