No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from SC117/Qwen3.8-27B-Uncensored-FIT-GGUF
All models by SC117 →Fourteen continuous-size GGUF quantizations — every file exactly its predicted size, every tier measured.
English · 简体中文 📖
Every file in this repository was planned, executed and verified by FIT-GGUF, an open-source, deterministic tensor-level planning layer on top of llama.cpp quantization presets. Standard GGUF quantization asks you to pick one of a handful of presets; FIT-GGUF starts from the largest supported preset below your requested byte budget, then spends the remaining bytes on deterministic tensor-level precision upgrades.
Traditional GGUF gives you presets. FIT gives you a size slider.
The method, the full preregistered research record and the fit CLI are open source: github.com/Scorp1o117/FIT-GGUF
The source model is an abliterated, refusal-removed model with no meaningful built-in guardrails, and may comply with harmful, illegal or unsafe requests. Use it only where you can provide appropriate moderation, access control and legal review. Do not deploy it to end users without your own safety layer.
源模型经过拒答方向移除，不具备可靠的内置安全护栏；请仅在合法、受控、具备审核与滥用防护的环境中使用，使用者自行承担部署责任。
FIT-12G means a 12 GiB budget for the main GGUF file — not total RAM/VRAM usage. KV cache, compute buffers, runtime overhead and the multimodal projector are separate. G = GiB (2³⁰ bytes). Naming: Qwen3.8-27B-Uncensored-FIT-<tier>-<dominant>.gguf
MTP removed: every quantization in this repository ships without the NextN/MTP head (the source was converted with --no-nextn). MTP-based speculative decoding is therefore not available with these files; text and vision inference are unaffected.
Quick picks
All numbers are protocol-scoped observations (five fixed 64 KiB domains vs aligned BF16), not an application benchmark or a universal ranking.
Measured quality improves monotonically across all 14 tiers (macro KL 1.1327 → … → 0.0838), and in the 8–10 GiB region every FIT tier beats its surrounding llama.cpp default presets: FIT-8G / FIT-8.5G beat IQ2_XXS, FIT-9.5G beats Q2_K_S, FIT-10G beats Q2_K. Superseded early recipes (the P5/P6 repairs) are retained in the research record as evidence, not hidden.
Full-size KL · 中文大图 · Same-top · Allocation repair · Target utilization
llama.cpp (text)
./llama-cli \ -m Qwen3.8-27B-Uncensored-FIT-12G-IQ3_S.gguf \ -ngl 99 \ -c 8192 \ -cnv
llama-server (text + vision)
./llama-server \ -m Qwen3.8-27B-Uncensored-FIT-12G-IQ3_S.gguf \ --mmproj mmproj-Qwen3.8-27B-Uncensored-BF16.gguf \ -ngl 99 -c 8192
Any llama.cpp-based runner (llama-cli, llama-server, LM Studio, KoboldCpp, Jan, …) loads these files directly. The BF16 projector pairs with any tier. Pick -ngl, context and batch for your hardware — and remember the GGUF file size alone is not a RAM/VRAM requirement calculator.
Size accuracy: all 14 artifacts matched their post-oracle predicted byte sizes exactly; most use >99.98% of the requested target (FIT-11.5G: 99.427%, the 67.5 MiB reported as target slack — llama.cpp counter-based preset rules shift when manual overrides bypass parts of preset selection; the planner detects this via an override-aware dry-run oracle).
Allocator scope: the balanced v0.1b policy has positive holdout evidence on the development architecture at some budgets but did not beat matched random allocation on a second model family. This release claims deterministic target-size planning and reports measured quality for these specific artifacts — it does not claim a universally optimal allocation.
✅ 14 quantized main language-model GGUFs · ✅ BF16 multimodal projector mmproj-Qwen3.8-27B-Uncensored-BF16.gguf (vision, pairs with any tier) · per-tier plan, effective recipe, tensor override file and quantize record (fit-plans/) · full metrics (results/p4-results.json) · checksums (results/SHA256SUMS)
❌ The auxiliary NextN/MTP head was excluded from the source conversion (--no-nextn).
The original abliteration belongs to OrcaRouter; this repository contributes the FIT quantization plans and artifacts only.
sha256sum -c results/SHA256SUMS
Evaluation slices, evaluation logs and the complete decision record live in the FIT-GGUF repository. Exact-size behavior is scoped to the recorded source metadata and pinned llama.cpp build; changing the converter, runtime, source layout or metadata requires revalidation.
Apache-2.0, inherited from the base model — follow the upstream license and model-card requirements.
OrcaRouter — abliterated BF16 source weights · Qwen — the original model family · llama.cpp — GGUF tooling and runtime · Unsloth calibration dataset lineage — imatrix (1,251 chunks, reused from the same-architecture lineage). FIT-GGUF is an independent project, not affiliated with Qwen, Alibaba, OrcaRouter or llama.cpp.