No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF
All models by HauhauCS →HauhauCS FastMTP: up to 3.02x document TG and 1.93x reasoning TG versus non-MTP — plus up to 35.2% more document TG and 21.1% more reasoning TG than standard embedded MTP.
Join the Discord for updates, roadmaps, projects, or just to chat.
Qwen3.8-27B uncensored by HauhauCS 0/465 Refusals* .
This is the Aggressive variant: direct answers, no refusal behavior, and minimal preamble on hard prompts.
Every text GGUF preserves Qwen3.8's native NextN head, and this release adds HauhauCS FastMTP: a specific acceleration sidecar qualified across the complete quant lineup at maximum native context. Vision is included through the separate BF16 projector.
Hugging Face's Hardware Compatibility widget may not recognize K_P quants. If files appear to be missing, click View variants or open Files and versions.
No changes to datasets or intended capabilities. This release preserves Qwen3.8-27B's text, reasoning, agentic, image, and video capabilities while applying the HauhauCS Aggressive uncensoring profile.
Pick Aggressive when you specifically want the model to get to the answer without first talking itself into compliance. For reliability-critical, specifically long-context agentic work, a Balanced release is normally the safer default when/if one is available.
BPW is the encoded tensor-payload average across the complete text model, including its embedded MTP tensors, rounded to two decimals. The projector and FastMTP sidecar work with every text quant; download the projector only for image or video input.
K_P ("Perfect") quants are HauhauCS custom quantizations that use model-specific analysis to selectively preserve quality where it matters most. Every model gets its own optimized quantization profile.
A K_P quant effectively bumps quality up by one or two quant levels at only around 5–15% more size than the base quant. The files remain standard GGUFs and work with llama.cpp, LM Studio, and other GGUF-compatible runtimes with no special build or plugin.
Note: K_P quants may show as ? in LM Studio's quant column. This is a display issue only—the model loads and runs normally.
HauhauCS FastMTP is the custom, variant-specific acceleration profile built for this exact Aggressive release: a compact 32K draft sidecar and per-quant serving profiles qualified for TG, acceptance, maximum native context, and VRAM.
It delivers up to 3.02x document TG and 1.93x reasoning TG versus non-MTP, plus up to 35.2% more document TG and 21.1% more reasoning TG than the standard embedded-MTP profile. The unchanged full target verifies every drafted token, so FastMTP accelerates generation without replacing the target model or changing its answers. The construction and selection methodology is exclusive to HauhauCS releases.
The benchmark ladder:
These results were measured on one RTX PRO 6000 Blackwell 96 GB per isolated lane at 204800 configured context, full CUDA offload, --no-mmap, and the official reasoning sampler. FastMTP accelerates TG; PP is reported alongside it for a complete serving comparison.
There are two acceleration paths:
--spec-type draft-mtp in a current upstream llama.cpp build.Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-FastMTP-32K.gguf and the HauhauCS runtime patch below.The compact draft uses a standard GGUF d2t token map plus a minimal Qwen3.8 runtime consumer. Build it once. The example below uses CUDA; for ROCm/HIP or Vulkan, replace -DGGML_CUDA=ON with -DGGML_HIP=ON or -DGGML_VULKAN=ON. For CPU-only, omit the backend flag.
If draft loading reports expected 5120, 248320, got 5120, 32768, the FastMTP sidecar is correct but the executable is unpatched. Launch the freshly built ./build/bin/llama-server from this checkout.
Then serve any target quant with the one shared FastMTP sidecar:
Three-run medians for the uncached 9.8K-token document fixture and three-case means for reasoning. Every FastMTP result reproduced the corresponding embedded-MTP output hashes.
The full-window gate used the final scrubbed Q3_K_P and FastMTP files: 190,000 uncached prompt tokens plus 64 generated tokens completed at 1613.81 PP tok/s and 131.81 TG tok/s, with 92.0% draft acceptance and no truncation inside the configured maximum native context.
Single-run reference results from the final public files at a configured max token context, full CUDA offload, --no-mmap, the official thinking sampler, and embedded MTP. The workload used an uncached 9.8K-token document-continuation prompt followed by 512 generated tokens.
With HauhauCS FastMTP enabled, the final Q3_K_P reached 138.37 document TG and 87.95 reasoning TG on the same Ada—23.5% and 3.9% faster than the pinned Unsloth Q3 control.
From the official Qwen3.8-27B model card:
Thinking mode (default):
temperature=1.0top_p=0.95top_k=20min_p=0.0presence_penalty=0.0repetition_penalty=1.0reasoning_effort=xhigh for the deepest reasoningInstruct / non-thinking mode:
temperature=0.7top_p=0.80top_k=20min_p=0.0presence_penalty=1.5repetition_penalty=1.0enable_thinking=falseQwen3.8 supports xhigh, medium, and low reasoning effort. Thinking and preserved reasoning are enabled by default in the official model contract.
Important:
--jinja for the embedded chat template.262144.If your llama.cpp build does not recognize the reasoning or MTP flags, update it. Older builds may still load the GGUF but will not expose the full Qwen3.8 serving path.
Qwen3.8 uses thinking mode by default. Disable it when you want shorter, faster direct responses.
Example llama-server default for all requests:
Example per request through the OpenAI-compatible API:
Example for multi-turn agents, preserve prior reasoning context with:
? in UIs that do not recognize the suffixEvery GGUF is covered by the signed HauhauCS release manifest. Exact SHA-256 values identify byte-for-byte mirrors after renaming; canonical tensor fingerprints continue to identify HauhauCS tensors after metadata-only rewriting.
The FastMTP sidecar's exact file SHA-256 is 115e618e1f73cb50817ed5856f0551c6bf9c3d94df96f440eaca78dc63b8968b; its canonical tensor fingerprint is 49e248e799f169b6ccc6a8127b9300a95f06cf3d96a8353266f5d457e81d1c87. The public-key DER fingerprint is f7be4a2335582ab7b2e393ca1c40ce70e483f1492c0f57b8c6e05d8a7223833c.
Download HauhauCS-RELEASE-MANIFEST.json, its signature, FastMTP-PROVENANCE.json, its signature, and HauhauCS-FastMTP-Ed25519-PUBLIC.pem, then verify:
Qwen3.8-27B is released by Qwen under the Apache 2.0 license. This quantized Aggressive variant retains that license.
git clone https://github.com/ggerganov/llama.cppcd llama.cppgit checkout 4df29be4f4c3673f428170fda944a5b19f743bb8
curl -L -o HauhauCS-FastMTP-llama.cpp.patch \ https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF/resolve/main/HauhauCS-FastMTP-llama.cpp.patchgit apply --check HauhauCS-FastMTP-llama.cpp.patchgit apply HauhauCS-FastMTP-llama.cpp.patch
cmake -S . -B build -DGGML_CUDA=ON -DCMAKE_BUILD_TYPE=Releasecmake --build build --config Release -j"$(nproc)"MODEL=Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-Q4_K_P.ggufDRAFT=Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-FastMTP-32K.ggufDEPTH=3
CUDA_VISIBLE_DEVICES=0 ./build/bin/llama-server \ --model "$MODEL" \ --spec-draft-model "$DRAFT" \ --spec-draft-ngl all \ --spec-type draft-mtp \ --spec-draft-n-max "$DEPTH" \ --spec-draft-p-min 0 \ --ctx-size 204800 \ --parallel 1 \ --batch-size 2048 \ --ubatch-size 512 \ --n-gpu-layers all \ --split-mode none \ --flash-attn on \ --no-mmap \ --temp 1.0 \ --top-k 20 \ --top-p 0.95 \ --min-p 0 \ --presence-penalty 0 \ --repeat-penalty 1.0 \ --jinja \ --reasoning on \ --reasoning-effort xhigh \ --reasoning-preserve \ --reasoning-format deepseek \ --host 127.0.0.1 \ --port 8080--chat-template-kwargs '{"enable_thinking":false}'{ "model": "qwen3.8-27b-aggressive-q3", "messages": [{"role": "user", "content": "..."}], "chat_template_kwargs": {"enable_thinking": false}}{ "chat_template_kwargs": {"preserve_thinking": true}}openssl pkeyutl -verify -rawin -pubin \ -inkey HauhauCS-FastMTP-Ed25519-PUBLIC.pem \ -in FastMTP-PROVENANCE.json \ -sigfile FastMTP-PROVENANCE.json.sig
openssl pkeyutl -verify -rawin -pubin \ -inkey HauhauCS-FastMTP-Ed25519-PUBLIC.pem \ -in HauhauCS-RELEASE-MANIFEST.json \ -sigfile HauhauCS-RELEASE-MANIFEST.json.sig