πͺ Qwopus3.6-27B-v2-MTP
MTP Release
Multi-Token Prediction reasoning model fine-tuned from Qwen3.6-27B
𧬠Trace Inversion & Negentropy
π§ 27B Parameters
β‘ Speculative Decoding
π οΈ Coding / DevOps / Math
π‘ What is Qwopus3.6-27B-v2-MTP?
πͺ Qwopus3.6-27B-v2-MTP is a speed-oriented reasoning release built on top of Qwen3.6-27B. It keeps the Qwopus line's focus on reconstructed reasoning traces, coding discipline, DevOps procedures, and mathematical derivations, while adding Multi-Token Prediction for faster generation. The goal is simple: preserve the depth and structure of a 27B reasoning model while making real interactive use noticeably faster.
β‘ MTP DecodingAuxiliary future-token prediction improves throughput on long reasoning, code, math, and strict-format prompts.
𧩠Structured ReasoningInherits the Qwopus training recipe built around reconstructed step-by-step reasoning trajectories.
π§ͺ GB10 TestedValidated on a 30-question local benchmark across Logic, Coding, DevOps, Math, and Edge tasks.
π Practical SpeedDesigned for workflows where strong answers matter, but waiting several extra minutes per task does not.
π‘ 1. Base Model, Training Library & Cooperation
π§ 1.1 Base Model Specifications (Qwen3.6-27B)
Qwen3.6-27B provides the dense 27B foundation for this release. Qwopus3.6-27B-v2-MTP focuses on preserving the base model's broad reasoning capability while tuning the output style toward stepwise analysis, tool-aware execution, and practical engineering answers.
π§ͺ 1.2 Hardware Cooperation & Joint Collaboration
This project is built in close collaboration with hardware engineer
Kyle Hessling, whose infrastructure and training support helped make stable 27B-scale experimentation possible.
πYou can follow him for hardware and model training updates on X / Twitter: @KyleHessling1
π¦₯ 1.3 Fine-tuning Framework (Unsloth)
The model training workflow is accelerated and memory-optimized with
Unsloth. Special thanks to the Unsloth team for making efficient large-model fine-tuning more accessible.
βοΈ 1.4 Custom MTP Heads Processing & Automation Tooling
This release features a custom splitting and merging methodology designed specifically for Qwen series Multi-Token Prediction (MTP) heads. The automation skill and complete processing pipeline scripts are open-sourced in
qwen-mtp-gguf.
πIf you find this toolkit helpful, please support the project by leaving a star on GitHub!
[!WARNING]
Community Release Notice: Qwopus3.6-27B-v2-MTP is an experimental community release intended for research, evaluation, and workflow exploration.
π 2. MTP Benchmark: Qwen3.6-27B vs Qwopus3.6-27B-v2-MTP
Performance Snapshot
Across a 30-question benchmark covering Logic, Coding, DevOps, Math, and Edge-format tasks, Qwopus3.6-27B-v2-MTP delivers a clear speed advantage over Qwen3.6-27B while producing a more compact overall answer stream. The benchmark is not just a raw throughput test: it includes long coding prompts, operational runbooks, math derivations, and strict constrained-output cases.
Overall Throughput
10.46 T/s
1.66x vs Qwen3.6-27B
Latency Saved
2.34 h
56.5% total time reduction
Token Efficiency
-27.7%
fewer completion tokens overall
Coverage
30 / 30
all benchmark prompts completed
- Speed: Qwopus3.6-27B-v2-MTP reaches 10.46 overall tokens/sec, compared with 6.29 tokens/sec for Qwen3.6-27B.
- Latency: total evaluation time drops from 14,901.69s to 6,487.81s, saving 8,413.88s across the full run.
- Output shape: MTP produces 67,862 completion tokens versus 93,802 from Qwen3.6-27B, giving a more compact overall response profile.
βοΈ 3. Test Environment & Configuration
- Compute platform: GB10 dedicated server platform.
- Evaluation format: same local GGUF server stack for both models.
- llama-server total context:
49152.
- Temperature / Top-p:
1.0 / 0.95.
- Max generated tokens: no explicit cap; generation is bounded by the request budget.
- Request format:
/v1/chat/completions with user content as text payload.
π 4. Full 30-Question Comparison
The table below keeps the benchmark concrete: every row compares the base Qwen3.6-27B run against the Qwopus MTP run on the same prompt. The strongest improvements appear in strict output, probability, DevOps configuration, and medium-length coding tasks, while a few prompts intentionally produce more detailed MTP answers.
π§ 5. Domain Reading
Logic
Logic prompts show a strong latency reduction, especially on the box-label puzzle and the HH-vs-TH stopping problem. The MTP model tends to reach the same kind of structured decision path with fewer generated tokens, making it useful when reasoning traces need to stay readable and quick.
Coding
Coding is one of the most practical wins. Thread-safe caching, interval merging, CSV streaming, C++ LRU, SQL, and Bash backup tasks all become substantially faster. Q6 is intentionally more expansive, but the broader coding group remains much faster overall.
DevOps
DevOps prompts benefit from concise operational structure. Nginx, OOM diagnosis, systemd, Kubernetes rollback, Docker command semantics, and Prometheus monitoring all show faster completion while preserving stepwise command-oriented guidance.
Math & Edge Tasks
Math has the highest MTP throughput among the five domains. Edge tasks show the sharpest wall-clock wins, especially strict JSON and noisy-input filtering, where the model can quickly settle into the required output pattern.
π― 6. Recommended Use Cases
- Agentic coding and code review assistance.
- DevOps runbooks, configuration generation, and incident diagnosis.
- Multi-step math and probability derivations.
- Structured reasoning with explicit intermediate logic.
- Fast constrained output generation where latency matters.
Resources, Acknowledgements & Citation
π AcknowledgementsThanks to the Qwen team, Unsloth, open-source contributors, and Kyle Hessling for close collaboration on hardware and training infrastructure.