No official torrent yet β requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from SC117/Ling-3.0-flash-abliterated-APEX-GGUF
All models by SC117 βEnglish | π δΈζζζ‘£
inclusionAI Ling-3.0-flash Β· 124B-A5.1B hybrid MoE Β· abliterix v6 trial 21 Β· APEX GGUF
Ling-3.0-flash is inclusionAI's next-generation native hybrid reasoning model: 124B total / 5.1B active (~12.4% of their previous 1T-class flagship). It uses a native hybrid-linear stack from pretraining β 5:1 Kimi Delta Attention (KDA) + gated MLA, 1/64 sparse MoE, 512 routed experts (top-8) + 1 shared expert, 2 dense layers, and a trained MTP head. Official context schedule is 8K β 32K β 256K. Thinking is on by default in the official card.
This community package is not an official inclusionAI release. It applies two extra steps on top of the official weights:
weight_normalization=full, LoRA rank 3, o_proj + down_proj only. This is the static merge, not the later runtime-only gate (v36).bailingmoe3.License: MIT (same family as the official model). Follow inclusionAI terms and local law.
After merging abliterix v6 trial 21, this model shows a much lower refusal rate and can differ from official Ling-3.0-flash. Evaluate compliance and safety for your use case; control access and audit as needed.
Implementation sketch: LoRA merge W += (B @ A) * (alpha / r) with MPOA full-norm rank 3 on o_proj + down_proj. Adapter path: Ling-3.0-flash-LoRA-Trial21-Refusals17-KL0.093.
Coding / agent ability is largely retained on Compact smoke; refusal and alignment behavior are changed. Official SWE / Tau / MCP tables were not re-run for this derivative.
These files use APEX-style MoE-aware mixed precision: precision follows tensor role + layer position (higher on edges, more aggressive in the middle).
This package is not I-tier (no imatrix). Common settings: 43 GGUF blocks (42 backbone + MTP blk.42); first 2 layers dense; routers ffn_gate_inp=Q8_0; MTP + nextn.eh_proj forced Q8_0; KDA/MLA tensor names as in llama.cpp bailingmoe3.
How to choose: start with Balanced if you have the RAM. Use Compact on 128 GB UMA (this is what we smoke-tested). Quality if you want IQ mid-experts and a smaller file than Balanced. Skip BF16 unless you are converting again.
These GGUFs are general.architecture = bailingmoe3. BailingMoE3 support (PR #26608) was merged into llama.cpp master on 2026-08-17 β the first release containing it is b10470. Use llama.cpp b10470 or newer (any release or master build from that date onward) to load these files directly. If you see unknown model architecture: 'bailingmoe3', your build is older than that β update. Do not mix with unofficial bailing-hybrid forks β the tensor names do not match.
Example (Compact, thinking off)
hf download SC117/Ling-3.0-flash-abliterated-APEX-GGUF \ --include "Ling-3.0-flash-abliterated-APEX-Compact.gguf" \ --local-dir ./models./llama-server
-m ./models/Ling-3.0-flash-abliterated-APEX-Compact.gguf
--port 8080
-sm none
--flash-attn on
--fit on
--ctx-size 32768
--reasoning off
--jinja
--host 0.0.0.0
temperature=0.6, top_p=0.95, top_k=20. Official HF/SGLang/vLLM path enables thinking by default; for llama.cpp eval we used --reasoning off so thinking does not eat the token budget.blk.42. This package was served with --spec-type none; speculative decode needs a build that understands Ling MTP.inclusionAI/Ling-3.0-flasho_proj + down_proj, MPOA rank 3)Ling-3.0-flash-abliteratedCommunity derivative (behavior edit + quantization). Not an official inclusionAI release. Use at your own risk; follow local law and the upstream MIT license.