No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from AtomicChat/Qwen3.5-4B-DFlash-GGUF
All models by AtomicChat →
Qwen3.5 4B Dflash, self-quantized to GGUF by Atomic Chat. Built straight from Z Lab's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline.
[!NOTE] These GGUFs are self-quantized from the original weights, not a repack. The importance matrix keeps low-bit quants closer to the full-precision model.
[!IMPORTANT] Always pass
--jinjaso the Qwen3.5 4B Dflash chat template is applied. Without it the model can emit malformed turns.
[!TIP] Pick the largest file that fits your (V)RAM with room for context.
Q8_0is the sweet spot for most setups;Q6_KorQ8_0for maximum fidelity.
Run Qwen3.5 4B Dflash locally with:
AtomicChat/Qwen3.5-4B-DFlash-GGUF, pick a quant, hit Use this model.llama-server -hf AtomicChat/Qwen3.5-4B-DFlash-GGUF:Q8_0 --jinja -c 8192ollama run hf.co/AtomicChat/Qwen3.5-4B-DFlash-GGUF:Q8_0The base model card does not state sampling defaults.
z-lab/Qwen3.5-4B-DFlash (original weights).--imatrix.Original model by Z Lab, released under the Apache 2.0 license. Quantized by Atomic Chat.
git clone https://github.com/ggml-org/llama.cppcmake llama.cpp -B llama.cpp/build -DBUILD_SHARED_LIBS=OFF -DGGML_CUDA=ONcmake --build llama.cpp/build --config Release -j --target llama-cli llama-server./llama.cpp/build/bin/llama-server \ -hf AtomicChat/Qwen3.5-4B-DFlash-GGUF:Q8_0 \ --jinja -ngl 99 -c 8192 -fa on