No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from AtomicChat/gemma-4-31B-it-GGUF
All models by AtomicChat →
Gemma 4 31B, self-quantized to GGUF by Atomic Chat. Built straight from Google's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline.
[!NOTE] These GGUFs are self-quantized from the original weights, not a repack. The importance matrix keeps low-bit quants closer to the full-precision model.
[!IMPORTANT] Always pass
--jinjaso the Gemma 4 31B chat template is applied. Without it the model can emit malformed turns.
[!NOTE] Gemma 4 31B is multimodal. This repo ships the
mmproj-gemma4-31b-it-f16.ggufvision projector. With-hfit is pulled automatically; otherwise pass--mmproj. Usellama-mtmd-cliorllama-serverto feed images.
Scores are Google's published results for the base google/gemma-4-31B-it, not our own measurements. Quantization preserves the large majority of this; Q4_K_M and up stay close to full precision.
[!TIP] Pick the largest file that fits your (V)RAM with room for context.
Q4_K_MorUD-Q4_K_XLis the sweet spot for most setups;Q6_KorQ8_0for maximum fidelity.
Run Gemma 4 31B locally with:
AtomicChat/gemma-4-31B-it-GGUF, pick a quant, hit Use this model.llama-server -hf AtomicChat/gemma-4-31B-it-GGUF:Q4_K_M --jinja -c 8192ollama run hf.co/AtomicChat/gemma-4-31B-it-GGUF:Q4_K_MGoogle's recommended sampling configuration for google/gemma-4-31B-it. Pass images through llama-mtmd-cli or llama-server with the projector.
google/gemma-4-31B-it (original weights).imatrix-coding.gguf.--imatrix.UD-Q4_K_XL additionally pins the token-embedding and output tensors to Q8_0.Original model by Google, released under the Apache 2.0 license. Full terms: Apache 2.0. Quantized by Atomic Chat.
git clone https://github.com/ggml-org/llama.cppcmake llama.cpp -B llama.cpp/build -DBUILD_SHARED_LIBS=OFF -DGGML_CUDA=ONcmake --build llama.cpp/build --config Release -j --target llama-cli llama-server./llama.cpp/build/bin/llama-server \ -hf AtomicChat/gemma-4-31B-it-GGUF:Q4_K_M \ --jinja -ngl 99 -c 8192 -fa on