No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from RedHatAI/Qwen3.8-2.4T-A95B-NVFP4
All models by RedHatAI →This is a quantized version of Qwen/Qwen3.8-2.4T-A95B with MoE layers quantized to NVFP4
This model is intended for deployment with vLLM. You can serve the model using
This model was quantized using LLM Compressor, see https://github.com/vllm-project/llm-compressor/blob/main/docs/key-models/qwen3.5/nvfp4-moe-example.md
vllm serve RedHatAI/Qwen3.8-2.4T-A95B-NVFP4 \ --tensor-parallel-size 8 \ --enable-expert-parallel 8 \ --reasoning-parser qwen3inspect eval hf/Idavidrein/gpqa/diamond --model vllm/RedHatAI/Qwen3.8-2.4T-A95B-NVFP4 --reasoning-effort xhigh --model-base-url http://localhost:8000/v1 -M client_timeout=2400 --token-limit 100000 --retry-on-error=2