No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from RedHatAI/Kimi-K3-NVFP4
All models by RedHatAI →This is a quantized version of moonshotai/Kimi-K3 with MoE layers quantized to NVFP4 for accelerated inference.
This model is intended for deployment with vLLM. You can serve the model using
May require https://github.com/vllm-project/vllm/pull/50500 to run
This model was compressed using LLM Compressor. For more information, please contact Kyle Sayers via the vLLM Developers Slack or ksayers@redhat.com.
vllm serve RedHatAI/Kimi-K3-NVFP4 \ --tensor-parallel-size 8 \ --trust_remote_code \ --load-format instanttensor \ --reasoning-parser kimi_k3 \ --language-model-only # optionalinspect eval hf/Idavidrein/gpqa/diamond \ --model vllm/RedHatAI/Kimi-K3-NVFP4 \ --reasoning-effort high \ --model-base-url http://localhost:8000/v1