No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from drawais/DeepSeek-R1-Distill-Qwen-14B-AWQ-INT4
All models by drawais →INT4 weight-only quantization of deepseek-ai/DeepSeek-R1-Distill-Qwen-14B.
DeepSeek-R1 reasoning distilled into Qwen 14B, then INT4. About 9 GB on disk. Runs on a 12 GB consumer GPU.
~9.9 GB on disk. Recommended VRAM: enough headroom for KV cache.
This artifact is a derivative work of deepseek-ai/DeepSeek-R1-Distill-Qwen-14B,
released by its original authors under the MIT License.
This artifact is distributed under the same license. The full license text is
included in LICENSE [blocked], and required attribution is in NOTICE [blocked].
License text: https://opensource.org/license/mit Source model: https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
vllm serve drawais/DeepSeek-R1-Distill-Qwen-14B-AWQ-INT4 \ --max-model-len 32768 \ --gpu-memory-utilization 0.94from vllm import LLM, SamplingParamsllm = LLM(model="drawais/DeepSeek-R1-Distill-Qwen-14B-AWQ-INT4", max_model_len=32768)print(llm.generate(["Hello!"], SamplingParams(max_tokens=128))[0].outputs[0].text)