No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from inclusionAI/LLaDA2.2-mini
All models by inclusionAI →LLaDA2.2-mini is the lightweight variant of the agentic diffusion language model in the LLaDA2 series. Built upon the LLaDA2.0-mini architecture, it inherits the core innovations of the LLaDA2.2 series — Levenshtein Editing (introducing DELETE and INSERT control tokens) — enabling long-context tool calling, multi-turn interaction, and robust error correction, while maintaining a smaller parameter footprint and lower inference cost. For more details, please refer to our technical report.
The following table compares LLaDA2.0-mini, LLaDA2.1-mini, and LLaDA2.2-mini across General and Agentic capabilities.
Efficient 128K Diffusion Infrastructure: LLaDA2.2-mini extends the context window to 128K and introduces the Block Routing mechanism, which restricts MoE expert activation at the diffusion block level, enabling efficient long-context agentic tasks.
Levenshtein Editing: Introduces DELETE and INSERT control tokens, enabling diffusion decoding to edit sequence structure, remove redundant content, and create insertion points during parallel generation.
Agentic Reinforcement Learning: Proposes Levenshtein Editing ELBO-based Block-level Policy Optimization (L-EBPO), leveraging agentic environment rewards to train Levenshtein editing and error correction capabilities in multi-turn tool-use scenarios.
Lightweight & Efficient: With a total of 16B parameters and only 1.4B activated during inference, it significantly reduces computational cost while maintaining strong capabilities.
Key specifications of LLaDA2.2-mini:
DELETE, INSERTPlease ensure transformers>=5.2.0 and related dependencies are installed.
For optimal performance, we recommend the following configurations:
Sampling Parameters: Use block_length=32, temperature=0.0, top_p=None, top_k=None as stable defaults.
Denoising Threshold: Adjust threshold, editing_threshold, and max_post_steps based on the speed-quality trade-off for your use case. Lower thresholds can improve inference speed but may lead to repetitive or unstable outputs.
Output Length: For most queries, an output length of 32768 tokens is recommended.
Long-Context Agentic Tasks: For long-context tool calling and multi-turn agentic applications, we recommend using SGLang as the serving backend. Ensure the server configuration supports a 128K context window and the model's MoE diffusion inference requirements.
If you are in mainland China, we strongly recommend accessing our models via 🤖 ModelScope.
This project is licensed under the Apache License 2.0.
For any questions, collaboration opportunities, or feedback, please reach out to us via Hugging Face or submit an issue on our GitHub repository.
Join us in advancing open, efficient, and intelligent diffusion language models for agentic applications!
import torchfrom transformers import AutoModelForCausalLM, AutoTokenizer
model_path = "inclusionAI/LLaDA2.2-mini"
model = AutoModelForCausalLM.from_pretrained( model_path, trust_remote_code=True, device_map="auto",)model = model.to(torch.bfloat16)model.eval()
tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
prompt = "Calculate 1+5-28*0.5-200=?"input_ids = tokenizer.apply_chat_template( [{"role": "user", "content": prompt}], add_generation_prompt=True, tokenize=True, return_tensors="pt",).input_ids
generated_tokens = model.generate( inputs=input_ids, eos_early_stop=True, gen_length=512, block_length=32, threshold=0.5, editing_threshold=0.0, temperature=0.0,)
generated_answer = tokenizer.decode( generated_tokens[0], skip_special_tokens=True,)print(generated_answer)