vllm-sr/Vela-1.0-Encoder-307M
- License
- mit
- Size
- not mirrored yet
No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from vllm-sr/Vela-1.0-Encoder-307M
All models by vllm-sr →No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from vllm-sr/Vela-1.0-Encoder-307M
All models by vllm-sr →Vela Base is a multilingual encoder foundation for specialized routing models.
307M parameters · Input capacity: 32,768 tokens, including special tokens.
Masked-token negative log-likelihood on the same multilingual development set, compared with the original mmBERT32K Base. Lower is better.
The 318 windows cover English, Chinese, German, French, Japanese and Arabic. Both models use FP32, identical fixed 15% masked-token targets, and complete inputs without truncation. This development set informed Vela checkpoint selection; it is not an independent test set.
With PyTorch and Transformers 4.57.6 or 5.17.0:
from transformers import pipeline
model_id = "vllm-sr/Vela-1.0-Encoder-307M"model = pipeline("fill-mask", model=model_id, device=-1)print(model(f"The capital of France is {model.tokenizer.mask_token}."))