smollm:135m

263K 9 months ago

🪐 A family of small models with 135M, 360M, and 1.7B parameters, trained on a new high-quality dataset.

135m 360m 1.7b

9 months ago

b0b2a4617438 · 92MB

llama
·
135M
·
Q4_0
{ "stop": [ "<|im_start|>", "<|im_end|>" ], "temperature": 0.2, "top
Apache License Version 2.0, January 200
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user

Readme

SmolLM is a series of small language models available in three sizes: 135M, 360M, and 1.7B parameters.

References

Blog post

Hugging Face