smollm

🪐 A family of small models with 135M, 360M, and 1.7B parameters, trained on a new high-quality dataset.

135m 360m 1.7b

84.5K 3 months ago

94 Tags

Readme

SmolLM is a series of small language models available in three sizes: 135M, 360M, and 1.7B parameters.

References

Blog post

Hugging Face