tinyllama:1.1b-chat-v0.6-q3_K_L

3.3M 2 years ago

The TinyLlama project is an open endeavor to train a compact 1.1B Llama model on 3 trillion tokens.

1.1b

2 years ago

3dca23077eec · 593MB ·

model
llama
·
1.1B
·
Q3_K_L
system
You are a helpful AI assistant.
params
{ "stop": [ "<|system|>", "<|user|>", "<|assistant|>", "</s>"
template
<|system|> {{ .System }}</s> <|user|> {{ .Prompt }}</s> <|assistant|>

Readme

TinyLlama is a compact model with only 1.1B parameters. This compactness allows it to cater to a multitude of applications demanding a restricted computation and memory footprint.

References

Hugging Face

GitHub