MistralLite is a fine-tuned model based on Mistral with enhanced capabilities of processing long contexts.
7b
28.2K Pulls Updated 14 months ago
Updated 14 months ago
14 months ago
7a3f8c87136f · 5.1GB
model
archllama
·
parameters7.24B
·
quantizationQ5_K_M
5.1GB
template
<|prompter|>{{ .System }} {{ .Prompt }}</s><|assistant|>
57B
params
{
"num_ctx": 32768,
"stop": [
"<|prompter|>",
"<|assistant|>",
"</s>
94B
Readme
Mistrallite is a fine-tuned model based on Mistral, with enhanced capabilities of processing long context (up to 32K tokens). This model is able to perform significantly better on several long context retrieve and answering tasks.