An expansion of Llama 2 that specializes in integrating both general language understanding and domain-specific knowledge, particularly in programming and mathematics.
42.7K Pulls Updated 11 months ago
Updated 11 months ago
11 months ago
df774285c05f · 17GB
model
archllama
·
parameters8.36B
·
quantizationF16
17GB
template
<|system|>
{{ .System }}
<|user|>
{{ .Prompt }}
<|assistant|>
62B
params
{
"stop": [
"<|system|>",
"<|user|>",
"<|assistant|>"
]
}
81B
Readme
LLaMa-Pro is a version of the original LLaMa model enhanced by the addition of transformer blocks by Tencent Applied Research Center (ARC). This model specializes in integrating both general language understanding and domain-specific knowledge, particularly in programming and mathematics.