Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.

7b 141b

225.2K 7 months ago

Readme

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr 141B-A35B is the latest model in the series, and is a fine-tuned version of Mixtral 8x22b.

Sizes

  • zephyr:141b: A Mixture of Experts (MoE) model with 141B total parameters and 35B active parameters.
  • zephyr:7b: The original Zephyr model

Source: