MegaDolphin-2.2-120b is a transformation of Dolphin-2.2-70b created by interleaving the model with itself.

120b

23.8K 11 months ago

Readme

MegaDolphin-120b was inspired by the amazing Goliath and Venus models. This model was created using a method of interleaving a model with itself.

References

Hugging Face