Mixtral 8x7B
2024-01-08 · Publisher : Mistral AI · Domain : Artificial Intelligence
Mistral AI launches Mixtral 8x7B, an open-source Mixture of Experts model that rivals GPT-3.5. This model uses an innovative architecture that activates only 2 out of 8 experts per token, optimizing performance and efficiency.
Mistral AI launches Mixtral 8x7B, an open-source Mixture of Experts model that rivals GPT-3.5. This model uses an innovative architecture that activates only 2 out of 8 experts per token, optimizing performance and efficiency.
Links
Tags : LLM, Open Source, MoE, Mistral