You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I know there is support for MoEs with Mixtral. I'm not sure how much of a lift it will take but I'm willing to help if people can point me in the right direction.
With the new Llama release it would be nice to support the new models.
The text was updated successfully, but these errors were encountered: