Llama 4 support

[codestar12]

With the new Llama release it would be nice to support the new models.

[codestar12]

I know there is support for MoEs with Mixtral. I'm not sure how much of a lift it will take but I'm willing to help if people can point me in the right direction.

[bhimrazy]

@ysjprojects, Any thoughts on this?

[codestar12]

bump

[ysjprojects]

Will be looking into LLaMA-4's architecture in the next few days and giving my thoughts on them