I want to add mamba_chat (2.8b) model

[SafeyahShemali]

Hello vllm Team,

havenhq/mamba-chat seems not supported with vllm. Will you be able to help me out to add it?

Sincerely,

[RonanKMcGovern]

+1 for this.

Would be big to have vLLM support for Mamba type models. I expect there will be even bigger Mamba models out soon.

[DarkLight1337]

FYI Jamba is now supported in vLLM (#4115), so it should be easier to implement this model now.

[K-Mistele]

+1 on Mamba models, Mistral just dropped a Mamba-based code model that looks awesome
https://mistral.ai/news/codestral-mamba/

[DarkLight1337]

I think this should be solved by #6484

[tlrmchlsmth]

Mamba support just landed (still TODO to support Mamba2, so Codestral Mamba is not yet supported)