Skip to content

feat: Add LLaDA 1.0/2.0 Diffusion Model Support#804

Draft
akkikiki wants to merge 7 commits intoml-explore:mainfrom
akkikiki:main
Draft

feat: Add LLaDA 1.0/2.0 Diffusion Model Support#804
akkikiki wants to merge 7 commits intoml-explore:mainfrom
akkikiki:main

Conversation

@akkikiki
Copy link

@akkikiki akkikiki commented Jan 24, 2026

Mostly vibe-coded to see if we should resume the previous threads/PRs on the diffusion lm threads.
CC: @awni @Goekdeniz-Guelmez @cavit99

Happy to contribute on top of #14 and/or #270 if that's appropriate but any suggestions?

@kernelpool
Copy link
Contributor

There's also #560 😀

@akkikiki
Copy link
Author

@kernelpool Obviously, I missed it 😀
Any plans for merging it soon?
There's more to build on it in addition to supporting models (e.g., kv-caching for block diffusion), and since SGLang is fully investing on supporting it at sgl-project/sglang#14199, I assume that there will be enough tractions?

@Goekdeniz-Guelmez
Copy link
Contributor

@akkikiki keep this pr open, the reason is that diffusion models need a careful, future-proof integration into mlx-lm. Eventually it will be merged, but will take its time. Keep this open and when the time is right, its getting merged :D

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

Comments