Implement ELLA for SD1.5

[ily-R]

This is my draft PR for the bounty ELLA for SD1.5. I implemented and tested the architecture. I have few steps left.

• Implement ELLA
• Test the adapter's inject/eject
• implement the weight conversion script for these weights
• test ELLA contribution to SD1.5 model using t5_xl text_embeddings from here

[limiteinductive]

Thanks for the great work.

I made my first round of essentially stylistic nits. I haven't made an e2e test, but verified that conversion is working.

Could you also apply lint using rye fmt and verify typing with rye run pyright?

[github-actions]

This bounty is stale because it has been opened for 7 days with no activity.

[Laurent2916]

Hey @ily-R, this looks better!
Do you see anything else @limiteinductive ?
I'll run the tests tomorrow

[Laurent2916]

I've run the tests, beside the fact that sentencepiece was missing from the dependencies, the 3 tests are green.

[limiteinductive]

I have nothing to add (except linting and rebase); @deltheil, could you have a final look? Also, what about the sentencepiece dependency?

[github-actions]

This bounty is stale because it has been opened for 7 days with no activity.

[deltheil]

I have nothing to add (except linting and rebase);

That's great!

@deltheil, could you have a final look?

OK, stay tuned.

Also, what about the sentencepiece dependency?

@limiteinductive where is it used? ("[...] beside the fact that sentencepiece was missing from the dependencies, the 3 tests are green")

[Laurent2916]

Hi @ily-R, final nits before we merge:

• could you please add sentencepiece as a test dependency
• because of a recent PR, there a small conflict in src/refiners/foundationals/latent_diffusion/stable_diffusion_1/__init__.py, could please resolve it

[ily-R]

I rebased and did the necessary lint/format and added the sentencepiece as a test dependency . The tests are green.
Let me know if there is something to fix

[deltheil]

@ily-R sorry for the delay - I sent a few final nit-s, do you mind having a look? Also, please rebase and squash into a single commit. Thanks!

[deltheil]

Please take a look (last round I guess)

[deltheil]

@ily-R thanks for the quick turnaround. Some last suggestions (see above).

[limiteinductive]

LGTM