Skip to content

Commit 4184e37

Browse files
authored
move todo
1 parent 43f1b75 commit 4184e37

File tree

1 file changed

+0
-11
lines changed

1 file changed

+0
-11
lines changed

README.md

Lines changed: 0 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -155,17 +155,6 @@ loss.backward()
155155
sampled = model.generate_text_only(text[:, :1], 1024)
156156
```
157157

158-
## Todo
159-
160-
- [ ] use N-dimensional alibi with flex attention (configure for only certain amount of heads) for relative positions for any modality
161-
- [ ] test out modality only training on oxford flowers
162-
- [ ] given findings in pi-zero robotics foundation model, add mixture of experts for both attention and feedforward as options
163-
- [ ] able to turn off meta information and use fixed shape per modality
164-
- [ ] make kv caching work during sampling and add tests
165-
- [ ] add down/up sampling unets with skip connections, customizable per modality, with attention in the middle, as in simple diffusion paper
166-
- [ ] allow for rotary positions to be turned on for 1d modalities, so transfusion can be used for action generation across time
167-
- [ ] add a debug mode behind environment flag for preemptive shape error messages
168-
169158
## Citations
170159

171160
```bibtex

0 commit comments

Comments
 (0)