Skip to content

Commit 063b8d6

Browse files
evaline-judeclark1
evaline-ju
and
declark1
authored
✨ Chat completions batcher (#380)
* ✨✅ Initial chat completions batcher Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * ♻️✅ Chat completions batcher with out-of-order chunks Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * ✅ Different choice chunks test Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * 🧪 Detection batch test Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * 🧪 Switch chunk ordering Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * 🧪 Reverse chunk order to non-edge case Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * 💡 Add unit tests comments on edge case Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * 🎨💡 Clean up debug Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * 🔀 Merge with main Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * Update src/orchestrator/types/detection_batcher/chat_completion.rs Co-authored-by: Dan Clark <44146800+declark1@users.noreply.github.com> Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * 🏷️ Add ChoiceIndex type Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * ♻️ Use ChoiceIndex Co-authored-by: Dan Clark <44146800+declark1@users.noreply.github.com> Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> * ✅ Update tests with ChoiceIndex Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> --------- Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com> Co-authored-by: Dan Clark <44146800+declark1@users.noreply.github.com>
1 parent 9f66e5d commit 063b8d6

File tree

2 files changed

+564
-16
lines changed

2 files changed

+564
-16
lines changed

0 commit comments

Comments
 (0)