-
Notifications
You must be signed in to change notification settings - Fork 2k
Send over less data for document sets #5018
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
PR Summary
This PR optimizes data transfer by introducing streamlined summary models (DocumentSetSummary, CCPairSummary, FederatedConnectorSummary) that reduce payload size when fetching document sets.
- Added new
DocumentSetSummary
Pydantic model inbackend/onyx/server/features/document_set/models.py
that provides a lightweight alternative to the full DocumentSet - Changed
list_document_sets_for_user
endpoint inbackend/onyx/server/features/document_set/api.py
to return summary models instead of full data - Updated frontend components in
web/src/app/admin/documents/sets/
to use new summary types while maintaining existing functionality - Ensured backward compatibility in
SlackChannelConfigFormFields
by handling both old and new data structures - Removed verbose metadata from connector displays while preserving essential fields (id, name, source, access_type)
10 files reviewed, 3 comments
Edit PR Review Bot Settings | Greptile
web/src/app/admin/bots/[bot-id]/channels/SlackChannelConfigFormFields.tsx
Outdated
Show resolved
Hide resolved
* Send over less data for document sets * Fix type errors * Fix tests * Fixes * Don't change packages
* Send over less data for document sets * Fix type errors * Fix tests * Fixes * Don't change packages
Description
Fixes https://linear.app/danswer/issue/DAN-2174/send-over-less-data-in-managedocument-set
How Has This Been Tested?
Verified normal behavior locally.
Backporting (check the box to trigger backport action)
Note: You have to check that the action passes, otherwise resolve the conflicts manually and tag the patches.