Skip to content

Conversation

Weves
Copy link
Contributor

@Weves Weves commented Jul 12, 2025

Description

Fixes https://linear.app/danswer/issue/DAN-2174/send-over-less-data-in-managedocument-set

How Has This Been Tested?

Verified normal behavior locally.

Backporting (check the box to trigger backport action)

Note: You have to check that the action passes, otherwise resolve the conflicts manually and tag the patches.

  • This PR should be backported (make sure to check that the backport attempt succeeds)
  • [Optional] Override Linear Check

@Weves Weves requested a review from a team as a code owner July 12, 2025 22:42
Copy link

vercel bot commented Jul 12, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
internal-search ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 13, 2025 9:06pm

Copy link
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR Summary

This PR optimizes data transfer by introducing streamlined summary models (DocumentSetSummary, CCPairSummary, FederatedConnectorSummary) that reduce payload size when fetching document sets.

  • Added new DocumentSetSummary Pydantic model in backend/onyx/server/features/document_set/models.py that provides a lightweight alternative to the full DocumentSet
  • Changed list_document_sets_for_user endpoint in backend/onyx/server/features/document_set/api.py to return summary models instead of full data
  • Updated frontend components in web/src/app/admin/documents/sets/ to use new summary types while maintaining existing functionality
  • Ensured backward compatibility in SlackChannelConfigFormFields by handling both old and new data structures
  • Removed verbose metadata from connector displays while preserving essential fields (id, name, source, access_type)

10 files reviewed, 3 comments
Edit PR Review Bot Settings | Greptile

@raunakab raunakab added this pull request to the merge queue Jul 13, 2025
Merged via the queue into main with commit 8377ab3 Jul 13, 2025
12 of 14 checks passed
@raunakab raunakab deleted the simplify-document-set-model branch July 13, 2025 23:54
Weves added a commit that referenced this pull request Jul 15, 2025
* Send over less data for document sets

* Fix type errors

* Fix tests

* Fixes

* Don't change packages
AnkitTukatek pushed a commit to TukaTek/onyx that referenced this pull request Sep 23, 2025
* Send over less data for document sets

* Fix type errors

* Fix tests

* Fixes

* Don't change packages
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants