Skip to content

Conversation

rkuo-danswer
Copy link
Contributor

Description

Fixes https://linear.app/danswer/issue/DAN-1935/fix-up-docker-image-caching-on-build.

How Has This Been Tested?

[Describe the tests you ran to verify your changes]

Backporting (check the box to trigger backport action)

Note: You have to check that the action passes, otherwise resolve the conflicts manually and tag the patches.

  • This PR should be backported (make sure to check that the backport attempt succeeds)
  • [Optional] Override Linear Check

Copy link

vercel bot commented May 1, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
internal-search ✅ Ready (Inspect) Visit Preview 💬 Add feedback May 3, 2025 0:40am

…ix/docker-cache-redux

# Conflicts:
#	.github/workflows/docker-build-push-web-container-on-tag.yml
@rkuo-danswer rkuo-danswer marked this pull request as ready for review May 1, 2025 23:36
@rkuo-danswer rkuo-danswer requested a review from a team as a code owner May 1, 2025 23:36
Copy link
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR Summary

This PR restores Docker layer caching functionality across multiple workflow files by implementing S3-based caching with proper platform-specific prefixes and deployment type separation.

  • Added DEPLOYMENT environment variable (cloud/standalone) in all workflow files to properly segment caches
  • Implemented platform-specific cache prefixing (e.g., backend-linux-amd64) to prevent cache conflicts between architectures
  • Removed/commented out no-cache: true directives that were preventing caching from working
  • Added proper matrix build support for linux/amd64 and linux/arm64 in backend container workflow
  • Fixed artifact naming patterns to include run IDs and prevent collisions between parallel builds

6 file(s) reviewed, 6 comment(s)
Edit PR Review Bot Settings | Greptile

@rkuo-danswer rkuo-danswer added this pull request to the merge queue May 5, 2025
Merged via the queue into main with commit 8231328 May 5, 2025
10 of 11 checks passed
@rkuo-danswer rkuo-danswer deleted the bugfix/docker-cache-redux branch May 5, 2025 17:46
ferdinandl007 pushed a commit to ferdinandl007/onyx that referenced this pull request May 8, 2025
* restore caching and fix up some prefixing

* try backend matrix build and fix artifact names

* need id

* add backslashes to be consistent

* fix no-cache

* leave docker tags to the meta action

* need checkout in merge

* add comment

* move spammy logs to debug status

* bunch of no-cache updates

* prefix

---------

Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
AnkitTukatek pushed a commit to TukaTek/onyx that referenced this pull request Sep 23, 2025
* restore caching and fix up some prefixing

* try backend matrix build and fix artifact names

* need id

* add backslashes to be consistent

* fix no-cache

* leave docker tags to the meta action

* need checkout in merge

* add comment

* move spammy logs to debug status

* bunch of no-cache updates

* prefix

---------

Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants