correctly cast timeout for grace period seconds (#850)#6753
Draft
correctly cast timeout for grace period seconds (#850)#6753
Conversation
## Overview some v2 pods in demo were stuck in terminating. This was due to the deletionTimeStamp being in the far future due to terminationGracePeriodSeconds being set to 3600000000000 ## Test Plan ran locally ## Rollout Plan (if applicable) managed-all ## Upstream Changes Should this change be upstreamed to OSS (flyteorg/flyte)? If not, please uncheck this box, which is used for auditing. Note, it is the responsibility of each developer to actually upstream their changes. See [this guide](https://unionai.atlassian.net/wiki/spaces/ENG/pages/447610883/Flyte+-+Union+Cloud+Development+Runbook/#When-are-versions-updated%3F). - [x] To be upstreamed to OSS ## Issue fixes: https://linear.app/unionai/issue/BB-6136/demo-pods-stuck-terminating ## Checklist * [ ] Added tests * [ ] Ran a deploy dry run and shared the terraform plan * [ ] Added logging and metrics * [ ] Updated [dashboards](https://unionai.grafana.net/dashboards) and [alerts](https://unionai.grafana.net/alerting/list) * [ ] Updated documentation Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>
Collaborator
|
Bito Automatic Review Skipped - Draft PR |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## master #6753 +/- ##
=======================================
Coverage 59.71% 59.72%
=======================================
Files 929 929
Lines 58011 58012 +1
=======================================
+ Hits 34642 34646 +4
+ Misses 20214 20211 -3
Partials 3155 3155
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why are the changes needed?
pods can get stuck in terminating essentially indefinitely due to terminationGracePeriodSeconds getting incorrectly cast from the config value
What changes were proposed in this pull request?
correctly cast config value for terminationGracePeriodSeconds
How was this patch tested?
has been running in Union clusters for a while
Labels
Please add one or more of the following labels to categorize your PR:
This is important to improve the readability of release notes.
Setup process
Screenshots
Check all the applicable boxes
Related PRs
Docs link