[AUTOCUT] Gradle Check Flaky Test Report for TieredSpilloverCacheStatsIT

[opensearch-ci-bot]

Flaky Test Report for TieredSpilloverCacheStatsIT

Noticed the TieredSpilloverCacheStatsIT has some flaky, failing tests that failed during post-merge actions.

Details

Git Reference	Merged Pull Request	Build Details	Test Name
0cbd848	18139	57455	org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testClosingShard
0dcb617	14160	40642	org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testStatsMatchOldApi
0fff808	14241	40860	org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testStatsMatchOldApi
1b36ee4	13926	40314	org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testStatsMatchOldApi
2f8cb07	13821	40754	org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testStatsMatchOldApi
3bb0b4a	14059	40115	org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testIndicesLevelAggregation
698f582	14344	41003	org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testStatsMatchOldApi
8af4647	14182	40937	org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testIndicesAndTierLevelAggregation
d2da9bb	14061	40216	org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testStatsMatchOldApi
d480027	14341	41019	org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testIndicesLevelAggregation

The other pull requests, besides those involved in post-merge actions, that contain failing tests with the TieredSpilloverCacheStatsIT class are:

• 14659
• 15509
• 16111
• 16731
• 12982
• 13998
• 14104
• 17517
• 13172
• 13474
• 13568
• 13739
• 13772
• 13834
• 13917
• 14062
• 14089
• 14119
• 14136
• 14154
• 14155
• 14206
• 14216
• 14230
• 14264
• 14338
• 14339
• 14357
• 14360
• 14362
• 14391
• 14487
• 14749
• 16560
• 17370
• 17635
• 17843
• 17880
• 17889
• 17893
• 17950
• 18070
• 18106
• 18127

For more details on the failed tests refer to OpenSearch Gradle Check Metrics dashboard.

[getsaurabh02]

@sgup432 Can you take a stab at this?

[sgup432]

@peteralfonsi Can you check on this? Considering you resolved all of them earlier.

[peteralfonsi]

This issue has been solved by #14333. We are still seeing a couple failures, but I've been going through and all those failures are on PRs from branches that don't yet have the fix in them.

I think we can leave this issue open for a couple more days so that people who have outstanding PRs without the fix in them can refer to it, and then close it assuming no actual new failures happen.

[prudhvigodithi]

Closing this issue as no new tests are added or PR's impacted, will allow the automation to re-open or create a new issue if seen failures with TieredSpilloverCacheStatsIT.
Thanks
@getsaurabh02 @andrross @reta @peteralfonsi @sgup432

[andrross]

@peteralfonsi The latest failure is this:

REPRODUCE WITH: ./gradlew ':modules:cache-common:internalClusterTest' --tests "org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testClosingShard" -Dtests.seed=F00F2D533575E581 -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=en-GI -Dtests.timezone=Pacific/Majuro -Druntime.java=21

TieredSpilloverCacheStatsIT > testClosingShard FAILED
    java.lang.AssertionError: expected:<hit_count=0, miss_count=0, evictions=0, size_in_bytes=0, item_count=0> but was:<hit_count=14, miss_count=34, evictions=0, size_in_bytes=8316, item_count=12>
        at __randomizedtesting.SeedInfo.seed([F00F2D533575E581:534133F4D1E78D2E]:0)
        at org.junit.Assert.fail(Assert.java:89)
        at org.junit.Assert.failNotEquals(Assert.java:835)
        at org.junit.Assert.assertEquals(Assert.java:120)
        at org.junit.Assert.assertEquals(Assert.java:146)
        at org.opensearch.cache.common.tier.TieredSpilloverCacheStatsIT.testClosingShard(TieredSpilloverCacheStatsIT.java:433)

[peteralfonsi]

Strange, the relevant code shouldn't have changed recently. I'll take a look.