[proxy] introduce moka for the project-info cache

[conradludgate]

Problem

LKB-2502 The garbage collection of the project info cache is garbage.

What we observed: If we get unlucky, we might throw away a very hot entry if the cache is full. The GC loop is dependent on getting a lucky shard of the projects2ep table that clears a lot of cold entries. The GC does not take into account active use, and the interval it runs at is too sparse to do any good.

Can we switch to a proper cache implementation?

Complications:

1. We need to invalidate by project/account.
2. We need to expire based on retry_delay_ms.

Summary of changes

1. Replace retry_delay_ms: Duration with retry_at: Instant when deserializing.
2. Split the EndpointControls from the RoleControls into two different caches.
3. Introduce an expiry policy based on error retry info.
4. Introduce moka as a dependency, replacing our TimedLru.

See the follow up PR for changing all TimedLru instances to use moka: #12726.

[github-actions]

9031 tests run: 8381 passed, 0 failed, 650 skipped (full report)

---

Flaky tests (3)

Postgres 17

• test_ps_unavailable_after_delete[DeletionAPIKind.FORCE]: release-arm64-without-lfc
• test_pull_timeline_partial_segment_integrity: debug-x86-64-without-lfc

Postgres 16

• test_ps_unavailable_after_delete[DeletionAPIKind.FORCE]: release-arm64-with-lfc

Code coverage* (full report)

• functions: 34.8% (8796 of 25290 functions)
• lines: 45.8% (71313 of 155546 lines)

* collected from Rust tests only

---

_{The comment gets automatically updated with the latest test results
ef1c66b at 2025-07-25T10:37:41.766Z :recycle:}

[awarus]

Looks good!

[awarus]

Some time ago we removed theCacheOutcome for the these caches. Do we need to measure cache hit/miss for new cache implementation?

[conradludgate]

Some time ago we removed theCacheOutcome for the these caches. Do we need to measure cache hit/miss for new cache implementation?

Yeah, I'd like to reintroduce that - along with tracking how many items are in the caches. moka also lets you get notified when an item is removed so I think we can do something neat. Will make a follow up for that.

[kszafran]

🎉 🎉