refactor: simplify caches

[psteinroe]

fixes unbounded memory caches that could lead to oom issues. Document-level caches would accumulate indefinitely as users edited files.

replaced all DashMap usages with appropriate data structures based on access patterns:
Bounded Memory Caches (LRU):

• PgQueryStore: DashMap → Mutex<LruCache<1000>> - AST parsing cache
• TreeSitterStore: DashMap → Mutex<LruCache<1000>> - CST parsing cache
• AnnotationStore: DashMap → Mutex<LruCache<1000>> - Statement annotations cache

Read-Heavy Workloads (RwLock):

• SchemaCacheManager: DashMap → RwLock - Database schema cache
• ConnectionManager: DashMap → RwLock - Database connection pool cache
• WorkspaceServer.documents: DashMap → RwLock - Open document cache

[juleswritescode]

Nice :)

Document-level caches would accumulate indefinitely as users edited files.

I'm curious, is this a bug with the lib? Or what happens there?

[psteinroe]

Nice :)

Document-level caches would accumulate indefinitely as users edited files.

I'm curious, is this a bug with the lib? Or what happens there?

this is just a follow-up of the change refactoring. before, we were removing data from the parse caches (pg_query, treesitter) based on the statement changed and statement deleted events that the change handling emitted. Without that, we never delete any parsing results. if a user now starts typing, we keep every parse result of every statement change. this pr fixes that with the LRU cache.

I then researched a bit about dash map and replaced it in other places with a more suitable store.