RESP2 and RESP3 response unification

[petyaslavova]

RESP2/RESP3 Response Unification

This PR unifies the return types of Redis commands across RESP2 and RESP3 protocols, ensuring that application code receives consistent data structures regardless of which protocol version the client is connected with. Previously, many commands returned fundamentally different types — tuples vs lists, bytes vs strings, flat arrays vs nested structures — forcing users to write protocol-aware branching logic. After this change, RESP2 callbacks normalize responses to match RESP3 native types, making the protocol version an internal transport detail rather than a leaky abstraction.

Core Commands

Sorted set commands (ZRANGE, ZPOPMAX, ZSCORE, ZRANDMEMBER, ZRANK, ZSCAN, etc.) now consistently return [member, score] lists with float scores, and score_cast_func receives a float in both protocols instead of raw bytes in RESP2. Blocking pop commands (BLPOP, BRPOP, BZPOPMAX, BZPOPMIN) return lists instead of tuples. ZMPOP/BZMPOP scores are always float. HRANDFIELD with values returns [[field, value], ...] lists in both protocols. LCS with IDX returns a dict in RESP2, matching RESP3's native map. str_if_bytes wrapping has been removed from RESP2 callbacks where RESP3 already returns raw types, eliminating unnecessary encoding discrepancies.

Structural & Module Commands

Stream commands (XINFO STREAM, XREAD, XREADGROUP), geo commands (GEOSEARCH, GEORADIUS), and client tracking info now return matching structures across protocols. Sentinel commands normalize flags to set and masters to consistent dict shapes. Complex introspection commands (COMMAND, COMMAND INFO, ACL LOG, ACL GETUSER, MEMORY STATS, DEBUG OBJECT) received dedicated RESP3 parsers that produce the same shape as their RESP2 counterparts. Module commands across Bloom/Cuckoo/CMS/TopK/TDigest, TimeSeries, JSON, and Search all follow the same pattern — RESP3 parsers were added or aligned to produce identical output types.

Search Module Refactoring

The Search module received significant internal cleanup beyond response unification. A shared decode_field_value utility in redis/utils.py replaces five duplicated decode-or-preserve-bytes blocks across Result, hybrid parsers, and load_document. Callback registration was deduplicated by moving _RESP2_MODULE_CALLBACKS / _RESP3_MODULE_CALLBACKS construction into a shared _init_module_callbacks() method on SearchCommands, eliminating three identical 20-line blocks. The pipeline adapter callbacks (_search_response_callback, _aggregate_response_callback, _hybrid_response_callback) were removed entirely — _parse_results now handles pipeline options directly via functools.partial, with a guard clause for commands queued without a query object.

Testing

The test suite was substantially refactored to remove protocol-conditional assertions. Over 2,500 lines of duplicated @pytest.mark.parametrize("protocol", [2, 3]) branches and if protocol == 3: blocks were replaced with unified assertions that validate both protocols produce the same types. New tests cover score_cast_func with scientific notation, load_document with field_encodings, and edge cases across all affected command families. The net result is 42 files changed with ~2,600 lines removed, reflecting the elimination of both production-side protocol branching and test-side conditional logic.

This change includes a fix for issue #4021

---

Note

High Risk
High risk because it introduces widespread breaking return-type/structure changes across many core and module commands (e.g., tuples→lists, bytes→str, lists→dicts, flag lists→sets) and updates pipeline callback behavior, which can break downstream code and tests that relied on protocol-specific shapes.

Overview
Unifies RESP2 and RESP3 command responses so callers receive the same Python types/structures regardless of protocol, including sorted-set score pairs (now list[list[member, float]] with score_cast_func always receiving float), blocking pops (now lists), streams (XREAD/XREADGROUP now dicts), and other structural normalizations (e.g., LCS idx → dict, CLIENT TRACKINGINFO → dict, COMMAND.flags → set with optional acl_categories, Sentinel flags → set and RESP3 SENTINEL MASTERS → dict keyed by name).

Adds/updates parsers and callbacks for RESP3 parity (e.g., MEMORY STATS, ACL LOG, DEBUG OBJECT, CLUSTER LINKS, CLUSTER SHARDS key decoding) and normalizes geo coordinate outputs to lists.

Extends the same unification to modules: Bloom/TopK/TDigest INFO commands now always return *Info objects; fixes incorrect numeric coercion for TOPK.ADD/INCRBY/LIST; JSON normalizes NUMINCRBY/NUMMULTBY to list results, converts JSON.RESP float strings to native floats, and aligns JSON.TYPE missing-key handling; Search adds RESP3 parsing to return rich result objects and refactors module pipeline callback registration so module pipelines inherit full client.response_callbacks and post-process consistently.

^{Reviewed by Cursor Bugbot for commit e1de69d. Bugbot is set up for automated code reviews on this repo. Configure here.}

[jit-ci]

🛡️ Jit Security Scan Results

✅ No security findings were detected in this PR

---

^{Security scan by Jit}

[cursor]

Cursor Bugbot has reviewed your changes and found 1 potential issue.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, have a team admin enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit 2301f33. Configure here.}