feat(query): Inverted index support search Variant inner fields

[b41sh]

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

This PR improves inverted index support for VARIANT data:

1. Tantivy Upgrade: Upgraded the underlying Tantivy search engine to its latest version, bringing performance improvements and new features.
2. Tantivy Search Integration: Replaced custom search functions with Tantivy's search capabilities. This change delivers better query performance, though it may result in a slightly larger index file size, we can improve performance by caching index data locally.
3. Advanced VARIANT Field Search: Introduced the ability to perform complex searches within VARIANT internal fields, including AND, OR, IN, and Range queries. This allows for precise and flexible filtering of semi-structured data.

for example

CREATE OR REPLACE TABLE test (
  id INT NULL,
  data VARIANT NULL,
  INVERTED INDEX idx1 (data)
);

INSERT INTO test VALUES 
(1, '{"user":{"name":"Alice","age":20,"hobbies":["football","swimming"]}}'),
(2, '{"user":{"name":"Bob","age":25,"hobbies":["shopping","piano"]}}'),
(3, '{"user":{"name":"Tom","age":30,"hobbies":["travel","running"]}}');


SELECT * FROM test WHERE query('data.user.name:Bob AND data.user.age:25');
╭───────────────────────────────────────────────────────────────────────────────────╮
│        id       │                               data                              │
│ Nullable(Int32) │                        Nullable(Variant)                        │
├─────────────────┼─────────────────────────────────────────────────────────────────┤
│               2 │ {"user":{"age":25,"hobbies":["shopping","piano"],"name":"Bob"}} │
╰───────────────────────────────────────────────────────────────────────────────────╯

SELECT * FROM test WHERE query('data.user.name:Bob OR data.user.age:30');
╭───────────────────────────────────────────────────────────────────────────────────╮
│        id       │                               data                              │
│ Nullable(Int32) │                        Nullable(Variant)                        │
├─────────────────┼─────────────────────────────────────────────────────────────────┤
│               2 │ {"user":{"age":25,"hobbies":["shopping","piano"],"name":"Bob"}} │
│               3 │ {"user":{"age":30,"hobbies":["travel","running"],"name":"Tom"}} │
╰───────────────────────────────────────────────────────────────────────────────────╯

SELECT * FROM test WHERE query('data.user.hobbies: IN [football shopping]');
╭────────────────────────────────────────────────────────────────────────────────────────╮
│        id       │                                 data                                 │
│ Nullable(Int32) │                           Nullable(Variant)                          │
├─────────────────┼──────────────────────────────────────────────────────────────────────┤
│               1 │ {"user":{"age":20,"hobbies":["football","swimming"],"name":"Alice"}} │
│               2 │ {"user":{"age":25,"hobbies":["shopping","piano"],"name":"Bob"}}      │
╰────────────────────────────────────────────────────────────────────────────────────────╯

SELECT * FROM test WHERE query('data.user.age: [25 TO 30]');
╭───────────────────────────────────────────────────────────────────────────────────╮
│        id       │                               data                              │
│ Nullable(Int32) │                        Nullable(Variant)                        │
├─────────────────┼─────────────────────────────────────────────────────────────────┤
│               2 │ {"user":{"age":25,"hobbies":["shopping","piano"],"name":"Bob"}} │
│               3 │ {"user":{"age":30,"hobbies":["travel","running"],"name":"Tom"}} │
╰───────────────────────────────────────────────────────────────────────────────────╯

• part of: Feature: Enhanced Inverted Index Support for Nested Fields within Variant Type #18850

Tests

• Unit Test
• Logic Test
• Benchmark Test
• No Test - Explain why

Type of change

• Bug Fix (non-breaking change which fixes an issue)
• New Feature (non-breaking change which adds functionality)
• Breaking Change (fix or feature that could cause existing functionality not to work as expected)
• Documentation Update
• Refactoring
• Performance Improvement
• Other (please describe):

---

This change is 

[github-actions]

Docker Image for PR

• tag: pr-18861-c5331ec-1760855997

note: this image tag is only available for internal use.