v1.2.712-nightly

What's Changed

Exciting New Features ✨

• feat(query): support left plan's from clause contains subquery by @forsaken628 in #17621

Thoughtful Bug Fix 🔧

• fix(query): to_date(9999-12-31, format_string) should success by @TCeason in #17652

Code Refactor 🎉

• refactor(query): Optimizations for Variant type column filter by @b41sh in #17646

Others 📒

• chore: calc rows per block for recluster by @zhyass in #17639

Full Changelog: v1.2.711-nightly...v1.2.712-nightly

v1.2.711-nightly

What's Changed

Exciting New Features ✨

• feat: impl function strip_null_value for Variant by @KKould in #17640

Thoughtful Bug Fix 🔧

• fix(query): to_date parse string with format should use UTC timezone by @TCeason in #17641
• fix(query): fix incorrect left mark join schema by @sundy-li in #17642
• fix: disk cache failed to build on macOS by @dantengsky in #17643
• fix(ddl): fix modify column data type null to not null failed by @b41sh in #17650

Code Refactor 🎉

• refactor: optimize file reading for disk-based cache on Unix by @dantengsky in #17638

Others 📒

• chore: optimize building bloom index for null by @zhyass in #17625
• chore: Add bendsave in release by @Xuanwo in #17644
• chore: Make sure bendsave is built while releasing by @Xuanwo in #17649
• chore: make error message when CTAS committing failed more user-friendly by @SkyFan2002 in #17645

Full Changelog: v1.2.710-nightly...v1.2.711-nightly

v1.2.710-nightly

What's Changed

Exciting New Features ✨

• feat: Enable test and doctest for all crates by @Xuanwo in #17633
• feat: Add bendsave which can backup and restore databend data by @Xuanwo in #17503

Others 📒

• chore: optimize show tables with multi catalogs by @TCeason in #17632

Full Changelog: v1.2.709-nightly...v1.2.710-nightly

v1.2.709-nightly

What's Changed

Exciting New Features ✨

• feat(query): add iceberg table functions by @sundy-li in #17626
• feat: heartbeat to avoid query result timeout. by @youngsofun in #17624

Thoughtful Bug Fix 🔧

• fix: trim object preix error by @SkyFan2002 in #17636

Code Refactor 🎉

• refactor(query): refactor json functions by @b41sh in #16840
• refactor(query): refactor test style by @sundy-li in #17630
• refactor: Improved Hilbert Clustering with Range Partition by @zhyass in #17424
• refactor: Unified query for hilbert and linear clustering information by @zhyass in #17618

Full Changelog: v1.2.708-nightly...v1.2.709-nightly

v1.2.708-nightly

What's Changed

Exciting New Features ✨

• feat(query): support create/drop table under iceberg catalog by @TCeason in #17619

Thoughtful Bug Fix 🔧

• fix(query): fix cast nested types cause panic by @b41sh in #17622
• fix(query): fix string view memory size calculate error by @b41sh in #17629

Full Changelog: v1.2.707-nightly...v1.2.708-nightly

v1.2.707-nightly

What's Changed

Exciting New Features ✨

• feat(query): add catalog stats api by @everpcpc in #17602

Thoughtful Bug Fix 🔧

• fix: tpcds spill test fail by @forsaken628 in #17597
• fix(query): fix comment display by @sundy-li in #17615

Code Refactor 🎉

• refactor(meta): upgrade OpenRaft to v0.10.0-alpha.9 by @drmingdrmer in #17612

Build/Testing/CI Infra Changes 🔌

• ci: upgrade tj-actions/changed-files to v46 by @everpcpc in #17613

Others 📒

• chore(cluster): remove useless debug log by @zhang2014 in #17614

Full Changelog: v1.2.706-nightly...v1.2.707-nightly

v1.2.706-nightly

What's Changed

Exciting New Features ✨

• feat: add table function fuse_vacuum2() by @SkyFan2002 in #16049
• feat: auto vacuum by @dantengsky in #17579
• feat(query): database dml for iceberg catalog by @sundy-li in #17578
• feat: UNPIVOT supports AS by @forsaken628 in #17595
• feat(query): bloom index support prune expr with simple casts by @forsaken628 in #17533

Thoughtful Bug Fix 🔧

• fix(storage): hilbert cluster information by @zhyass in #17577
• fix: tpcds Q69 fail by @forsaken628 in #17588
• fix(parser): allow reorder the task options in CREATE TASK/ALTER TASK by @flaneur2020 in #17537
• fix: parquet meta cache key should not use mtime. by @youngsofun in #17589
• fix(query): /v1/roles return all roles for account admin by @everpcpc in #17596
• fix(query): fix fold agg mismatch datatypes by @sundy-li in #17593
• fix: the output columns of cte related columns lack the columns required by cte itself by @KKould in #17576

Code Refactor 🎉

• refactor: add VirtualDataScheam to TableMeta by @KKould in #17591
• refactor: extract map-api and watcher to separate crates by @drmingdrmer in #17594
• refactor(meta): adopt external crate for shared state machine logic by @drmingdrmer in #17609
• refactor: move MatchSeq to external crate map-api by @drmingdrmer in #17610

Others 📒

• chore: add infer filter unit test by @BohuTANG in #17574
• chore(optimizer): deduplicate_join_condition unit tests by @BohuTANG in #17585
• chore: optimize sparse data read by @zhyass in #17581
• chore(optimizer): normalize_disjunctive_filter unit test by @BohuTANG in #17592
• chore(storage): add block file size by @zhyass in #17580
• chore(query): add udf script configs by @sundy-li in #17601
• chore(query): optimize show tables from iceberg catalog by @TCeason in #17603
• chore(meta): add meta-meta compatibility chart svg by @drmingdrmer in #17606
• chore(optimizer): add tpcds unit test for optimizer by @BohuTANG in #17605
• chore: update cast.rs by @eltociear in #17590
• chore(optimizer): snow_plan -> good_plan by @BohuTANG in #17611

New Contributors

• @eltociear made their first contribution in #17590

Full Changelog: v1.2.705-nightly...v1.2.706-nightly

v1.2.705-nightly

What's Changed

Exciting New Features ✨

• feat(query): support nondeterministic update by @forsaken628 in #17555
• feat: string_agg is compatible with multiple types as arguments instead of just String by @KKould in #17570

Thoughtful Bug Fix 🔧

• fix(query): fix incorrect domain folder by @sundy-li in #17549
• fix: The update in MERGE INTO was mistakenly optimized as a delete by @SkyFan2002 in #17571
• fix(query): show catalog support iceberg engine by @TCeason in #17569
• fix: session leak when execute explain pipeline in cluster mode by @dqhl76 in #17572

Others 📒

• chore: polish error message in CommitSink by @dantengsky in #17558
• chore: reorganize meta service watcher module by @drmingdrmer in #17557

Full Changelog: v1.2.704-nightly...v1.2.705-nightly

v1.2.704-nightly

What's Changed

Exciting New Features ✨

• feat(query): Supports folding of show grants results for roles and users by @TCeason in #17543
• feat(query): support query level spill setting by @zhang2014 in #17542
• feat: support WITHIN GROUP clause for AggregateFunction by @KKould in #17519
• feat(query): add catalog apis by @everpcpc in #17493
• feat: support load Avro Files. by @youngsofun in #17548
• feat(query): add api for users & roles by @everpcpc in #17553

Thoughtful Bug Fix 🔧

• fix: explain update sql panic by @zhyass in #17474
• fix(query): show roles rewrite kind is err by @TCeason in #17547
• fix: agg input does not match union output when subquery by @KKould in #17552
• fix: with recursive bind table panic by @KKould in #17554
• fix: parquet meta cache key include md5 or mtime or query_id. by @youngsofun in #17556

Code Refactor 🎉

• refactor(meta): simplify map key handling and improve naming consistency by @drmingdrmer in #17545

Build/Testing/CI Infra Changes 🔌

• ci: fix pack binaries by @everpcpc in #17544

Others 📒

• chore(query): siphash support generic types by @sundy-li in #17535
• chore(query): remove old sort spill by @forsaken628 in #17546

Full Changelog: v1.2.703-nightly...v1.2.704-nightly

v1.2.703-nightly

What's Changed

Exciting New Features ✨

• feat: support query metadata from parquet. by @youngsofun in #17527
• feat: skip reading empty files when load/query location. by @youngsofun in #17522
• feat(base): enhanced query-level memory management by @zhang2014 in #17358

Thoughtful Bug Fix 🔧

• fix(query): fix display ast with quoted comments by @sundy-li in #17529
• fix: ensure result correctness when enable pruning cache by @dqhl76 in #17524
• fix(query): user/role name not support \b and \f by @TCeason in #17530
• fix(query): ident role_name not support ' " \b \f in parse by @TCeason in #17534

Code Refactor 🎉

• refactor: remove timeout from snapshot hint refresh process by @dantengsky in #17532

Others 📒

• chore(query): allow arrow dictionary array into databend by @sundy-li in #17521
• chore(query): revert 17516 by @zhang2014 in #17539
• chore: rename EvalExpireTime to Expirable for better semantics by @drmingdrmer in #17540

Full Changelog: v1.2.702-nightly...v1.2.703-nightly