v1.2.707-nightly

What's Changed

Exciting New Features ✨

• feat(query): add catalog stats api by @everpcpc in #17602

Thoughtful Bug Fix 🔧

• fix: tpcds spill test fail by @forsaken628 in #17597
• fix(query): fix comment display by @sundy-li in #17615

Code Refactor 🎉

• refactor(meta): upgrade OpenRaft to v0.10.0-alpha.9 by @drmingdrmer in #17612

Build/Testing/CI Infra Changes 🔌

• ci: upgrade tj-actions/changed-files to v46 by @everpcpc in #17613

Others 📒

• chore(cluster): remove useless debug log by @zhang2014 in #17614

Full Changelog: v1.2.706-nightly...v1.2.707-nightly

v1.2.706-nightly

What's Changed

Exciting New Features ✨

• feat: add table function fuse_vacuum2() by @SkyFan2002 in #16049
• feat: auto vacuum by @dantengsky in #17579
• feat(query): database dml for iceberg catalog by @sundy-li in #17578
• feat: UNPIVOT supports AS by @forsaken628 in #17595
• feat(query): bloom index support prune expr with simple casts by @forsaken628 in #17533

Thoughtful Bug Fix 🔧

• fix(storage): hilbert cluster information by @zhyass in #17577
• fix: tpcds Q69 fail by @forsaken628 in #17588
• fix(parser): allow reorder the task options in CREATE TASK/ALTER TASK by @flaneur2020 in #17537
• fix: parquet meta cache key should not use mtime. by @youngsofun in #17589
• fix(query): /v1/roles return all roles for account admin by @everpcpc in #17596
• fix(query): fix fold agg mismatch datatypes by @sundy-li in #17593
• fix: the output columns of cte related columns lack the columns required by cte itself by @KKould in #17576

Code Refactor 🎉

• refactor: add VirtualDataScheam to TableMeta by @KKould in #17591
• refactor: extract map-api and watcher to separate crates by @drmingdrmer in #17594
• refactor(meta): adopt external crate for shared state machine logic by @drmingdrmer in #17609
• refactor: move MatchSeq to external crate map-api by @drmingdrmer in #17610

Others 📒

• chore: add infer filter unit test by @BohuTANG in #17574
• chore(optimizer): deduplicate_join_condition unit tests by @BohuTANG in #17585
• chore: optimize sparse data read by @zhyass in #17581
• chore(optimizer): normalize_disjunctive_filter unit test by @BohuTANG in #17592
• chore(storage): add block file size by @zhyass in #17580
• chore(query): add udf script configs by @sundy-li in #17601
• chore(query): optimize show tables from iceberg catalog by @TCeason in #17603
• chore(meta): add meta-meta compatibility chart svg by @drmingdrmer in #17606
• chore(optimizer): add tpcds unit test for optimizer by @BohuTANG in #17605
• chore: update cast.rs by @eltociear in #17590
• chore(optimizer): snow_plan -> good_plan by @BohuTANG in #17611

New Contributors

• @eltociear made their first contribution in #17590

Full Changelog: v1.2.705-nightly...v1.2.706-nightly

v1.2.705-nightly

What's Changed

Exciting New Features ✨

• feat(query): support nondeterministic update by @forsaken628 in #17555
• feat: string_agg is compatible with multiple types as arguments instead of just String by @KKould in #17570

Thoughtful Bug Fix 🔧

• fix(query): fix incorrect domain folder by @sundy-li in #17549
• fix: The update in MERGE INTO was mistakenly optimized as a delete by @SkyFan2002 in #17571
• fix(query): show catalog support iceberg engine by @TCeason in #17569
• fix: session leak when execute explain pipeline in cluster mode by @dqhl76 in #17572

Others 📒

• chore: polish error message in CommitSink by @dantengsky in #17558
• chore: reorganize meta service watcher module by @drmingdrmer in #17557

Full Changelog: v1.2.704-nightly...v1.2.705-nightly

v1.2.704-nightly

What's Changed

Exciting New Features ✨

• feat(query): Supports folding of show grants results for roles and users by @TCeason in #17543
• feat(query): support query level spill setting by @zhang2014 in #17542
• feat: support WITHIN GROUP clause for AggregateFunction by @KKould in #17519
• feat(query): add catalog apis by @everpcpc in #17493
• feat: support load Avro Files. by @youngsofun in #17548
• feat(query): add api for users & roles by @everpcpc in #17553

Thoughtful Bug Fix 🔧

• fix: explain update sql panic by @zhyass in #17474
• fix(query): show roles rewrite kind is err by @TCeason in #17547
• fix: agg input does not match union output when subquery by @KKould in #17552
• fix: with recursive bind table panic by @KKould in #17554
• fix: parquet meta cache key include md5 or mtime or query_id. by @youngsofun in #17556

Code Refactor 🎉

• refactor(meta): simplify map key handling and improve naming consistency by @drmingdrmer in #17545

Build/Testing/CI Infra Changes 🔌

• ci: fix pack binaries by @everpcpc in #17544

Others 📒

• chore(query): siphash support generic types by @sundy-li in #17535
• chore(query): remove old sort spill by @forsaken628 in #17546

Full Changelog: v1.2.703-nightly...v1.2.704-nightly

v1.2.703-nightly

What's Changed

Exciting New Features ✨

• feat: support query metadata from parquet. by @youngsofun in #17527
• feat: skip reading empty files when load/query location. by @youngsofun in #17522
• feat(base): enhanced query-level memory management by @zhang2014 in #17358

Thoughtful Bug Fix 🔧

• fix(query): fix display ast with quoted comments by @sundy-li in #17529
• fix: ensure result correctness when enable pruning cache by @dqhl76 in #17524
• fix(query): user/role name not support \b and \f by @TCeason in #17530
• fix(query): ident role_name not support ' " \b \f in parse by @TCeason in #17534

Code Refactor 🎉

• refactor: remove timeout from snapshot hint refresh process by @dantengsky in #17532

Others 📒

• chore(query): allow arrow dictionary array into databend by @sundy-li in #17521
• chore(query): revert 17516 by @zhang2014 in #17539
• chore: rename EvalExpireTime to Expirable for better semantics by @drmingdrmer in #17540

Full Changelog: v1.2.702-nightly...v1.2.703-nightly

v1.2.702-nightly

What's Changed

Exciting New Features ✨

• feat: object warehouse support rbac by @TCeason in #17262
• feat: (semi-)sync table/field comments with the table being attached by @dantengsky in #17478
• feat(raft-log): enhance raft-log reliability and add compatibility tests by @drmingdrmer in #17510
• feat: add log.file.max_size and rolling test by @BohuTANG in #17508
• feat: csv/tsv/ndjson support querying file meta data. by @youngsofun in #17512
• feat(query): support explain(DECORRELATED,verbose) by @forsaken628 in #17518
• feat(query): add show_roles table function by @TCeason in #17517

Thoughtful Bug Fix 🔧

• fix(query): tpcds q69 fail by @forsaken628 in #17516

Code Refactor 🎉

• refactor: re-generate hint file after alter table operations by @dantengsky in #17511

Others 📒

• chore: modify license url by @TCeason in #17513
• chore: refine some fuse_time_travel_size related logs by @dantengsky in #17515

Full Changelog: v1.2.701-nightly...v1.2.702-nightly

v1.2.701-nightly

What's Changed

Exciting New Features ✨

• feat(query): add markov model function and feistel function for obfuscator by @forsaken628 in #17437
• feat(sqlsmith): fuzz test support more dbs as seed by @b41sh in #17489
• feat: SHOW CREATE TABLE add quote for ident by @KKould in #17505

Thoughtful Bug Fix 🔧

• fix: check table mutability in copy into by @dantengsky in #17480
• fix: impl hive disable_table_info_refresh for hive to avoid error when show table status from by @BohuTANG in #17484
• fix(binder): AggregateRewriter should skip the rewrite of Pivot.aggregate by @forsaken628 in #17483
• fix(query): unsupport datetime format item should not return panic error by @TCeason in #17490
• fix(binder): different UDAF call must have unique display_name by @forsaken628 in #17500

Code Refactor 🎉

• refactor: s3 region auto detect error add timeout/endpoint by @BohuTANG in #17482

Build/Testing/CI Infra Changes 🔌

• ci: add workflow to publish deb repo by @everpcpc in #17485
• ci: fix download deb packages by @everpcpc in #17486
• ci: fix gpg key for deb distribution by @everpcpc in #17487
• ci: add view sqlsmith test by @TCeason in #17472
• ci: package meta & query deb separately by @everpcpc in #17488

Others 📒

• chore(query): add placeholder parser by @sundy-li in #17481
• chore(ci): fix benchmark comment failure by @zhang2014 in #17492
• chore: add more log info(like temp dir) for the vacuum temp files hook by @BohuTANG in #17494
• chore(query): continue the vacuum query hook even aborted by @sundy-li in #17497
• chore: Split metactl into lib meta/control and bin metactl by @Xuanwo in #17496

New Contributors

• @KKould made their first contribution in #17505

Full Changelog: v1.2.700-nightly...v1.2.701-nightly

v1.2.700-nightly

What's Changed

Exciting New Features ✨

• feat(query): add table stats api to admin interface by @everpcpc in #17471
• feat: Use max/min to estimate ndv by @Xuanwo in #17468
• feat: add table option copy_dedup_full_path by @youngsofun in #17473

Thoughtful Bug Fix 🔧

• fix: InterpreterMetrics could subtract with overflow by @forsaken628 in #17461
• fix(query): fix stack overflow if excessive use of union all by @zhang2014 in #17475

Others 📒

• chore(ci): fix benchmark comment failure by @zhang2014 in #17470
• chore(query): add monotonicity function property by @sundy-li in #17469

Full Changelog: v1.2.699-nightly...v1.2.700-nightly

v1.2.699-nightly

What's Changed

Exciting New Features ✨

• feat(binder): support update from by @Dousir9 in #17464

Thoughtful Bug Fix 🔧

• fix(query): fix bind internal column by @b41sh in #17463
• fix(query): spill config should be mask by @forsaken628 in #17467
• fix(query): fix variant get string function auto cast null to SQL NULL by @b41sh in #17466

Full Changelog: v1.2.698-nightly...v1.2.699-nightly

v1.2.698-nightly

What's Changed

Exciting New Features ✨

• feat: deprecate prefix_filter and change default level of logging. by @youngsofun in #17444
• feat: Add hdfs support in iceberg and fill iceberg statistics by @Xuanwo in #17352
• feat: support specifying columns to include in the "Attach table" statement by @dantengsky in #17442
• feat(metrics): add progress metrics via collector by @flaneur2020 in #17359

Thoughtful Bug Fix 🔧

• fix(doc): fix load tpcds tpch document by @sundy-li in #17438
• fix(query): fix join subquery scalar rewrite by @sundy-li in #17441
• fix: fix inconsistency comment about bitmap by @forsaken628 in #17452
• fix(query): fix WindowPartitionTopNExchange painc with an empty block by @forsaken628 in #17453
• fix(parser): allow timestamp as a function name by @forsaken628 in #17455
• fix(query): fix order by derived column with limit return wrong values by @b41sh in #17457
• fix(query): fold constant subquery to build filter plan instead of join plan by @b41sh in #17448
• fix(query): fix left semi optimize to inner join by @sundy-li in #17458

Build/Testing/CI Infra Changes 🔌

• ci: fix missing return for stable release by @everpcpc in #17454
• ci: fix publish binary to R2 by @everpcpc in #17456

Others 📒

• chore: update enterprise edition license url by @TCeason in #17445
• chore(query): testing tpch/tpcds using 1G scale factor by @sundy-li in #17449
• chore(metrics): tune the histogram bucket for seconds/milliseconds by @flaneur2020 in #17197

Full Changelog: v1.2.697-nightly...v1.2.698-nightly