Tracking issues for missing features

[Xuanwo]

This issue is used to track those features that possible in duckdb but not yet implemented.

Table DDL/DML

• CREATE TABLE: Add CREATE TABEL support #62
• DROP TABLE #67
• TRUNCATE TABLE #71
• INSERT INTO ... VALUES / SELECT ...: Add INSERT INTO ... VALUES ... Support #59
• INSERT OVERWRITE / INSERT INTO ... ON CONFLICT ...
• DELETE FROM ... WHERE <predicate>: Add DELETE support #61
• UPDATE ... SET ... WHERE <predicate>: Add UPDATE support #60
• MERGE INTO ...: feat: add MERGE INTO support for Lance tables #156

Schema Evolution

• feat: Add ALTER TABLE ADD/DROP/ALTER COLUMN support #77
  • ALTER TABLE ... ADD COLUMN ...
  • ALTER TABLE ... DROP COLUMN ...
  • ALTER TABLE ... ALTER COLUMN ...
• COMMENT ON TABLE/COLUMN / ALTER TABLE SET/UNSET

Index

• feat: Add CREATE/DROP INDEX support #76
  • CREATE INDEX for vector
  • CREATE INDEX for scalar
  • DROP INDEX
• SHOW INDEXES #83
• reindex (need to figure out how to expose it in SQL)
• prewarm (need to figure out how to expose it in SQL)

Versions

• time travel: read branch/version/tag #88
• list versions
• CREATE TAG / DROP TAG / ALTER TAG
• CREATE BRANCH / DROP BRANCH / CHECKOUT BRANCH
• OPTIMIZE
• VACUUM

Optimize

• LIMIT/OFFSET pushdown #75
• TABLESAMPLE pushdown #86
• ANALYZE + optimizer stats #80
• RowID: SELECT ... WHERE _rowid IN (...) #84
• LIKE/ILIKE pushdown #79
• regexp_matches/SIMILAR TO pushdown #90
• feat: Add IS (NOT) DISTINCT FROM pushdown support #94
• starts_with/ends_with/contains/lower/upper functions pushdown #109
• More duckdb types (like binary/uuid/time/interval) pushdown
• TRY_CAST constant pushdown

Search

• Allow Hybrid search to use index
• Allow search multi-vector
• Allow search UINT8[]
• Allow search results to include _rowid
• Rewrite ORDER BY <distance_expr> LIMIT k into lance_vector_search
• Allow prefilter=true to fallback while not possible

Storage

• Add more storage support: refactor!: Use lance secrets instead #113
  • azure
  • gcs