-
Notifications
You must be signed in to change notification settings - Fork 140
Description
Description
dbt Core v1.10 introduces Iceberg data catalog support, allowing adapters to materialize models into both built-in and external catalogs that manage open table formats (like Iceberg).
This feature lets dbt projects manage datasets in object storage with a warehouse-agnostic interface and centralize catalog configuration.
Our adapter needs to implement this functionality so that users can:
-
Materialize dbt models as Iceberg tables (or other supported open table formats).
-
Register these tables in supported catalogs (e.g., AWS Glue, Hive Metastore).
-
Query those tables through ClickHouse with dbt.
Tasks (we'll add more tasks over time)
-
Review dbt Core v1.10 adapter catalog integration docs and implementation guidelines.
-
Add adapter methods required for catalog integration (list_catalogs, create_table_with_catalog, etc.).
-
Ensure correct handling of metadata registration in supported catalogs.
-
Add configuration support for catalog parameters (catalog type, location, table format, etc.).
-
Implement integration tests for catalog-based materializations.