Skip to content

[dbt-core v1.10.0] Implementing Support for Catalog Integrations #489

@BentsiLeviav

Description

@BentsiLeviav

Description

dbt Core v1.10 introduces Iceberg data catalog support, allowing adapters to materialize models into both built-in and external catalogs that manage open table formats (like Iceberg).

This feature lets dbt projects manage datasets in object storage with a warehouse-agnostic interface and centralize catalog configuration.

Our adapter needs to implement this functionality so that users can:

  • Materialize dbt models as Iceberg tables (or other supported open table formats).

  • Register these tables in supported catalogs (e.g., AWS Glue, Hive Metastore).

  • Query those tables through ClickHouse with dbt.

Tasks (we'll add more tasks over time)

  • Review dbt Core v1.10 adapter catalog integration docs and implementation guidelines.

  • Add adapter methods required for catalog integration (list_catalogs, create_table_with_catalog, etc.).

  • Ensure correct handling of metadata registration in supported catalogs.

  • Add configuration support for catalog parameters (catalog type, location, table format, etc.).

  • Implement integration tests for catalog-based materializations.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions