Databricks Tags - Parity with dbt Tags

[ludwig-sewall]

Describe the feature

I would like databricks_tags to be additive in the same way as dbt tags.

Describe alternatives you've considered

Current workarounds could be yaml anchors or simply rewriting the same config in multiple places. I think neither of the workarounds follow the DRY principles.

Additional context

In the dbt_project.yml below I'm using databricks_tags which is a map. In the example below I was at first expecting the persisted tags in Databricks to include both the owner tag and the tier but only the tier tag is persisted.

The expected result would be to persist both owner tag and the tier but only the tier tag is persisted

models:
  ludwig_sandbox:
    +persist_docs:
      relation: true
      columns: true
    +databricks_tags:
      owner: "platform-team"
    bronze:
      +materialized: view
    silver:
      +materialized: table
    gold:
      +materialized: table
      +access: public
      +databricks_tags:
        tier: "gold"

Who will this benefit?

Anyone who wants to persist dbt documentation in Databricks. Not having this feature will lead to inconsistencies in data governance.

Are you interested in contributing this feature?

I will not contribute personally but rather leave it as feature request

[benc-db]

Unfortunately, we don't control how map values get handled hierarchically :(.

[github-actions]

This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please remove the stale label or comment on the issue.

[sd-db]

This is fixed post #1340 and will go out with v1.12 release