Skip to content

Commit 34c647b

Browse files
committed
Updated working models and readme
1 parent f756b04 commit 34c647b

File tree

108 files changed

+3337
-4047
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

108 files changed

+3337
-4047
lines changed

.gitignore

Lines changed: 0 additions & 171 deletions
This file was deleted.

README.md

Lines changed: 2 additions & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
# Zendesk dlt-dbt Package
22

33
### Overview
4-
The Zendesk dlt-dbt package offers data models to help you transform and analyze Zendesk data. It's designed to integrate seamlessly with the dlt Zendesk pipeline, which extracts and loads Github data into your data warehouse.
4+
The Zendesk dlt-dbt package offers data models to help you transform and analyze Zendesk data. It's designed to integrate with the dlt Zendesk pipeline, which extracts and loads Zendesk data into your data warehouse.
55

66
### Who is this for?
77
This package is perfect for dbt users who want to integrate Zendesk data into their analytics workflows without building models from scratch.
@@ -29,7 +29,7 @@ This package is perfect for dbt users who want to integrate Zendesk data into th
2929
Follow the dlt Zendesk [pipeline documentation](https://dlthub.com/docs/dlt-ecosystem/verified-sources/zendesk) to set up your pipeline. Ensure you have your Zendesk and destination credentials configured.
3030

3131
3. **Run the Pipeline:**
32-
Extract and load data from Zendesk into your data warehouse by running the pipelines. As there are two seperate pipelines for Zendesk support and talk. We'll run each seperately and model it.
32+
Extract and load data from the Zendesk API into your data warehouse using the Zendesk pipeline. As Zendesk pipeline integrates multiple sources. Here, we will build a model for the `zendesk_support` source. For more details on sources, refer to the documentation.
3333

3434
### Step 2: Install and Configure the dbt Project
3535

@@ -92,30 +92,6 @@ marts/
9292
├── tests/
9393
```
9494

95-
For Zendesk talk:
96-
97-
```text
98-
dbt_dlt_zendesk_pipeline_talk/
99-
├── analysis/
100-
├── macros/
101-
├── marts/
102-
├── models/
103-
│ ├── marts/
104-
│ │ ├── dim__dlt_loads.sql
105-
│ │ ├── dim_current_queue_activity.sql
106-
│ │ ├── dim_greeting_categories.sql
107-
│ │ ├── dim_greetings.sql
108-
│ │ ├── dim_settings__supported_locales.sql
109-
│ │ └── dim_settings.sql
110-
│ ├── staging/ #same models as above with prefix `stg`
111-
│ ├── dlt_active_load_ids.sql
112-
│ └── dlt_processed_load_ids.sql
113-
├── sources.yml
114-
├── tests/
115-
├── dbt_project.yml
116-
└── requirements.txt
117-
```
118-
11995
### Step 3: Run dbt
12096
Execute the dbt models to transform the raw Zendesk data into useful tables:
12197

@@ -143,18 +119,11 @@ for data model which can be further modified as required.
143119

144120
Here's the link to the DB diagram: [link](https://dbdiagram.io/d/zendesk_support_dlt_dbt_v0-1-0-67a1f7c0263d6cf9a0f9bb5f).
145121

146-
2. The schema of data modelled Zendesk Talk above using dlt-dbt-generator:
147-
148-
![picture](https://storage.googleapis.com/dlt-blog-images/zendesk_talk_dlt_dbt_v0.1.0.png)
149-
150-
Here's the link to the DB diagram: [link](https://dbdiagram.io/d/Zendesk_talk_dlt_dbt_v0-1-0-67a20abe263d6cf9a0fc28ec).
151122

152123
> ⚠️ **Note:**
153124
>
154125
> Please note that this is a starting template for your data model and is not the final product. It is advised to customize the data model as per your needs.
155126
156-
Here's the link to the DB diagram: [link](https://dbdiagram.io/d/Zendesk_talk_dlt_dbt_v0-1-0-67a20abe263d6cf9a0fc28ec).
157-
158127
#### Optional: Advanced Usage (Generator and Licensing)
159128

160129
This package was created using the dlt-dbt-generator by dlt-plus. For more information about dlt-plus, refer to the
Lines changed: 28 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -1,29 +1,29 @@
1-
name: 'dlt_zendesk_pipeline_talk'
2-
3-
config-version: 2
4-
version: '0.1'
5-
6-
profile: 'dlt_zendesk_pipeline_talk'
7-
8-
model-paths: ["models"]
9-
test-paths: ["tests"]
10-
analysis-paths: ["analysis"]
11-
macro-paths: ["macros"]
12-
13-
target-path: "target"
14-
clean-targets:
15-
- "target"
16-
- "dbt_modules"
17-
- "logs"
18-
19-
require-dbt-version: [">=1.0.0", "<2.0.0"]
20-
21-
models:
22-
dlt_zendesk_pipeline_talk:
23-
materialized: table
24-
staging:
25-
materialized: view
26-
+docs:
27-
node_color: 'silver'
28-
+docs:
1+
name: 'dlt_zendesk_pipeline'
2+
3+
config-version: 2
4+
version: '0.1'
5+
6+
profile: 'dlt_zendesk_pipeline'
7+
8+
model-paths: ["models"]
9+
test-paths: ["tests"]
10+
analysis-paths: ["analysis"]
11+
macro-paths: ["macros"]
12+
13+
target-path: "target"
14+
clean-targets:
15+
- "target"
16+
- "dbt_modules"
17+
- "logs"
18+
19+
require-dbt-version: [">=1.0.0", "<2.0.0"]
20+
21+
models:
22+
dlt_zendesk_pipeline:
23+
materialized: table
24+
staging:
25+
materialized: view
26+
+docs:
27+
node_color: 'silver'
28+
+docs:
2929
node_color: 'gold'

gitignore.txt

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
# ignore secrets, virtual environments and typical python compilation artifacts
2+
secrets.toml
3+
# ignore basic python artifacts
4+
.env
5+
**/__pycache__/
6+
**/*.py[cod]
7+
**/*$py.class
8+
# ignore duckdb
9+
*.duckdb
10+
*.wal

models/dbt_dlt_zendesk_pipeline_talk/models/dlt_active_load_ids.sql

Lines changed: 0 additions & 13 deletions
This file was deleted.

models/dbt_dlt_zendesk_pipeline_talk/models/dlt_processed_load_ids.sql

Lines changed: 0 additions & 13 deletions
This file was deleted.

models/dbt_dlt_zendesk_pipeline_talk/models/marts/dim_current_queue_activity.sql

Lines changed: 0 additions & 16 deletions
This file was deleted.

models/dbt_dlt_zendesk_pipeline_talk/models/marts/dim_greeting_categories.sql

Lines changed: 0 additions & 12 deletions
This file was deleted.

models/dbt_dlt_zendesk_pipeline_talk/models/marts/dim_greetings.sql

Lines changed: 0 additions & 20 deletions
This file was deleted.

0 commit comments

Comments
 (0)