generated from dataforgoodfr/d4g-project-template
-
Notifications
You must be signed in to change notification settings - Fork 51
Analyst/lounes tous polluants udi dernier #164
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 8 commits
Commits
Show all changes
22 commits
Select commit
Hold shift + click to select a range
1b4e62d
feat: creation de la branche (à continuer)
LounesAbd 5cf172a
Merge remote-tracking branch 'upstream' into analyst/lounes_tous-poll…
LounesAbd 8f78a1b
Merge remote-tracking branch 'upstream' into analyst/lounes_tous-poll…
LounesAbd 210bfbe
feat : create files and first SQL model iteration
LounesAbd 1faa608
feat : add yaml profile
LounesAbd 8d9fd74
fix : syntaxe de la clause FROM
LounesAbd 4f2b0b7
fix : changement syntaxe CASE WHEN et valeurs acceptées dbt colonne '…
LounesAbd 3193880
Merge remote-tracking branch 'upstream' into analyst/lounes_tous-poll…
LounesAbd 1af078e
Merge remote-tracking branch 'upstream' into analyst/lounes_tous-poll…
LounesAbd 5f082c7
fix : simplified model and added dbt test file
LounesAbd dedaf94
Merge remote-tracking branch 'upstream' into analyst/lounes_tous-poll…
LounesAbd 94931eb
Merge branch 'main' into analyst/lounes_tous-polluants_udi_dernier
jereze 373d54b
fix: little changes to match the results better
LounesAbd f377c17
fix: changed results name in pfas test file and in tous polluants udi…
LounesAbd fb3c66f
Merge remote-tracking branch 'upstream' into analyst/lounes_tous-poll…
LounesAbd 7ac258d
Merge branch 'upstream' into analyst/lounes_tous-polluants_udi_dernie…
LounesAbd 919a9e1
fix: add test dernier_prel_datetime
LounesAbd 0c34cd1
Revert "fix: little changes to match the results better"
jereze 961f3f5
fix the revert
jereze 0861751
update dat model
jereze bf2c8bc
rename "tous_polluants" to "tous"
jereze 9f834b4
add "tous" category to website
jereze File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
34 changes: 34 additions & 0 deletions
34
dbt_/models/intermediate/tous_polluants/_int__tous_polluants_models.yml
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,34 @@ | ||
version: 1 | ||
|
||
models: | ||
- name: int__resultats_tous_polluants_udi_dernier | ||
description: "Résultats des derniers prélèvements pour tous les polluants par UDI. Ce modèle sélectionne le dernier prélèvement pour chaque paramètre et agrège les résultats pour identifier les dépassements des seuils sanitaires et/ou règlementaires." | ||
columns: | ||
- name: cdreseau | ||
description: "Code de l'installation (UDI)." | ||
LounesAbd marked this conversation as resolved.
Show resolved
Hide resolved
|
||
tests: | ||
- not_null | ||
- unique | ||
|
||
- name: dernier_prel_datetime | ||
description: "Date et heure du dernier prélèvement pris en compte dans l'analyse." | ||
type: TIMESTAMP | ||
tests: | ||
- not_null | ||
LounesAbd marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
||
- name: resultat_all | ||
description: "Interprétation du résultat en fonction des seuils sanitaires et règlementaires." | ||
type: VARCHAR | ||
tests: | ||
- accepted_values: | ||
values: | ||
- "inf_limites" | ||
- "min_1_parametre_sup_limite_reg" | ||
- "min_1_parametre_sup_limite_sanitaire" | ||
|
||
- name: periode | ||
description: "Période d'analyse des prélèvements (ici, toujours 'dernier_prel')." | ||
type: VARCHAR | ||
tests: | ||
- accepted_values: | ||
values: ["dernier_prel"] |
56 changes: 56 additions & 0 deletions
56
dbt_/models/intermediate/tous_polluants/int__resultats_tous_polluants_udi_dernier.sql
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,56 @@ | ||
SELECT | ||
cdreseau, | ||
periode, | ||
-- On garde la date du prélèvement la plus récente entre toutes les | ||
-- substances | ||
MAX(dernier_prel_datetime) AS dernier_prel_datetime, | ||
CASE | ||
WHEN | ||
-- 1 : check si une des substances dépasse la limite sanitaire | ||
MAX(CASE | ||
WHEN categorie = 'cvm' AND resultat = 'sup_0_5' THEN 1 | ||
WHEN | ||
categorie = 'pfas' | ||
AND resultat = 'un_pfas_sup_valeur_sanitaire' | ||
THEN 1 | ||
ELSE 0 | ||
END) = 1 | ||
THEN 'min_1_parametre_sup_limite_sanitaire' | ||
|
||
WHEN | ||
-- 2 : check si une des substances dépasse la limite règlementaire | ||
MAX(CASE | ||
WHEN | ||
categorie = 'pfas' | ||
AND resultat IN ( | ||
'somme_20pfas_sup_0_1', | ||
'somme_20pfas_inf_0_1_et_4pfas_sup_0_02' | ||
) | ||
THEN 1 | ||
ELSE 0 | ||
END) = 1 | ||
THEN 'min_1_parametre_sup_limite_reg' | ||
|
||
WHEN | ||
-- 3 : check si toutes les substances sont en dessous des limites | ||
MAX(CASE | ||
WHEN | ||
categorie = 'cvm' | ||
AND resultat IN ('non_quantifie', 'inf_0_5') | ||
THEN 0 | ||
WHEN | ||
categorie = 'pfas' | ||
AND resultat IN ( | ||
'aucun_parametre_quantifie', | ||
'somme_20pfas_inf_0_1_et_4pfas_inf_0_02' | ||
) | ||
THEN 0 | ||
ELSE 1 | ||
END) = 0 | ||
THEN 'inf_limites' | ||
|
||
ELSE 'erreur' | ||
END AS resultat_all | ||
FROM {{ ref('int__union_resultats_udi') }} | ||
WHERE periode = 'dernier_prel' | ||
GROUP BY cdreseau, periode |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.