FT2024-2 GRIB2 (#273)

* xml,txt files

* 247 code table 49 add an entry to encode a probability based on a quantile distribution instead of based on a threshold (#265)

* fix rebase conflict xml,txt files

* fix rebase conflicts 247 adding entry in COde table 4.9 and associated note

* fix rebase conflicts xml,txt files

* xml,txt files

* #247 changing PDF acronym to probability distribution function

* xml,txt files

* remove odd char

* xml,txt files

* xml,txt files

* remove datestamp from XML gen

* xml,txt files

---------

Co-authored-by: Enrico Fucile <efucile@wmo.int>
Co-authored-by: Sebastien Villaume <sebastien.villaume@ecmwf.int>

* 253 new normal and tangential velocity.... (#270)

* xml,txt files

* xml,txt files

* issue #253 update branch

* xml,txt files

* Update GRIB2_CodeFlag_4_2_10_4_CodeTable_en.csv

53 and 54 for normal and tangential component of water velocity, as entry 52 is used in issue 244 for mixed layed depth.

* xml,txt files

---------

Co-authored-by: Enrico Fucile <efucile@wmo.int>
Co-authored-by: Sibylle Krebber <62389319+SibylleK@users.noreply.github.com>

* 248 code table 4101 new entry in code table 4101 to extend the usage of templates 4105 4106 4107 and 4112 (#263)

* fix rebase conflict: 248 adding entry in Code Table 4.101 and associated note

* fix rebase of xml,txt files

* fix legacy conflict text

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <sebastien.villaume@ecmwf.int>
Co-authored-by: Enrico Fucile <efucile@wmo.int>

* 244 new new mixed layer depth parameter in code table 42 discipline 10 1 (#262)

* issue #244 in NEW branch

* xml,txt files

* xml,txt files

---------

Co-authored-by: Enrico Fucile <efucile@wmo.int>

* 246 additional anomalies templates (#268)

* #246 adding template 4.128 to 4.136 and entries in code table 4.0

* rebase fix xml,txt files

* Update GRIB2_Template_4_129_ProductDefinitionTemplate_en.csv

Replace "to" with "-"

* xml,txt files

* Update GRIB2_Template_4_131_ProductDefinitionTemplate_en.csv

upper limit

* xml,txt files

* Update GRIB2_Template_4_134_ProductDefinitionTemplate_en.csv

"51-62" not as octetNo

* xml,txt files

* Update GRIB2_Template_4_136_ProductDefinitionTemplate_en.csv

upper limit and typo in line 47

* xml,txt files

* fix CSV

* xml,txt files

* Apply suggestions from code review

update see note references

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <sebastien.villaume@ecmwf.int>
Co-authored-by: Enrico Fucile <efucile@wmo.int>
Co-authored-by: Sibylle Krebber <62389319+SibylleK@users.noreply.github.com>

* 245 deprecate template 444 create rectified version as template 450 (#269)

* #245 deprecate template 4.44, create new corrected template 4.50 and update Code table 4.0 accordingly

* xml,txt files

* Update GRIB2_CodeFlag_4_0_CodeTable_en.csv

* xml,txt files

* Update GRIB2_Template_4_50_ProductDefinitionTemplate_en.csv

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <sebastien.villaume@ecmwf.int>
Co-authored-by: Enrico Fucile <efucile@wmo.int>

* 250 code table 42 and 4238 new sourcesink entries in code table 4238 and a new parameter in code table 42 discipline 0 category 20 (#274)

* #250 adding entries in code table 4.22.0.20 and 4.238

* xml,txt files

* #250 updating entries to only keep sink and source (removing loss and gain)

* xml,txt files

* xml,txt files

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <sebastien.villaume@ecmwf.int>
Co-authored-by: Enrico Fucile <efucile@wmo.int>

* 238 new precipitation type flag... (#267)

#238

* xml,txt files

* 271 remove date from xml script (#272)

* xml,txt files

* Update create_master_lists.py

Remove the generation of the 'generated' param to avoid complex merging process.

Now the xml header won't have the 'generated' param anymore

* xml,txt files

---------

Co-authored-by: Enrico Fucile <efucile@wmo.int>

* xml,txt files

* xml,txt files

* update branch for issue #238

* xml,txt files

---------

Co-authored-by: Enrico Fucile <efucile@wmo.int>
Co-authored-by: antoineMerleEUM <antoine.merle@eumetsat.int>

* 249 code table 14 43 and 46 adding new entries to better describe type of forecasting (#261)

#249 
* fix rebase conflict: 249 adding entries in code table 1.4, 4.3 and 4.6 with associated notes

* fix rebase of xml,txt files

* #249, add notes, change sample to example

* xml,txt files

* editorial, changed 23 to 22 in CF4.3

* xml,txt files

* Update GRIB2_CodeFlag_4_6_CodeTable_en.csv

Co-authored-by: Marijana Crepulja <62389855+marijanacrepulja@users.noreply.github.com>

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <sebastien.villaume@ecmwf.int>
Co-authored-by: Enrico Fucile <efucile@wmo.int>
Co-authored-by: Marijana Crepulja <62389855+marijanacrepulja@users.noreply.github.com>

* Update notes/CodeFlag_notes.csv

* 251 code table 41 and 42 new category for thermodynamical properties in discipline land surface and associated parameters (#266)

* #251 adding entries in subtables of codec table 4.2

* fix rebase conflicts for xml,txt files

* change capitilization

* xml,txt files

* #251 add notes

* xml,txt files

* Update GRIB2_CodeFlag_4_2_0_4_CodeTable_en.csv

add note number

* xml,txt files

* Update GRIB2_CodeFlag_4_2_0_4_CodeTable_en.csv

change note number again

* xml,txt files

---------

Co-authored-by: Sebastien Villaume <sebastien.villaume@ecmwf.int>
Co-authored-by: Enrico Fucile <efucile@wmo.int>

* 249 new2 (#275)

* Code table 1.4, 4.3 and 4.6: Adding new entries to better describe type of forecasting #249

* xml,txt files

---------

Co-authored-by: Enrico Fucile <efucile@wmo.int>

---------

Co-authored-by: Enrico Fucile <efucile@wmo.int>
Co-authored-by: Sebastien Villaume <sebastien.villaume@ecmwf.int>
Co-authored-by: Sibylle Krebber <62389319+SibylleK@users.noreply.github.com>
Co-authored-by: antoineMerleEUM <antoine.merle@eumetsat.int>
Co-authored-by: Marijana Crepulja <62389855+marijanacrepulja@users.noreply.github.com>

Author: 6 people

GRIB2_CodeFlag_1_4_CodeTable_en.csv

@@ -8,6 +8,8 @@ Type of data,,5,,Control and perturbed forecast products,,,,Operational
 Type of data,,6,,Processed satellite observations,,,,Operational
 Type of data,,7,,Processed radar observations,,,,Operational
 Type of data,,8,,Event probability,,,,Operational
-Type of data,,9-191,,Reserved,,,,Operational
+Type of data,,9,,Experimental data,(see Note 2),249a,,Operational
+Type of data,,10,,ML based forecast,(see Note 3),249b,,Operational
+Type of data,,11-191,,Reserved,,,,Operational
 Type of data,,192-254,,Reserved for local use,,,,Operational
 Type of data,,255,,Missing,,,,Operational

GRIB2_CodeFlag_4_0_CodeTable_en.csv

@@ -29,13 +29,13 @@ Product definition template number,,40,,Analysis or forecast at a horizontal lev
 Product definition template number,,41,,"Individual ensemble forecast, control and perturbed, at a horizontal level or in a horizontal layer at a point in time for atmospheric chemical constituents",,,,Operational
 Product definition template number,,42,,"Average, accumulation, and/or extreme values or other statistically processed values at a horizontal level or in a horizontal layer in a continuous or non-continuous time interval for atmospheric chemical constituents",,,,Operational
 Product definition template number,,43,,"Individual ensemble forecast, control and perturbed, at a horizontal level or in a horizontal layer in a continuous or non-continuous time interval for atmospheric chemical constituents",,,,Operational
-Product definition template number,,44,,Analysis or forecast at a horizontal level or in a horizontal layer at a point in time for aerosol,,,,Operational
+Product definition template number,,44,,Analysis or forecast at a horizontal level or in a horizontal layer at a point in time for aerosol (deprecated),,,,Deprecated
 Product definition template number,,45,,"Individual ensemble forecast, control and perturbed, at a horizontal level or in a horizontal layer at a point in time for aerosol",,,,Operational
 Product definition template number,,46,,"Average, accumulation, and/or extreme values or other statistically processed values at a horizontal level or in a horizontal layer in a continuous or non-continuous time interval for aerosol",,,,Operational
 Product definition template number,,47,,"Individual ensemble forecast, control and perturbed, at a horizontal level or in a horizontal layer in a continuous or non-continuous time interval for aerosol",,,,Operational
 Product definition template number,,48,,Analysis or forecast at a horizontal level or in a horizontal layer at a point in time for optical properties of aerosol,,,,Operational
 Product definition template number,,49,,"Individual ensemble forecast, control and perturbed, at a horizontal level or in a horizontal layer at a point in time for optical properties of aerosol",,,,Operational
-Product definition template number,,50,,Reserved,,,,Operational
+Product definition template number,,50,,Analysis or forecast at a horizontal level or in a horizontal layer at a point in time for aerosol,,,,Operational
 Product definition template number,,51,,Categorical forecasts at a horizontal level or in a horizontal layer at a point in time,,,,Operational
 Product definition template number,,52,,Reserved,,,,Operational
 Product definition template number,,53,,Partitioned parameters at a horizontal level or in a horizontal layer at a point in time,,,,Operational
@@ -110,7 +110,16 @@ Product definition template number,,124,,"Analysis or forecast at a horizontal l
 Product definition template number,,125,,"Individual ensemble forecast, control and perturbed, at a horizontal level or in a horizontal layer at a point in time for radionuclides",,,,Operational
 Product definition template number,,126,,"Average, accumulation, and/or extreme values or other statistically processed values at a horizontal level or in a horizontal layer in a continuous or non-continuous time interval for radionuclides",,,,Operational
 Product definition template number,,127,,"Individual ensemble forecast, control and perturbed, at a horizontal level or in a horizontal layer in a continuous or non-continuous time interval for radionuclides",,,,Operational
-Product definition template number,,128-253,,Reserved,,,,Operational
+Product definition template number,,128,,"Anomalies significance and other derived products from an analysis or forecast in relation to a reference period at a horizontal level or in a horizontal layer at a point in time",,,,Operational
+Product definition template number,,129,,"Anomalies significance and other derived products from an individual ensemble forecast, control and perturbed in relation to a reference period at a horizontal level or in a horizontal layer at a point in time",,,,Operational
+Product definition template number,,130,,"Anomalies significance and other derived products from derived forecasts based on all ensemble members in relation to a reference period at a horizontal level or in a horizontal layer at a point in time",,,,Operational
+Product definition template number,,131,,"Anomalies significance and other derived products as probability forecasts in relation to a reference period at a horizontal level or in a horizontal layer at a point in time",,,,Operational
+Product definition template number,,132,,"Quantile forecasts of anomalies, significance and other derived products in relation to a reference period at a horizontal level or in a horizontal layer at a point in time",,,,Operational
+Product definition template number,,133,,"Post-processed quantile forecasts of anomalies, significance and other derived products in relation to a reference period at a horizontal level or in a horizontal layer at a point in time",,,,Operational
+Product definition template number,,134,,"Quantile forecasts of anomalies, significance and other derived products in relation to a reference period at a horizontal level or in a horizontal layer in a continuous or non-continuous time interval",,,,Operational
+Product definition template number,,135,,"Post-processed quantile forecasts of anomalies, significance and other derived products in relation to a reference period at a horizontal level or in a horizontal layer in a continuous or non-continuous time interval",,,,Operational
+Product definition template number,,136,,"Probability forecasts of anomalies, significance and other derived products in relation to a reference period with spatiotemporal processing based on focal (moving window) statistics in relation to a reference period at a horizontal level or in at a point in time",,,,Operational
+Product definition template number,,137-253,,Reserved,,,,Operational
 Product definition template number,,254,,CCITT IA5 character string,,,,Operational
 Product definition template number,,255-999,,Reserved,,,,Operational
 Product definition template number,,1000,,Cross-section of analysis and forecast at a point in time,,,,Experimental

GRIB2_CodeFlag_4_101_CodeTable_en.csv

@@ -8,6 +8,7 @@ Type of relationship to reference dataset,,20,,Extreme Forecast Index (EFI),(see
 Type of relationship to reference dataset,,21,,Shift of Tails (SOT),(see Note 4),138,,Operational
 Type of relationship to reference dataset,,22,,Anomaly of probabilities,(see Note 5),148,,Operational
 Type of relationship to reference dataset,,23,,Standardized Drought Index,(see Note 6),147,,Operational
-Type of relationship to reference dataset,,24-191,,Reserved,,,,Operational
+Type of relationship to reference dataset,,24,,Crossing Point Forecast (CPF) (see Note 7),248a,,Operational
+Type of relationship to reference dataset,,25-191,,Reserved,,,,Operational
 Type of relationship to reference dataset,,192-254,,Reserved for local use,,,,Operational
 Type of relationship to reference dataset,,255,,Missing,,,,Operational

GRIB2_CodeFlag_4_1_CodeTable_en.csv

@@ -40,7 +40,8 @@ Parameter category by product discipline,Product discipline 2 - Land surface pro
 Parameter category by product discipline,Product discipline 2 - Land surface products,4,,Fire weather products,,,,Operational
 Parameter category by product discipline,Product discipline 2 - Land surface products,5,,Glaciers and inland ice,,,,Operational
 Parameter category by product discipline,Product discipline 2 - Land surface products,6,,Urban areas,,,,Operational
-Parameter category by product discipline,Product discipline 2 - Land surface products,7-191,,Reserved,,,,Operational
+Parameter category by product discipline,Product discipline 2 - Land surface products,7,,Thermodynamic properties,,,,Operational
+Parameter category by product discipline,Product discipline 2 - Land surface products,8-191,,Reserved,,,,Operational
 Parameter category by product discipline,Product discipline 2 - Land surface products,192-254,,Reserved for local use,,,,Operational
 Parameter category by product discipline,Product discipline 2 - Land surface products,255,,Missing,,,,Operational
 Parameter category by product discipline,"Product discipline 3 - Satellite remote sensing products (formerly ""Space products"")",0,,Image format products,(see Note 1),40,,Operational

GRIB2_CodeFlag_4_201_CodeTable_en.csv

@@ -12,6 +12,8 @@ Precipitation type,,9,,Graupel,,,,Operational
 Precipitation type,,10,,Hail,,,,Operational
 Precipitation type,,11,,Drizzle,,,,Operational
 Precipitation type,,12,,Freezing drizzle,,,,Operational
-Precipitation type,,13-191,,Reserved,,,,Operational
+Precipitation type,,13,,Hail (less than 5 mm),,,,Operational
+Precipitation type,,14,,Hail (greater than or equal to 5 mm),,,,Operational
+Precipitation type,,15-191,,Reserved,,,,Operational
 Precipitation type,,192-254,,Reserved for local use,,,,Operational
 Precipitation type,,255,,Missing,,,,Operational

GRIB2_CodeFlag_4_238_CodeTable_en.csv

@@ -29,6 +29,15 @@ Source or sink,,26,,Road transportation,,,,Operational
 Source or sink,,27,,Off-road transportation,,,,Operational
 Source or sink,,28,,Nuclear power plant,,,,Operational
 Source or sink,,29,,Nuclear weapon,,,,Operational
-Source or sink,,30-191,,Reserved,,,,Operational
+Source or sink,,30,,Commercial buildings heating,,,,Operational
+Source or sink,,31,,Residential heating,,,,Operational
+Source or sink,,32,,Oil refineries and transformation industry,,,,Operational
+Source or sink,,33,,Gas production,,,,Operational
+Source or sink,,34,,Vegetation,,,,Operational
+Source or sink,,35,,Biomass burning,,,,Operational
+Source or sink,,36,,Settlements,,,,Operational
+Source or sink,,37,,Soil,,,,Operational
+Source or sink,,38,,Wild animals,,,,Operational
+Source or sink,,39-191,,Reserved,,,,Operational
 Source or sink,,192-254,,Reserved for local use,,,,Operational
 Source or sink,,255,,Missing,,,,Operational

GRIB2_CodeFlag_4_2_0_19_CodeTable_en.csv

@@ -50,6 +50,7 @@ Parameter number by product discipline and parameter category,"Product disciplin
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 19: physical atmospheric properties",48,,Top of persistent contrails,,,m,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 19: physical atmospheric properties",49,,Base of persistent contrails,,,m,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 19: physical atmospheric properties",50,,Convectively-induced turbulence (CIT) (eddy dissipation rate),,,m2/3 s-1,Operational
-Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 19: physical atmospheric properties",51-191,,Reserved,,,,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 19: physical atmospheric properties",51,,Visibility through precipitation,,,m,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 19: physical atmospheric properties",52-191,,Reserved,,,,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 19: physical atmospheric properties",192-254,,Reserved for local use,,,,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 19: physical atmospheric properties",255,,Missing,,,,Operational

GRIB2_CodeFlag_4_2_0_20_CodeTable_en.csv

@@ -51,19 +51,23 @@ Parameter number by product discipline and parameter category,"Product disciplin
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",79,,Column integrated northward mass flux,,,kg m-1 s-1,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",80,,Column integrated divergence of mass flux,,,kg m-2 s-1,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",81,,Column integrated net source,(see Note 3),129,kg m-2 s-1,Operational
-Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",82-99,,Reserved,,,,Operational
-Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",100,,Surface area density (aerosol),,,/m,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",82,,Sink mass flux,,,kg m-2 s-1,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",83,,Source mass flux,,,kg m-2 s-1,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",84,,Volume-mean total column mixing ratio,,,mol mol-1,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",85-99,,Reserved,,,,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",100,,Surface area density (aerosol),,,m-1,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",101,,Vertical visual range,,,m,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",102,,Aerosol optical thickness,,,Numeric,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",103,,Single scattering albedo,,,Numeric,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",104,,Asymmetry factor,,,Numeric,Operational
-Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",105,,Aerosol extinction coefficient,,,/m,Operational
-Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",106,,Aerosol absorption coefficient,,,/m,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",105,,Aerosol extinction coefficient,,,m-1,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",106,,Aerosol absorption coefficient,,,m-1,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",107,,Aerosol lidar backscatter from satellite,,,m-1 sr-1,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",108,,Aerosol lidar backscatter from the ground,,,m-1 sr-1,Operational
-Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",109,,Aerosol lidar extinction from satellite,,,/m,Operational
-Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",110,,Aerosol lidar extinction from the ground,,,/m,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",109,,Aerosol lidar extinction from satellite,,,m-1,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",110,,Aerosol lidar extinction from the ground,,,m-1,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",111,,Angstrom exponent,,,Numeric,Operational
-Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",112-191,,Reserved,,,,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",112,,Absorption aerosol optical thickness,,,Numeric,Operational
+Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",113-191,,Reserved,,,,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",192-254,,Reserved for local use,,,,Operational
 Parameter number by product discipline and parameter category,"Product discipline 0 - Meteorological products, parameter category 20: atmospheric chemical constituents",255,,Missing,,,,Operational