From d2c9a25615ae25f5950204ab968f25ed5765325f Mon Sep 17 00:00:00 2001 From: Anna Milan Date: Mon, 3 Feb 2025 09:54:44 +0100 Subject: [PATCH 1/2] Update data-publisher.adoc 1.3.3.4 editorial --- guide/sections/part1/data-publisher.adoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/guide/sections/part1/data-publisher.adoc b/guide/sections/part1/data-publisher.adoc index ef41a47..6f6ea67 100644 --- a/guide/sections/part1/data-publisher.adoc +++ b/guide/sections/part1/data-publisher.adoc @@ -110,7 +110,7 @@ To ensure that data consumers can easily find the topics they want to subscribe If the data seem to relate to more than one topic, the most appropriate one should be selected. The topic hierarchy is not a knowledge organization system – it is used solely to ensure the uniqueness of topics for publishing notification messages. Discovery metadata is used to describe a dataset and its relevance to additional disciplines; each dataset is mapped to one, and only one, topic. -If the WIS2 Topic Hierarchy does not include a topic appropriate for the data, the data should be published on an experimental topic. This will allow data exchange to be established while the formalities are being considered.footnote:[Experimental topics are necessary for the WIS2 pre-operational phase and future pre-operational data exchange in test mode.] Experimental topics are provided for each Earth system discipline at level eight in the topic hierarchy (for example, ``origin/a/wis2/{centre-id}/data/{earth-system-discipline}/experimental/``). Data publishers can extend the experimental branch with subtopics they deem appropriate. Experimental topics are subject to change and will be removed once they are no longer needed. For more information, see _Manual on WIS_, Volume II, Appendix D. WIS2 Topic Hierarchy, section 1.2 Publishing guidelines. +If the WIS2 Topic Hierarchy does not include a topic appropriate for the data, the data should be published on an experimental topic. This will allow data exchange to be established while the formalities are being considered.footnote:[Experimental topics are necessary for the WIS2 pre-operational phase and future pre-operational data exchange in test mode.] Experimental topics are provided for each Earth system discipline at level eight in the topic hierarchy (for example, ``origin/a/wis2/{centre-id}/data/{earth-system-discipline}/experimental/``). Data publishers can extend the experimental branch with subtopics they deem appropriate. Experimental topics are subject to change and will be removed once they are no longer needed. For more information, see _Manual on WIS_, Volume II, Appendix D. WIS2 Topic Hierarchy, section 1.2 Publishing. Whatever topic is used, the discovery metadata provided to the Global Discovery Catalogue must include subscription links using that topic.footnote:[The Global Discovery Catalogue will reject discovery metadata records containing links to topics outside the official topic hierarchy.] The Global Broker will only republish notification messages on topics specified in the discovery metadata records. From 70523752e668b31088b3c05789b9908b35499daf Mon Sep 17 00:00:00 2001 From: Anna Milan Date: Tue, 4 Feb 2025 09:23:36 +0100 Subject: [PATCH 2/2] Update global-services.adoc --- guide/sections/part2/global-services.adoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/guide/sections/part2/global-services.adoc b/guide/sections/part2/global-services.adoc index 9eb550e..3dcaa00 100644 --- a/guide/sections/part2/global-services.adoc +++ b/guide/sections/part2/global-services.adoc @@ -116,7 +116,7 @@ In WIS2, Global Caches provide access to WMO core data for data consumers. This * A Global Cache is designed to support real-time content distribution. Data consumers access data objects from a Global Cache instance by resolving the URL in a data availability notification message and downloading the file to which the URL points. Only by checking the URL, is it transparent to the data consumers from which Global Cache they are downloading the data. There is no need to download the same data object from multiple Global Caches. The data id contained within notification messages is used by data consumers and Global Services to detect such duplicates. * There is no requirement for a Global Cache to provide a browsable interface to the files in its repository in order to allow data consumers to discover what content is available. However, a Global Cache may choose to provide such a capability (for example, implemented as a WAF), along with documentation to inform data consumers of how the capability works. * The default behaviour for a Global Cache is to cache all data published under the ``origin/a/wis2/data/+/core`` topic. A data publisher may indicate that data should not be cached by adding the ``"cache": false`` assertion in the WIS2 Notification Message. -* A Global Cache may decide not to cache data, for example, if the data are considered too large, or if a WIS2 Node publishes an excessive number of small files. If a Global Cache decides not to cache data, it should behave as though the cache property is set to false and send a message on the monitor topic hierarchy to inform the originating centre and its GISC. The Global Cache operator should work with the originating WIS2 Node and its GISC to remedy this issue. +* A Global Cache may decide not to cache data, for example, if the data are considered too large, or if a WIS2 Node publishes an excessive number of small files. If a Global Cache decides not to cache data, it should behave as though the cache property is set to false and send a message on the ``monitor`` topic hierarchy to inform the originating centre and its GISC. The Global Cache operator should work with the originating WIS2 Node and its GISC to remedy this issue. * If core data are not cached on a Global Cache (that is, if the data are flagged as ``"cache": false`` or if the Global Cache decides not to cache these data), the Global Cache shall nevertheless republish the WIS2 Notification Message to the ``cache/a/wis2/...`` topic. In this case, the message id will be changed, and the rest of the message will not be modified. * A Global Cache should operate with a fixed IP address so that WIS2 Nodes can permit access to download resources based on IP address filtering. A Global Cache should also operate with a publicly resolvable DNS name pointing to that IP address. The WMO Secretariat must be informed of the IP address and/or hostname, and any subsequent changes. * A Global Cache should validate the integrity of the resources it caches and only accept data that match the integrity value from the WIS2 Notification Message. If the WIS2 Notification Message does not contain an integrity value, the Global Cache should accept the data as valid. In this case, the Global Cache may add an integrity value to the message it republishes.