Skip to content

Commit e8161f0

Browse files
biozitdjw8605Copilot
authored
* adding xrootd/xrootd#2373 b_todisk: number of bytes written to disk; and b_prefetch: number of bytes requested via prefetching. One can now determine the amount of data cache read from the remote (b_todisk + b_bypass) and also how much of this transfer was driven by prefetching (b_prefetch). Note that b_todisk includes b_prefetch -- number of bytes for which explicit remote read calls had to be issued is b_todisk + b_bypass - b_prefetch. adding xrootd/xrootd#2373 * Update Collectors/DetailedCollector.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update Collectors/DetailedCollector.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update Collectors/DetailedCollector.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Derek Weitzel <djw8605@gmail.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
1 parent 2140f53 commit e8161f0

File tree

1 file changed

+14
-0
lines changed

1 file changed

+14
-0
lines changed

Collectors/DetailedCollector.py

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -394,8 +394,22 @@ def process_gstream(self, gstream, addr, sid):
394394
event["remotes_origin"] = ""
395395
event["bytes_hit_cache"] = event.pop("b_hit")
396396
event["bytes_miss_cache"] = event.pop("b_miss")
397+
397398
# number of bytes bypass by the cache due an overload
398399
event["bytes_bypass_cache"] = event.pop("b_bypass")
400+
401+
# b_todisk: number of bytes written to disk
402+
event["bytes_to_disk"] = event.pop("b_todisk")
403+
404+
# b_prefetch: number of bytes requested via prefetching
405+
event["bytes_by_prefetch"] = event.pop("b_prefetch")
406+
407+
# One can now determine the amount of data cache read from the remote (b_todisk + b_bypass) and also how much of this transfer was driven by prefetching (b_prefetch). Note that b_todisk includes b_prefetch.
408+
event["bytes_read_by_remote"] = event["bytes_to_disk"] + event["bytes_bypass_cache"]
409+
410+
# number of bytes for which explicit remote read calls had to be issued is b_todisk + b_bypass - b_prefetch.
411+
event["bytes_explicit_remote_read"] = event["bytes_to_disk"] + event["bytes_bypass_cache"] - event["bytes_by_prefetch"]
412+
399413
event["site"] = site
400414
event["vo"] = self.returnVO(event["file_path"])
401415
fname = event["file_path"]

0 commit comments

Comments
 (0)