Skip to content

Conversation

mackenzie-grimes-noaa
Copy link
Contributor

Linear Issue

IDSSE-1256

Changes

  • Add PackType option to bit pack: INT.
    • Maximum size of a data value is max int (2 ^ 32) or about 4.2 billion

Explanation

Some NBM weather data had such a wide range of weather values that DAS web server would throw an error "Unable to find appropriate packing". For example, cloud ceiling caused this error because it had values from 100 ft to 291,000 ft.

This error was because the bit_pack module was at most packing data into "SHORT"-sized blocks, which go from 0 to 65,535. Now we can bit-pack data into INT-sized memory blocks. It's not nearly as efficient for disk space/network usage, but if the data values vary wildly it may sometimes be needed.

@mackenzie-grimes-noaa mackenzie-grimes-noaa merged commit fbcbc45 into main Jun 18, 2025
2 checks passed
@mackenzie-grimes-noaa mackenzie-grimes-noaa deleted the bug/unable-to-pack-bits branch June 18, 2025 16:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant