Skip to content

Conversation

@StephenCWills
Copy link
Member

This PR moves the logic for aggregation to the application rather than the SQL database. This also allows us to slip a proper time zone conversion in before the aggregation rather than attempting to push a makeshift time zone conversion into the database. Instead of one subquery with four subqueries to define the slices for aggregation, we are able to do this with only two queries. IDataReader and IEnumerable were used to avoid loading the full data set into memory during aggregation.

TVA recently changed out their lightning database. We've received word that the TX_LIGHTNING schema no longer exists, and the Vaisala tables now belong to the GIS schema. They also said that Weatherbug data will no longer be available.

@StephenCWills StephenCWills marked this pull request as draft March 30, 2023 16:00
@StephenCWills
Copy link
Member Author

Slipping into draft mode because the Weatherbug data is now likely located in the GIS.EARTH_NETWORKS_PULSE table.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants