Terraform Templates for Resource Creation incl Private Link

This release provides Terraform templates that can set up the entire infrastructure including Fabric resources, Azure resources and MongoDB resources with or without Private Endpoints and Private Link.

v1.1

Enhancement: Write metadata.json as the first file

Enhancement: Write (Patch and Push) a "_TEMP" file and then rename it to original file, instead of directly writing the original file

Enhancement: RTS time interval check : changed logic from Push of change events to push every 20 secs, thus even if no events occur, the changes accumulated will be pushed after TIME interval lapsed

Enhancement: Better datetime handling: changed conversion function from to_datetime() instead of pd.Timestamp() with Timezone also handled

Enhancement: Columns added/ deleted - causes issue if MSFT picks two such files together, for now sufficient delay added

Enhancement : Write a new file (_conversion.log) to LZ if any column was changed to Null based on conversion error

BUG: Decimal 128 was not handled properly - Use MongoDB use MongoDB datatype to identify Bson.Decimal128 and force convert to float64

BUG: Contention Issues: Remove write back to local after reading from LZ in get_file_from_lz

BUG: The loop to get first NOT NULL first record wasn't handled properly and thus initial schema wasn't correct

Enhancement: Integer with NaN is defaulted to Float datatype - use MongoDB datatype to identify it as Int

Enhancement: Timestamp dtype initially was object because of NaN, was force corrected to datetime(ns)