v0.20.7

Changes

• chore: Add dev certificates to the Dockerfile (#1657) @wojciechsromek
• Au/network metrics (POP-2879) (#1634) @naure
• Au/iris workers NUMA-awareness (POP-2820) (#1594) @naure
• [POP-2841] Bump hnsw e2e max batch size and wait until key generation by gpu (#1653) @eaypek-tfh
• Add profiling config to dev [POP-2886] (#1654) @eaypek-tfh
• POP-2846 (#1617) @mcalancea
• [POP-2885] Unify image tagging and image build pipeline trigger in GPU and CPU (#1649) @eaypek-tfh
• Use x86_64 arch in CPU pipeline (#1648) @eaypek-tfh
• (POP 2815) Use search instead of search_to_insert for non-centers (#1607) @mcalancea
• Chore/revert backtrace upgrade (#1643) @carlomazzaferro
• Revert e2e iris-mpc GPU max batch size to 64 (#1638) @eaypek-tfh
• bump tokio to 1.47.1 and backtrace to 0.3.75 (#1636) @mcalancea
• Consolidate GPU and CPU e2e configs (#1635) @eaypek-tfh
• au/fast-metrics: Fast metrics with local aggregation (POP-2813) (#1620) @naure
• [POP-2855] Decumulate the 2D cumulative bucket counts (#1630) @leonanos8
• Mihai/POP-2850: Iris store HashMap to Vec (#1626) @mcalancea
• Do not run key-manager in hnsw e2e pod init (#1632) @eaypek-tfh

Maintenance

• profiling server up to the point that it works ~60 secs (#1641) @carlomazzaferro
• document access to dev cluster (#1640) @carlomazzaferro

v0.20.6

Changes

• add 2d mongo collection in the purge script for ease of testing (#1624) @leonanos8
• [POP-2845] Less alloc in MPC primitives (#1619) @mcalancea
• [POP-2854] introduce new env var for iris-mpc-cpu image tag in e2e tests (orb-context-environment) (#1627) @leonanos8
• au/borrow-iris: Avoid Arc::clone and Vec in dot product workers (POP-2853) (#1625) @naure
• [POP-2658] 2D anon stats on GPU (#1557) @dkales
• (POP 2812) Different scheduler for search (#1606) @mcalancea
• Bump actions/checkout from 4.2.1 to 5.0.0 (#1602) @dependabot[bot]
• Bump tracing-subscriber dependency to version 0.3.20 (#1622) @bgillesp
• [POP-2804] Extend py-bindings for graph structure (#1596) @mcalancea
• (POP 2842) extend benches/dot with more scenarios (#1601) @mcalancea
• gate metric recording on send under a feature (#1616) @mcalancea
• [POP-2808] add build_plaintext.rs (#1593) @mcalancea
• INFRA-5122 Update iris-mpc image on ampc-hnsw-dev (#1612) @MichalLeszczynski
• chore: Allow hyphens in schema names + alter DNS config for e2e (#1611) @wojciechsromek
• INFRA-5122 Update ampc-hnsw-dev requests and limits (#1610) @MichalLeszczynski
• Iris worker pool (POP-2819) (#1576) @naure
• INFRA-5122 Supplement missing values for ampc-hnsw-dev (#1609) @MichalLeszczynski
• INFRA-5122 Add values for ampc-hnsw-dev (#1604) @MichalLeszczynski
• Bump max_db_size to 18M in prod (#1599) @leonanos8
• remove unused (#1600) @carlomazzaferro
• Bump docker/setup-buildx-action from 3.10.0 to 3.11.1 (#1590) @dependabot[bot]
• Bump docker/build-push-action from 6.15.0 to 6.18.0 (#1589) @dependabot[bot]
• E2e/templates for hnsw e2e (#1598) @carlomazzaferro
• INFRA-5126: deploy refactored relyance workflow to team infra repositories (#1597) @tcharewicz
• au/phase-parallel: introduce session groups; parallelize intra_batch [POP-2741] (#1568) @naure
• au/simplify-eval: In eval_distance_batch, support a single query (#1575) @naure
• [POP-2717] Implement genesis 104 e2e test (#1573) @bgillesp
• Temporarily remove PRF check to unblock staging (#1592) @bgillesp
• au/phase-metrics: more metrics + metrics-logger in tests [POP-2777] (#1567) @naure
• Chore/fix docker build cargo edit version (#1587) @carlomazzaferro
• prod values for ampc-hnsw (#1583) @carlomazzaferro
• Bump docker/setup-buildx-action from 3.10.0 to 3.11.1 (#1502) @dependabot[bot]
• Bump docker/build-push-action from 6.15.0 to 6.18.0 (#1501) @dependabot[bot]
• Bump hoverkraft-tech/compose-action from 2.2.0 to 2.3.0 (#1500) @dependabot[bot]
• release: Enable Reauth in production (#1571) @wojciechsromek
• cargo edit version (#1578) @carlomazzaferro
• Replace double colon metrics domain separators with dots (#1574) @bgillesp
• Chore: replace eu-north-1 to eu-central-1 after the infrastructure move in argocd script (#1561) @leonanos8
• fix: Use correct host (#1560) @wojciechsromek
• Finish genesis 100 and 101 tests (#1555) @sdwoodbury
• add check to verify that the PRF didnt get out of sync (#1530) @sdwoodbury
• feat: Set correct SG IDs for ampc in eu-central-1 (#1559) @jazzbee
• bench-dot: Benchmark for galois_ring_pairwise_distance (#1539) @naure
• [POP-2705] Implement initialization of s3 deletions data for genesis e2e (#1553) @bgillesp
• filter-valid-entries: Retain valid entries after batch sync [POP-2670] (#1532) @naure
• feat: add production participants' CA certs (#1542) @jazzbee
• [POP-2750] Refactor HawkActor insertion code to support plaintext execution (#1546) @bgillesp
• Refactor HawkSession struct (#1545) @bgillesp
• [POP-2734] stagger connections and increase delay between retries (#1544) @sdwoodbury
• [POP-2730] Revise PlaintextStore to support stored iris version (#1541) @bgillesp
• Bump the AMPC HNSW Stage instance type (#1543) @kszarek
• [POP-2699] Add TCP keepalive and metrics for reconnect (#1536) @sdwoodbury
• Simplify pairwise_distance (#1535) @naure
• feat: Download CA certs and add them to docker image (#1523) @jazzbee
• chore: Use pod IPs (#1529) @wojciechsromek
• chore: Set hostNetwork: false (#1528) @wojciechsromek
• Lower memory requirements for HNSW (#1527) @kszarek
• Lower memory requirements for HNSW (#1526) @kszarek
• INFRA-4966 Change HNSW stage instance to x2iedn.8xlarge (#1525) @kszarek
• Add pod sg config for smpc-hnsw-stage (#1524) @MichalLeszczynski
• feat: use default value of replicas for AMPC-HNSW deployment (#1522) @jazzbee
• feat: scale down deployment on stage environment (#1521) @jazzbee
• INFRA-4872 Add values files for new eks on ampc-hnsw (#1519) @MichalLeszczynski
• [POP-2568] e2e test values for GT anon stats test (#1517) @leonanos8
• Add snapshotting after database backup (#1511) @danielle-tfh
• Fix NGINX - resolve nginx startup issues in non-root container (#1516) @kszarek
• Fix: add NGINX access log format (#1515) @kszarek
• set terminationGracePeriodSecods in stage (#1514) @carlomazzaferro
• INFRA-482 Add SSL certificate to application container and NGINX Sidecar (#1510) @kszarek
• aurel/test-shutdown-handler (#1512) @naure

Features

• [POP-2714] Implement delta protocol for plaintext genesis indexer (#1569) @bgillesp
• E2E tests for GPU anon stats (#1507) @dkales
• [POP-2564] HNSW E2E: Framework + Genesis 100 (#1503) @siajasl

Bug Fixes

• Fix off-by-one error in serial ids for init-test-dbs graphs (#1621) @bgillesp
• Bump reqwest from 0.12.9 to 0.12.12 (#1588) @dependabot[bot]
• bandaid fix for batch sync (#1595) @carlomazzaferro
• Bump actions/cache from 4.2.3 to 4.2.4 (#1585) @dependabot[bot]
• fix docker build (#1584) @carlomazzaferro
• Improve batch sync mechanism (#1572) @carlomazzaferro
• Fix dependency compatibility issue in CPU Integration Tests CI/CD workflow (#1566) @bgillesp
• (bugfix): fix logic that assigns sessions to network connections (#1506) @sdwoodbury

Maintenance

• Refactor and simplify genesis e2e runners (#1582) @bgillesp
• Restructure some files in genesis e2e tests (#1581) @bgillesp
• Implement genesis 106 e2e test (#1580) @bgillesp
• [POP-2718] Implement genesis 105 e2e test (#1579) @bgillesp
• add genesis test cases 102 and 103 (#1563) @sdwoodbury
• [POP-2656] Implement anon stat change in hnsw that do not count all rotations (#1445) @leonanos8
• update to security.md (#1540) @orlra

v0.20.5

What's Changed

• Fix the latest_serial_id metric by @danielle-tfh in #1488
• Fix last persisted delta modification to always be stored by @danielle-tfh in #1489
• [POP-2647] Introduce env var to control full scan side switching by @leonanos8 in #1490
• Add check to ensure latest persisted index matches the height of the … by @danielle-tfh in #1487
• Genesis skip deletions for staging by @danielle-tfh in #1491
• Add syncing on modifications during startup by @danielle-tfh in #1493
• [POP-2614] Implement parallel quicksort for HNSW search by @bgillesp in #1471
• do not bubble up errors from main by @eaypek-tfh in #1498
• distance <= threshold by @naure in #1479
• Add TLS capability to the networking stack by @sdwoodbury in #1478
• pass around batch sha and valid entries by @carlomazzaferro in #1496
• Add defining serial id when inserting into plaintext HNSW database by @danielle-tfh in #1459
• Fix processing time and add logs for genesis batches by @danielle-tfh in #1504
• Implement table copying for Genesis roll-back by @danielle-tfh in #1495
• Fix CI issues for GH actions by @danielle-tfh in #1509
• Only load iris database up to max index id by @danielle-tfh in #1505
• Add retries for the heartbeat task by @danielle-tfh in #1508

Full Changelog: v0.20.4...v0.20.5

v0.20.4

What's Changed

• Update purge stage dbs script by @danielle-tfh in #1486
• Fix saving prev modification by @danielle-tfh in #1485

Full Changelog: v0.20.3...v0.20.4

v0.20.3

What's Changed

• aurel/test-is_match: Unittests for search functions by @naure in #1475
• Deploy v0.20.2 to stage by @leonanos8 in #1482
• Deploy v0.20.2 to prod by @leonanos8 in #1483
• Skip actions on config changes [POP-2639] by @eaypek-tfh in #1484
• Add Genesis modification metrics by @danielle-tfh in #1480
• POP-2575: Add iris copying from iris store to HSNW store by @danielle-tfh in #1462

Full Changelog: v0.20.2...v0.20.3

v0.20.2

Changes

• Release v0.20.1 to prod with bumped max db size (#1474) @eaypek-tfh
• Add using seed for shares creation for tests (#1452) @danielle-tfh
• (chore): Make Networking use a NetworkValue instead of Vec (#1473) @sdwoodbury
• release v0.20.1 in stage (#1472) @eaypek-tfh
• aurel/parallel-mirror: Run normal and mirrored searches in parallel (#1469) @naure
• aurel/refactor-batch: Group related "pushes" into methods (#1467) @naure
• [POP-2533] Implement processing of modifications in delta (#1432) @bgillesp
• [POP-2566] Deprecate legacy fields from e2e input struct (#1466) @leonanos8
• POP-2588-reset-order: Track requests_order and do modifications in order (#1464) @naure

Bug Fixes

• aurel/fix-db-size (#1477) @naure
• Fix anon stats. (#1451) @dkales

Maintenance

• INFRA-4818 docs: Code signing update (#1470) @danielllek
• (feat): Use TcpStream for MPC networking (#1443) @sdwoodbury

v0.20.1

Changes

• Do not tolerate HNSW result sender failures (#1465) @eaypek-tfh
• Enable replaying reset check results & add HNSW reset results persistence (POP-2591 & POP-2589) (#1463) @eaypek-tfh
• bump stage versions (#1460) @eaypek-tfh
• Chore/hnsw test latest (#1421) @carlomazzaferro

Maintenance

• [POP-2579] [POP-2578] Chore/remove shadow readonly mode (#1461) @carlomazzaferro

v0.20.0

Changes

• Sync graph modifications on startup by rolling forward (#1457) @eaypek-tfh
• Cover edge case in sqs sync (#1458) @eaypek-tfh
• [POP-2586] Select HNSW layers based on identifiers (#1455) @bgillesp
• More reauth test (#1450) @naure
• Store graph modifications (#1449) @eaypek-tfh
• Do not store distances in HawkMutation (#1448) @naure
• Reauth matching test (#1436) @naure
• remove properties from batch (#1447) @carlomazzaferro
• deploy v0.19.1 to stage (#1444) @leonanos8

Features

• Add basic metrics for Genesis Handler (#1456) @danielle-tfh
• [POP-2563] Genesis: Batch generator unit test hardening (#1441) @siajasl

Bug Fixes

• aurel/test-reject: Fix missing connectivity of the first batch (#1454) @naure
• Add fix for reading graphs with deletions that are not present (#1453) @danielle-tfh
• Fix skip persistence on batch (#1438) @danielle-tfh
• Allow suffix for creating GPU database schema (#1440) @danielle-tfh

v0.19.1

Changes

• Enable roll-forward on enrollments by using modifications table (#1442) @eaypek-tfh

v0.19.0

Changes

• aurel/matching-test: Unit tests for the matching module (#1427) @naure

Features

• [POP-2478] Store rotation indices for partial matches (#1398) @leonanos8

Bug Fixes

• fix: only clear anon stat buckets after normal&mirror orientation run (#1439) @leonanos8