Skip to content

use NGINX tls ports #1518

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 138 commits into from
Closed

use NGINX tls ports #1518

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
138 commits
Select commit Hold shift + click to select a range
c87de15
mainchanges
wojciechsromek Jun 6, 2025
f1bdd3e
work in progress
wojciechsromek Jun 9, 2025
a33026d
merge
carlomazzaferro Jul 1, 2025
5de06fa
Merge branch 'main' into POP-2530/implement-anon-stat-change-in-hnsw-…
dkales Jul 7, 2025
1a0b05a
rewrite anonymized bucket statistics to only include the minimum FHD …
dkales Jul 7, 2025
3dc156f
remove unused function
dkales Jul 7, 2025
f8a0c13
Merge branch 'main' into POP-2530/implement-anon-stat-change-in-hnsw-…
dkales Jul 7, 2025
51c90e2
Merge branch 'main' into POP-2530/implement-anon-stat-change-in-hnsw-…
leonanos8 Jul 9, 2025
fe4ca4d
Add TLS capability to the networking stack (#1478)
sdwoodbury Jul 9, 2025
f2f9ea8
pass around batch sha and valid entries (#1496)
carlomazzaferro Jul 10, 2025
38c36d6
Add defining serial id when inserting into plaintext HNSW database (#…
danielle-tfh Jul 10, 2025
fad9a76
Fix processing time and add logs for genesis batches (#1504)
danielle-tfh Jul 10, 2025
69044bc
Implement table copying for Genesis roll-back (#1495)
danielle-tfh Jul 10, 2025
61c2374
feat: anon stats buffer size config value is now more similar to GPU …
dkales Jul 11, 2025
462b493
use NGINX tls ports
carlomazzaferro Jul 14, 2025
350d001
ff sha
carlomazzaferro Jul 14, 2025
9c1f8ab
client tls + server tcp
carlomazzaferro Jul 15, 2025
61b8330
client tls + server tcp
carlomazzaferro Jul 15, 2025
9576a5d
spurious change
carlomazzaferro Jul 15, 2025
ef4b402
tls configs
carlomazzaferro Jul 15, 2025
02632cd
nginx in docker
carlomazzaferro Jul 15, 2025
1c95ec1
final configs for tls locally running w/ nginx
carlomazzaferro Jul 15, 2025
64d8703
skip verification server
carlomazzaferro Jul 16, 2025
e137d6b
custom branch build
carlomazzaferro Jul 16, 2025
836c3b4
custom image + tls configs
carlomazzaferro Jul 16, 2025
5bd5e75
correct image sha
carlomazzaferro Jul 16, 2025
e1812b2
deploy
carlomazzaferro Jul 16, 2025
4490ccd
feat: Download CA certs and add them to docker image
jazzbee Jul 21, 2025
c5d9c4a
Merge remote-tracking branch 'origin/feat-INFRA-4821-cert' into chore…
wojciechsromek Jul 21, 2025
79b172a
Merge remote-tracking branch 'origin/main' into chore/test-tls-in-stage
wojciechsromek Jul 22, 2025
2911edd
use os certs
wojciechsromek Jul 22, 2025
e1d8ae7
deploy new certs handling
wojciechsromek Jul 22, 2025
1269ca7
fmt
wojciechsromek Jul 22, 2025
486e9b5
request pod-eni
wojciechsromek Jul 22, 2025
2233815
do not use hostNetwork
wojciechsromek Jul 22, 2025
b395f18
restore the last know working image
wojciechsromek Jul 22, 2025
fcd6926
use pod IP instead of node IP
wojciechsromek Jul 22, 2025
03e119a
expose additional ports
wojciechsromek Jul 22, 2025
9bf9b17
do not order enis, should happen by itself
wojciechsromek Jul 22, 2025
4b77897
apply logic to use ca carts
wojciechsromek Jul 22, 2025
d51918b
do not skip tls verification
wojciechsromek Jul 22, 2025
2475927
restore old image sha (before home ca)
wojciechsromek Jul 22, 2025
4619875
restore tls verification skip
wojciechsromek Jul 22, 2025
175acf8
run staging based on CA certs
wojciechsromek Jul 22, 2025
e2ca18f
deploy latest commit
wojciechsromek Jul 23, 2025
846856b
ssl_verify_client off
wojciechsromek Jul 23, 2025
385df32
revert change, make sure we are using fullchain cert for nginx
wojciechsromek Jul 23, 2025
cfc2cae
print subjects of loaded certs
wojciechsromek Jul 23, 2025
5fc8834
deploy new code
wojciechsromek Jul 23, 2025
01053c5
correct sha
wojciechsromek Jul 23, 2025
4e8f9fc
new sha, with correct certs
wojciechsromek Jul 23, 2025
aec399b
connect on url, not ip address
wojciechsromek Jul 24, 2025
7b7d9f4
fmt
wojciechsromek Jul 24, 2025
c8b77a7
added new image sha
wojciechsromek Jul 24, 2025
c72b4ba
sha
wojciechsromek Jul 24, 2025
da9aedc
test app-tls
wojciechsromek Jul 24, 2025
f39a3c9
remove unused skip tls verification
wojciechsromek Jul 24, 2025
d3f9fbf
fmt
wojciechsromek Jul 24, 2025
3b241e3
app-level tls
wojciechsromek Jul 25, 2025
e1e056b
deploy new sha
wojciechsromek Jul 25, 2025
316c33c
small improvements
wojciechsromek Jul 25, 2025
80ba406
deploy new sha
wojciechsromek Jul 25, 2025
c95da8b
fixes
wojciechsromek Jul 25, 2025
22f1ae8
deploy fixes
wojciechsromek Jul 25, 2025
c95a305
array notation fix
wojciechsromek Jul 25, 2025
5183aa7
array notation fix
wojciechsromek Jul 25, 2025
659183d
array notation fix
wojciechsromek Jul 25, 2025
a9a8789
config change
wojciechsromek Jul 25, 2025
a5e86f2
sha
wojciechsromek Jul 25, 2025
91ed082
do not use nginx ports
wojciechsromek Jul 25, 2025
5b84516
do not require client to present cert
wojciechsromek Jul 25, 2025
0ee6541
fix client verifier
wojciechsromek Jul 28, 2025
926b5fa
deploy new sha
wojciechsromek Jul 28, 2025
200b40b
disable nginx sidecar
wojciechsromek Jul 28, 2025
0d4b86b
bump requests
wojciechsromek Jul 28, 2025
c4f7fa3
request bigger machine
wojciechsromek Jul 28, 2025
fa6cfac
[POP-2699] Add TCP keepalive and metrics for reconnect (#1536)
sdwoodbury Jul 25, 2025
32253c1
stagger connections and increase delay between retries
sdwoodbury Jul 29, 2025
9b95c47
make iris-mpc use grpc instead of tcp
sdwoodbury Jul 28, 2025
7925187
wip: tls
sdwoodbury Jul 28, 2025
0f865e2
make iris-mpc use gRPC and attempt to add TLS too
sdwoodbury Jul 29, 2025
10d9d6a
bugfix: server cert and domain name
sdwoodbury Jul 29, 2025
d1c5f72
deploy latest changes by stuart
wojciechsromek Jul 29, 2025
b10adcc
remove TLS
wojciechsromek Jul 29, 2025
b5f1eb5
bump connection parallelism to 32
wojciechsromek Jul 29, 2025
ce4c8d8
bump connection parallelism to 128
wojciechsromek Jul 29, 2025
468b2cc
bump connection parallelism to 64
wojciechsromek Jul 29, 2025
ffdd47a
restore the original parallelism
wojciechsromek Jul 29, 2025
4859da4
deploy to bigger host
wojciechsromek Jul 30, 2025
851ff03
use new stage eu-central-1
wojciechsromek Aug 6, 2025
cf10571
proper sgs
wojciechsromek Aug 6, 2025
c2289d3
use eu-north-1 to not introduce secondary source truth
wojciechsromek Aug 6, 2025
4a0e2fe
do not use double colon in metric names
wojciechsromek Aug 6, 2025
97ea6c7
update image to use new metric names
wojciechsromek Aug 6, 2025
3b22a71
remove double colon
carlomazzaferro Aug 6, 2025
c875d42
update sha
carlomazzaferro Aug 6, 2025
e1c4e7c
clippy
leonanos8 Aug 15, 2025
56cf5d0
Merge branch 'sw/test-tls-in-stage-grpc' into chore/test-tls-in-stage
leonanos8 Aug 15, 2025
7001612
cargo edit in Dockerfile.hawk
leonanos8 Aug 15, 2025
970292f
new image with grpc comm
leonanos8 Aug 15, 2025
123d323
enable TLS for new round of perf test
leonanos8 Aug 16, 2025
472a2c8
Revert "enable TLS for new round of perf test"
leonanos8 Aug 17, 2025
2c7e6f6
enable TLS for new round of perf test
leonanos8 Aug 16, 2025
1026129
decrease hawk_request parallelism by a factor of 2
leonanos8 Aug 20, 2025
32439b7
Revert "enable TLS for new round of perf test"
leonanos8 Aug 20, 2025
086951f
Revert "Merge branch 'sw/test-tls-in-stage-grpc' into chore/test-tls-…
carlomazzaferro Aug 20, 2025
7ee7c5b
update image and parameters
carlomazzaferro Aug 20, 2025
dd83f5e
update image and parameters
carlomazzaferro Aug 20, 2025
cb2412d
update parameters
carlomazzaferro Aug 20, 2025
531ac97
update parameters
carlomazzaferro Aug 20, 2025
d34230a
merge
carlomazzaferro Aug 21, 2025
e913538
merge
carlomazzaferro Aug 21, 2025
e7e8ed2
clippy
carlomazzaferro Aug 21, 2025
549dc72
latest sha
carlomazzaferro Aug 21, 2025
6586a7a
update parameters
carlomazzaferro Aug 21, 2025
5306dc4
update parameters
carlomazzaferro Aug 21, 2025
522ecb8
update parameters
carlomazzaferro Aug 21, 2025
f069df7
update parameters
carlomazzaferro Aug 21, 2025
8c28d23
bandaid fix for batch sync
dkales Aug 21, 2025
f7d707d
graviton
carlomazzaferro Aug 21, 2025
4ac209b
graviton
carlomazzaferro Aug 21, 2025
83bb41e
disable tls
carlomazzaferro Aug 21, 2025
b04a83c
Revert "bandaid fix for batch sync"
carlomazzaferro Aug 21, 2025
7bd27f5
params
carlomazzaferro Aug 21, 2025
8f21c1d
try building arm64
wojciechsromek Aug 21, 2025
3c6b85d
Merge branch 'chore/test-tls-in-stage' of github.com:worldcoin/gpu-ir…
wojciechsromek Aug 21, 2025
f91be3c
install docker
wojciechsromek Aug 21, 2025
1dae0cd
params
carlomazzaferro Aug 21, 2025
591df8f
Merge branch 'chore/test-tls-in-stage' of github.com:worldcoin/iris-m…
carlomazzaferro Aug 21, 2025
2181060
fix
wojciechsromek Aug 21, 2025
68741ee
Merge branch 'chore/test-tls-in-stage' of github.com:worldcoin/gpu-ir…
wojciechsromek Aug 21, 2025
163f27c
deploy arm64 image
wojciechsromek Aug 21, 2025
27edf19
adapt limits to x8g.24xl instance
wojciechsromek Aug 22, 2025
3a2d88b
Revert "params"
carlomazzaferro Aug 22, 2025
26446db
run on x8g.48xl
wojciechsromek Aug 22, 2025
32baec6
also alter the instance type
wojciechsromek Aug 22, 2025
851ec79
remove qemu from arm64 build pipeline
wojciechsromek Aug 25, 2025
faa2fb8
build for graviton
wojciechsromek Aug 25, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion deploy/stage/ampc-hnsw-0-stage/values-ampc-hnsw.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ env:
value: "eu-north-1"

- name: SMPC__SERVICE_PORTS
value: '["4000","4001","4002"]'
value: '["4000","4101","4102"]'

- name: SMPC__HAWK_SERVER_HEALTHCHECK_PORT
value: '3000'
Expand Down
2 changes: 1 addition & 1 deletion deploy/stage/ampc-hnsw-1-stage/values-ampc-hnsw.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ env:
value: "eu-north-1"

- name: SMPC__SERVICE_PORTS
value: '["4000","4001","4002"]'
value: '["4100","4001","4102"]'

- name: SMPC__HAWK_SERVER_HEALTHCHECK_PORT
value: '3000'
Expand Down
2 changes: 1 addition & 1 deletion deploy/stage/ampc-hnsw-2-stage/values-ampc-hnsw.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ env:
value: "eu-north-1"

- name: SMPC__SERVICE_PORTS
value: '["4000","4001","4002"]'
value: '["4100","4101","4002"]'

- name: SMPC__HAWK_SERVER_HEALTHCHECK_PORT
value: '3000'
Expand Down