ESDB Subscriptions die intermittently

[mbirkegaard]

We're seeing subscriptions getting dropped from time to time. Usually +30 hours after starting.

Logs on the consumer side say "Subscription stopped"

And on the the ESDB side we see nothing around the same time

Ideally the subscription would just restart and consumers resume from where they left off, but let me know if we need to do own monitoring (like polling whether the subscription or consumer is running).

[oskardudycz]

SLOW BUS MSG and SLOW QUEUE MSG could suggest that the database is undeprovisioned or under load (although it doesn't have to be). The Closing gRPC client connection looks weird. I'll also try to see what could be a reason, but nevertheless, I'll add auto-restart capabilities for Emmett consumer.

[oskardudycz]

I'm going to close this ticket, as we added some fixes around it already in last releases.