App keeps reconnecting to Atem Mini and Atem 1 Production Studio

[Dumk0]

• I'm submitting a ...
  [v] bug report
  [ ] feature request
  [ ] question about the decisions made in the repository
  [ ] question about how to use this project

• Summary
  A few months ago the library was working fine with Atem Mini and Atem 1 M/E Production Studio 4K switches.
  But now it keeps reconnecting to both. Debug output is below:

SEND 101453ab00000000003a00000100000000000000
RECV 101453ab00000000000000000200038e00000000
SEND 800c53ab0000000000000000
RECV 0d54838e0000000000000001000cffff5f7665720002001e003400045f70696e4154454d204d696e6900000000201c5c4343645004080480000000020000000000507270040008000d000000002401005f746f70010e01010001000004010000000000010000010000000101012003e8000c64505f4d654300010002000c00005f6d706c14000100000c00005f46414306006450003c00805f46454300040000015072700000001e0000018b020c03e800000064000005c804000001000001c200001ee608e0000000000578000054c4007464505f564d430008000008010000000000000000000000090000000000000000000000000a0100010000000000000000000b013a000000000000000000001a4364500000000000000000000c0000000000000000000000000d0000200000000000000000001b000000000000000000000000000c00005f4d41436420ffff002064505f44564500010011101112131415161718191a1b1c1d1e1f22200000000c6450506f777201000004000c00005669644d0c000800000c08004169564d00006450000c038054634c6b00000000000c72705443436301000000002c0000496e50720000426c61636b000000000000507270040008000000424c4b0001500100010001081001002c0001496e5072000143616d657261203100000020000043436450020843414d3101020002000200501101002c0800496e5072000243616d657261203200800000000200000000005043414d3201000002000200201101002c6450496e5072000343616d657261203300700000000000000000002043414d3301500002000200001101002c0000496e5072000443616d657261203400004343645003010d01000143414d3401000002000200521101002c0000496e507203e8436f6c6f722042617273000000000050727002544241525301000100010002431001002c0202496e507207d1436f6c6f72203100000000000000002063534343434f4c3101030100010003010001002c7270496e507207d2436f6c6f72203200645003010801000100000000434f4c3201700100010003000001002c0000496e50720bc24d6564696120506c617965722031005c000000004d50310001000100010004081001002c0004496e50720bc34d6564696120506c617965722031204b657900084d50314b01040100010005501001002c0000496e5072271a50726f6772616d0002800000000400000000005050474d0001000100010080200100002c6450496e5072271b50726576696577007374000000000000000000205056570001500100010080000100002c0000496e50722af943616d65726120312044697265637400058000004449520001000002000207000100002c7270496e50721f414f757470757400000002000000000000000000000000002001700100010081430000000c008050726749000000010010000050727649002000020020645000106450547253530000010001000000000c0000547250720000727000106450547250730000198000000001000c0000544d785000192454000c727054447050001907d1001c0d015457705000190600000007d11388206c1388138800006450001c6450544476500019191c0bc20bc3010101f402bc000000207270001c6450545374500001010201f402bc000000020049002200050000000c72704b654f6e00000050001c05034b6542500000000101000bc20bc300202328dcd8c1803e80001464504b654c6d0000010001f402bc00000800002008004b41436b00000000000001f4000000000000000003e8000000000000001800004b41434300000000c3e920bf02711a5c065503f7001800004b6550740000060013881388206c138813880050
RECV 08b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 880c838e0000000000000009
SEND 800c838e0001000000000000
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 880c838e000000000000000a

... (pretty much the same lines as above but with growing amount of 280c838e000... events between 28b8838e000...)

RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 280c838e000000000000000a
RECV 280c838e000000000000000c
RECV 280c838e000000000000000e
RECV 280c838e000000000000000b
RECV 280c838e000000000000000d
RECV 280c838e000000000000000f
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 280c838e000000000000000a
RECV 280c838e000000000000000c
RECV 280c838e000000000000000e
RECV 280c838e000000000000000b
RECV 280c838e000000000000000d
RECV 280c838e000000000000000f
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 280c838e000000000000000a
RECV 280c838e000000000000000c
RECV 280c838e000000000000000e
RECV 280c838e000000000000000b
RECV 280c838e000000000000000d
RECV 280c838e000000000000000f
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 280c838e000000000000000a
RECV 280c838e000000000000000c
RECV 280c838e000000000000000e
RECV 280c838e000000000000000b
RECV 280c838e000000000000000d
RECV 280c838e000000000000000f
RECV 28b8838e00000000000000080020ffff4343645004080380000000040000000000507270000000000000000000201c5c434364500408048000000002000000000050727004000800000000000020010043436450040805800000000100000000005072700800000000000000002003e8434364500408068000000002000000000050727000000800000000000020000043436450040b00800000000200000000005072700000000000000000000c03e8496e436d01010202
RECV 280c838e0000000000000009
RECV 280c838e000000000000000a
RECV 280c838e000000000000000c
RECV 280c838e000000000000000e
RECV 880c838e0000000000000010
RECV 280c838e000000000000000b
RECV 280c838e000000000000000d
RECV 280c838e000000000000000f
RECV 1014838e00000000003400000400000000000000
SEND 800c838e0000000000000000
RECV 3014838e0000000000cd00000400000000000000
SEND 800c838e0000000000000000
reconnect

each reconnect generates the same log.

Library version: 2.2.2
Atem firmware: 8.5

I am not sure if firmware was upgraded on the devices since the time when it was working.

[Dumk0]

Seems that the issue appears when communication goes through VPN connection.
I tried to run the same code from pc located at that network where Atem switch is and it works without errors.

[Julusian]

That makes sense. I can't remember which way it is running anymore, but there are pings being sent to detect for timeouts/disconnects.
In general the protocol is rather picky about latency and if the client/atem doesnt respond within a few hundred ms the connection will be closed and trigger a reconnect.

There might be something we can do on our side to minimise the risk of this, but a lot of this is enforced by the atem, so I am not confident.

Sometimes I have had issues with even the official app over a vpn, and other times not.