Calls to device are extremely slow

[janwiesemann]

I'm not sure where to post this issue but I've recently received my Voice Assist PE and I've been experiencing this issue, where It has an extremely bad response time. This issue is also relate to esphome/home-assistant-voice-pe#257 and probably a few other, since this seams to quite a common issue.

It is not related to my network, since Wireshark does not show any packages, which are being send to my Voice PE. In fact, it only shows packages being send by HA, if I execute an action, like a volume change, from my Voice PE.