If nothing is sent from client before timeout, we should close the connection, to free a spot in the queue.