remove_listener should: * Remove the listener stream from the configuration * Free up any resources being used, like filters * Etc
