Iceoryx2 in Kubernetes, FailedToDeliverSignal.

[DrissiReda]

Hello, did anyone ever use iceoryx2 in Kubernetes?

I want to run a pod with multiple containers that communicate with each other via iceoryx2. I used the event based communication rust example.

With docker compose it works well simply by mounting the same /dev/shm to all services.

I thought it would be the same with Kubernetes, simply creating an emptyDir and mounting it to /dev/shm and adding shareProcessNamespace: true but that is clearly not enough.

I don't think the issue is with the code because it still works well and communication indeed does take place, I just keep getting this warning.

I'm getting this warning by the sender when it is supposed to notify the next container.

Does anybody have any idea?

Here is the warning:

64 [W] Notifier { listener_connections: SingleThreaded { data: ListenerConnections { connections: [UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. }], 
service_state: ServiceState { dynamic_storage: Storage { shm: SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 94, data: 
"iox2_305ad9523c6b202364d581359ec3d2c5743e42e7_626772a4b6690f9fccde77d45ea5cec2a3f01513.dynamic" } }, size: 2739, base_address: 0x7f0f22d9a000, has_ownership: false, file_descriptor: FileDescriptor { value: 11, is_owned: true }, memory_lock: 
None, mapping_offset: 0 }, name: FileName { value: FixedSizeByteString<255> { len: 40, data: 
"626772a4b6690f9fccde77d45ea5cec2a3f01513" } }, _phantom_data: 
PhantomData<iceoryx2::service::dynamic_config::DynamicConfig> }, additional_resource: NoResource, static_config: StaticConfig 
{ service_id: ServiceId(RestrictedFileName { value: FixedSizeByteString<64> { len: 40, data: 
"626772a4b6690f9fccde77d45ea5cec2a3f01513" } }), service_name: ServiceName { value: FixedSizeByteString<255> { len: 29, 
data: "udp_source_to_processor_event" } }, attributes: AttributeSet(FixedSizeVec<iceoryx2::service::attribute::Attribute, 8> { 
MetaVec<iceoryx2::service::attribute::Attribute, iceoryx2_bb_elementary::relocatable_ptr::GenericRelocatablePointer> { capacity: 
8, len: 0, is_initialized: true, content: [  ] } }), messaging_pattern: Event(StaticConfig { max_notifiers: 16, max_listeners: 16, 
max_nodes: 36, event_id_max_value: 255, deadline: None, notifier_created_event: None, notifier_dropped_event: None, 
notifier_dead_event: None }) }, shared_node: SharedNode { id: NodeId(UniqueSystemId { value: 
17817794181064921046063251463, pid: 7, creation_time: Time { clock_type: Monotonic, seconds: 2183293, nanoseconds: 
965904558 } }), details: NodeDetails { executable: FileName { value: FixedSizeByteString<255> { len: 10, data: "udp-source" } }, 
name: NodeName { value: FixedSizeByteString<128> { len: 0, data: "" } }, config: Config { global: Global { root_path: Path { value: 
FixedSizeByteString<255> { len: 18, data: "/dev/shm/iceoryx2/" } }, prefix: FileName { value: FixedSizeByteString<255> { len: 5, 
data: "iox2_" } }, service: Service { directory: Path { value: FixedSizeByteString<255> { len: 8, data: "services" } }, 
data_segment_suffix: FileName { value: FixedSizeByteString<255> { len: 5, data: ".data" } }, static_config_storage_suffix: FileName 
{ value: FixedSizeByteString<255> { len: 8, data: ".service" } }, dynamic_config_storage_suffix: FileName { value: 
FixedSizeByteString<255> { len: 8, data: ".dynamic" } }, creation_timeout: 500ms, connection_suffix: FileName { value: 
FixedSizeByteString<255> { len: 11, data: ".connection" } }, event_connection_suffix: FileName { value: FixedSizeByteString<255> { 
len: 6, data: ".event" } }, blackboard_mgmt_suffix: FileName { value: FixedSizeByteString<255> { len: 16, data: 
".blackboard_mgmt" } }, blackboard_data_suffix: FileName { value: FixedSizeByteString<255> { len: 16, data: ".blackboard_data" } 
} }, node: Node { directory: Path { value: FixedSizeByteString<255> { len: 5, data: "nodes" } }, monitor_suffix: FileName { value: 
FixedSizeByteString<255> { len: 13, data: ".node_monitor" } }, static_config_suffix: FileName { value: FixedSizeByteString<255> { 
len: 8, data: ".details" } }, service_tag_suffix: FileName { value: FixedSizeByteString<255> { len: 12, data: ".service_tag" } }, 
cleanup_dead_nodes_on_creation: true, cleanup_dead_nodes_on_destruction: true } }, defaults: Defaults { publish_subscribe: 
PublishSubscribe { max_subscribers: 8, max_publishers: 2, max_nodes: 20, subscriber_max_buffer_size: 2, 
subscriber_max_borrowed_samples: 2, publisher_max_loaned_samples: 2, publisher_history_size: 0, enable_safe_overflow: true, 
unable_to_deliver_strategy: Block, subscriber_expired_connection_buffer: 128 }, event: Event { max_listeners: 16, max_notifiers: 
16, max_nodes: 36, event_id_max_value: 255, deadline: None, notifier_created_event: None, notifier_dropped_event: None, 
notifier_dead_event: None }, request_response: RequestResonse { enable_safe_overflow_for_requests: true, 
enable_safe_overflow_for_responses: true, max_active_requests_per_client: 4, max_response_buffer_size: 2, max_servers: 2, 
max_clients: 8, max_nodes: 20, max_borrowed_responses_per_pending_response: 2, max_loaned_requests: 2, 
server_max_loaned_responses_per_request: 2, client_unable_to_deliver_strategy: Block, server_unable_to_deliver_strategy: 
Block, client_expired_connection_buffer: 128, enable_fire_and_forget_requests: true, server_expired_connection_buffer: 128 }, 
blackboard: Blackboard { max_readers: 8, max_nodes: 20 } } } }, monitoring_token: UnsafeCell { .. }, registered_services: 
RegisteredServices { data: Mutex { data: {ServiceId(RestrictedFileName { value: FixedSizeByteString<64> { len: 40, data: 
"626772a4b6690f9fccde77d45ea5cec2a3f01513" } }): (ContainerHandle { index: 0, container_id: 5 }, 1), 
ServiceId(RestrictedFileName { value: FixedSizeByteString<64> { len: 40, data: "f3a12830905c19d9a0f610df1e08b64dd0bea1ed" } 
}): (ContainerHandle { index: 0, container_id: 2 }, 1)}, poisoned: false, .. } }, signal_handling_mode: HandleTerminationRequests, 
_details_storage: Storage { name: FileName { value: FixedSizeByteString<255> { len: 4, data: "node" } }, config: Configuration { 
path: Path { value: FixedSizeByteString<255> { len: 53, data: "/dev/shm/iceoryx2/nodes/17817794181064921046063251463" } }, 
suffix: FileName { value: FixedSizeByteString<255> { len: 8, data: ".details" } }, prefix: FileName { value: FixedSizeByteString<255> 
{ len: 5, data: "iox2_" } } }, has_ownership: false, file: File { path: Some(FilePath { value: FixedSizeByteString<255> { len: 71, data: "/
dev/shm/iceoryx2/nodes/17817794181064921046063251463/iox2_node.details" } }), file_descriptor: FileDescriptor { value: 3, 
is_owned: true }, has_ownership: false }, len: 1757 } }, static_storage: Storage { name: FileName { value: FixedSizeByteString<255> 
{ len: 40, data: "626772a4b6690f9fccde77d45ea5cec2a3f01513" } }, config: Configuration { path: Path { value: 
FixedSizeByteString<255> { len: 26, data: "/dev/shm/iceoryx2/services" } }, suffix: FileName { value: FixedSizeByteString<255> { 
len: 8, data: ".service" } }, prefix: FileName { value: FixedSizeByteString<255> { len: 5, data: "iox2_" } } }, has_ownership: false, file: 
File { path: Some(FilePath { value: FixedSizeByteString<255> { len: 80, data: "/dev/shm/iceoryx2/services/
iox2_626772a4b6690f9fccde77d45ea5cec2a3f01513.service" } }), file_descriptor: FileDescriptor { value: 10, is_owned: true }, 
has_ownership: false }, len: 224 } }, list_state: UnsafeCell { .. } } }, default_event_id: TriggerId(0), event_id_max_value: 255, 
dynamic_notifier_handle: Some(ContainerHandle { index: 0, container_id: 4 }), notifier_id: UniqueNotifierId(UniqueSystemId { 
value: 176496716845094300488302592007, pid: 7, creation_time: Time { clock_type: Monotonic, seconds: 2183293, 
nanoseconds: 977971600 } }), on_drop_notification: None, node_id: NodeId(UniqueSystemId { value: 
17817794181064921046063251463, pid: 7, creation_time: Time { clock_type: Monotonic, seconds: 2183293, nanoseconds: 
965904558 } }) }

[elfenpiff]

@DrissiReda this is the repository for classic iceoryx. Could you repost the issue in iceoryx2 https://github.com/eclipse-iceoryx/iceoryx2

[elfenpiff]

@DrissiReda could you also post the next line of the log message. The log messages are a bit complicated - we are working on it - they always come with two lines, the first line is the origin, the state of the object that logs the message and the second line is the actual log message.

[DrissiReda]

@DrissiReda could you also post the next line of the log message. The log messages are a bit complicated - we are working on it - they always come with two lines, the first line is the origin, the state of the object that logs the message and the second line is the actual log message.

Thanks I did that with the thread I opened in iceoryx2.

[elBoberido]

@DrissiReda I would close the discussion here, since this is specifically a discussion for iceoryx2 and for discoverability, it is better to have the discussion in the iceoryx2 repo -> eclipse-iceoryx/iceoryx2#1107