Problem with running TeamEngine based tests in local docker image

[verendi]

We installed the official docker image (docker.pkg.github.com/inspire-mif/helpdesk-validator/inspire-validator:2024.3) locally.
We are having trouble with the 2 TeamEngine based tests for "Direct WFS" and "OGC API-Features". It is not possible to run these 2 tests. We always get the error message "An error has occured" after starting the test.
The request http://localhost:8090/validator/v2/TestRuns ends in a 404 error and gives the error
Direct WFS: ExecutableTestSuiteDao: An object with the id \"ed2d3501-d700-4ff9-b9bf-070dece8ddbd\" could not be found!

OGC API-Features: ExecutableTestSuiteDao: An object with the id \"c543e1ad-465d-3162-ac1a-badef588dc76\" could not be found!

Steps to reproduce

Start the docker container using

docker run --name inspire-validator -d -p 8090:8090 -v ~/etf:/etf docker.pkg.github.com/inspire-mif/helpdesk-validator/inspire-validator:2024.3

Change the config file /etf/config/etf-config.properties and add the remote team engine credentials.
Restart the docker container.

Open the Validator UI http://localhost:8090/validator/ and try to run a Direct WFS or OGC API-Features test.

Full stacktraces for the errors from the test runs requests are:

org.springframework.web.util.NestedServletException: Handler dispatch failed; nested exception is de.interactive_instruments.etf.webapp.controller.LocalizableApiError: de.interactive_instruments.exceptions.ObjectWithIdNotFoundException: ExecutableTestSuiteDao: An object with the id "ed2d3501-d700-4ff9-b9bf-070dece8ddbd" could not be found!
	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:982)
	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
	at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:523)
	at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:590)
	at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1419)
	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:764)
	at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1665)
	at de.interactive_instruments.etf.webapp.filter.ApiFilter.doFilterInternal(ApiFilter.java:89)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347)
	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263)
	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:210)
	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
	at org.eclipse.jetty.websocket.servlet.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:170)
	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)
	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:131)
	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:598)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:223)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1570)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1384)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1543)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1306)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)
	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:149)
	at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:51)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
	at org.eclipse.jetty.server.Server.handle(Server.java:563)
	at org.eclipse.jetty.server.HttpChannel$RequestDispatchable.dispatch(HttpChannel.java:1598)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:753)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:501)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:287)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)
	at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)
	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:421)
	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:390)
	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:277)
	at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:199)
	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:411)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: de.interactive_instruments.etf.webapp.controller.LocalizableApiError: de.interactive_instruments.exceptions.ObjectWithIdNotFoundException: ExecutableTestSuiteDao: An object with the id "ed2d3501-d700-4ff9-b9bf-070dece8ddbd" could not be found!
	at de.interactive_instruments.etf.webapp.controller.TestRunController.start(TestRunController.java:517)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.base/java.lang.reflect.Method.invoke(Unknown Source)
	at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
	at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
	at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
	at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
	... 52 common frames omitted
Caused by: de.interactive_instruments.exceptions.ObjectWithIdNotFoundException: ExecutableTestSuiteDao: An object with the id "ed2d3501-d700-4ff9-b9bf-070dece8ddbd" could not be found!
	at de.interactive_instruments.etf.dal.dao.basex.AbstractBsxDao.getById(AbstractBsxDao.java:209)
	at de.interactive_instruments.etf.webapp.controller.TestDriverController.getById(TestDriverController.java:163)
	at de.interactive_instruments.etf.dal.dao.PreparedDtoResolver.getById(PreparedDtoResolver.java:49)
	at de.interactive_instruments.etf.webapp.dto.StartTestRunRequest.toTestRun(StartTestRunRequest.java:119)
	at de.interactive_instruments.etf.webapp.controller.TestRunController.start(TestRunController.java:474)
	... 63 common frames omitted

2025-04-16 11:42:33.325 [qtp294247762-24] ERROR d.i.e.w.d.ApiError - EXID-1744803753325: An exception occurred while trying to invoke "http://localhost:8080/validator/v2/TestRuns"
org.springframework.web.util.NestedServletException: Handler dispatch failed; nested exception is de.interactive_instruments.etf.webapp.controller.LocalizableApiError: de.interactive_instruments.exceptions.ObjectWithIdNotFoundException: ExecutableTestSuiteDao: An object with the id "c543e1ad-465d-3162-ac1a-badef588dc76" could not be found!
	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:982)
	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
	at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:523)
	at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:590)
	at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1419)
	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:764)
	at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1665)
	at de.interactive_instruments.etf.webapp.filter.ApiFilter.doFilterInternal(ApiFilter.java:89)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347)
	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263)
	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:210)
	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
	at org.eclipse.jetty.websocket.servlet.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:170)
	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)
	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:131)
	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:598)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:223)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1570)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1384)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1543)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1306)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)
	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:149)
	at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:51)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
	at org.eclipse.jetty.server.Server.handle(Server.java:563)
	at org.eclipse.jetty.server.HttpChannel$RequestDispatchable.dispatch(HttpChannel.java:1598)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:753)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:501)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:287)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)
	at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: de.interactive_instruments.etf.webapp.controller.LocalizableApiError: de.interactive_instruments.exceptions.ObjectWithIdNotFoundException: ExecutableTestSuiteDao: An object with the id "c543e1ad-465d-3162-ac1a-badef588dc76" could not be found!
	at de.interactive_instruments.etf.webapp.controller.TestRunController.start(TestRunController.java:517)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.base/java.lang.reflect.Method.invoke(Unknown Source)
	at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
	at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
	at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
	at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
	... 47 common frames omitted
Caused by: de.interactive_instruments.exceptions.ObjectWithIdNotFoundException: ExecutableTestSuiteDao: An object with the id "c543e1ad-465d-3162-ac1a-badef588dc76" could not be found!
	at de.interactive_instruments.etf.dal.dao.basex.AbstractBsxDao.getById(AbstractBsxDao.java:209)
	at de.interactive_instruments.etf.webapp.controller.TestDriverController.getById(TestDriverController.java:163)
	at de.interactive_instruments.etf.dal.dao.PreparedDtoResolver.getById(PreparedDtoResolver.java:49)
	at de.interactive_instruments.etf.webapp.dto.StartTestRunRequest.toTestRun(StartTestRunRequest.java:119)
	at de.interactive_instruments.etf.webapp.controller.TestRunController.start(TestRunController.java:474)
	... 58 common frames omitted

It doesn't matter which service is tested, the behaviour can be reproduced with any service URL.

[verendi]

Hi @jenriquesoriano ,

have you already had the opportunity to take a closer look at the issue? It would be very helpful if we could get some feedback on what the problem is. We are a bit lost with that error.

Thanks for your help in advance,
Verena

[jbarreroj]

Dear @verendi,

Following the exact steps you provided, we ran the container with

docker run --name inspire-validator -d -p 8090:8090 -v ~/etf:/etf docker.pkg.github.com/inspire-mif/helpdesk-validator/inspire-validator:2024.3

Once it was up, we accessed http://localhost:8090/validator/v2/ExecutableTestSuites and saw 214 tests returned

{"EtfItemCollection":{"version":2.0,"returnedItems":214,"position":0,...

with the two TeamEngine-based tests (“Direct WFS” and “OGC API-Features”) missing.

We then updated the remote TeamEngine credentials in /etf/config/etf-config.properties, fully stopped and restarted the container. After the restart, the previous endpoint returned 217 tests

{"EtfItemCollection":{"version":2.0,"returnedItems":217,"position":0,...

and both IDs (ed2d3501-d700-4ff9-b9bf-070dece8ddbd and c543e1ad-465d-3162-ac1a-badef588dc76) appeared correctly.

Could it be that the TeamEngine credentials provided are incorrect? Or perhaps the container did not fully stop and restart, causing it to retain the previous configuration?

I look forward to your feedback. Thanks in advance!

Best regards,
José Barrero

[verendi]

Dear @jbarreroj ,

thank you for the feedback.
I tried it out today and now it works and the two TeamEngine-based tests are available and executable.

But I didn't do anything different today than I did at the time in April when I created this issue. Even then, I always stopped and restarted the container because of the TE credentials and I also checked directly in the TE-UI that the credentials were correct.
Do you have any information about what exactly happens in the background during the initialization of the TE based tests? It feels a bit random whether it works or not.

I look forward to your feedback.

Thanks in advance and kind regards,
Verena

[jbarreroj]

Dear @verendi ,

Thanks for confirming that you can now see and execute the two TeamEngine-based tests.
On container startup, the Inspire Validator uses the TETD driver to load TeamEngine suites by reading the URL and credentials from etf-config.properties. If the driver cannot reach the configured TE endpoint at that moment, it logs an error and continues without importing those suites.

For example, when it fails you will see in the logs:

[main] INFO  d.i.e.t.ComponentContainer - Preparing Test Driver TEAM Engine test driver OGC API Features 1.0.1-SNAPSHOT  
[main] ERROR d.i.e.t.TestDriverLoader - Failed to load component  
  de.interactive_instruments.etf.component.ComponentLoadingException: … TEAM Engine application web interface not available at http://cite.opengeospatial.org/teamengine/rest/suites  
…  
[main] INFO  d.i.e.w.c.TestDriverController - 214 Executable Test Suites loaded

When it succeeds, you’ll instead see:

[main] INFO  d.i.e.t.ComponentContainer - Preparing Test Driver TEAM Engine test driver OGC API Features 1.0.1-SNAPSHOT  
…  
[main] INFO  d.i.e.w.c.TestDriverController - Loaded Test Driver TEAM Engine test driver OGC API Features - 1.0.1-SNAPSHOT (07f42606-41b1-4871-a83b-64c20012f03b)  
[main] INFO  d.i.e.w.c.TestDriverController - 217 Executable Test Suites loaded

Here the driver reached the remote TE interface, imported all suites, and you see the full count.

It’s very likely that during your April restart the TeamEngine server was temporarily down or unreachable, causing the TETD driver to log the failure and skip those two suites.

Please let us know if you need any further assistance.

Kind regards,
José Barrero

[fabiovinci]

Dear @verendi,

Was the information you received helpful in resolving your issue?
Can we close the issue?