-
-
Couldn't load subscription status.
- Fork 2.6k
Closed
Labels
Description
What happened?
When running a scraper with selenium grid, I'm receiving a Java Runtime Error ~5-20m into the tests, this Is consistent.
Command used to start Selenium Grid with Docker (or Kubernetes)
# Options
options = webdriver.FirefoxOptions()
profile = webdriver.FirefoxProfile()
# Performance arguments
options.add_argument("--disable-extensions")
options.add_argument("--disable-gpu")
options.add_argument("--no-sandbox")
options.add_argument("--disable-dev-shm-usage")
options.add_argument("--disable-setuid-sandbox")
options.add_argument("--disable-popup-blocking")
options.add_argument("--disable-infobars")
options.add_argument("--disable-notifications")
options.add_argument("--disable-default-apps")
options.add_argument("--mute-audio")
options.add_argument("--blink-settings=imagesEnabled=false")
# Blocks requests to ebay images
options.set_preference("permissions.default.image", 2)
options.set_preference("dom.ipc.plugins.enabled.libflashplayer.so", "false")
# Docker Compose File
selenium:
image: selenium/standalone-firefox
container_name: selenium_chrome
shm_size: "2gb"
platform: linux/x86_64
environment:
SE_ENABLE_TRACING: false
networks:
- scraper_network
ports:
- "4444:4444"Relevant log output
selenium_chrome | #
selenium_chrome | # A fatal error has been detected by the Java Runtime Environment:
selenium_chrome | #
selenium_chrome | # SIGSEGV (0xb) at pc=0x00007fffff142d23, pid=55, tid=159
selenium_chrome | #
selenium_chrome | # JRE version: OpenJDK Runtime Environment (17.0.12+7) (build 17.0.12+7-Ubuntu-1ubuntu224.04)
selenium_chrome | # Java VM: OpenJDK 64-Bit Server VM (17.0.12+7-Ubuntu-1ubuntu224.04, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, linux-amd64)
selenium_chrome | # Problematic frame:
selenium_chrome | # V [libjvm.so+0x747d23] G1ParScanThreadState::trim_queue_to_threshold(unsigned int)+0x2fb3
selenium_chrome | #
selenium_chrome | # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
selenium_chrome | #
selenium_chrome | # An error report file with more information is saved as:
selenium_chrome | # /tmp/hs_err_pid55.log
selenium_chrome | #
selenium_chrome | # If you would like to submit a bug report, please visit:
selenium_chrome | # https://bugs.launchpad.net/ubuntu/+source/openjdk-17
selenium_chrome | #
selenium_chrome | /opt/bin/start-selenium-standalone.sh: line 179: 55 Aborted java ${JAVA_OPTS:-$SE_JAVA_OPTS} ${CHROME_DRIVER_PATH_PROPERTY} ${EDGE_DRIVER_PATH_PROPERTY} ${GECKO_DRIVER_PATH_PROPERTY} -jar /opt/selenium/selenium-server.jar ${EXTRA_LIBS} standalone --session-request-timeout ${SE_SESSION_REQUEST_TIMEOUT} --session-retry-interval ${SE_SESSION_RETRY_INTERVAL} --healthcheck-interval ${SE_HEALTHCHECK_INTERVAL} --relax-checks ${SE_RELAX_CHECKS} --detect-drivers false --bind-host ${SE_BIND_HOST} --config /opt/selenium/config.toml ${SUB_PATH_CONFIG} ${SE_OPTS}
selenium_chrome | 2024-12-06 19:53:19,617 WARN exited: selenium-standalone (exit status 134; not expected)
selenium_chrome | 2024-12-06 19:53:19,618 WARN received SIGINT indicating exit request
selenium_chrome | 2024-12-06 19:53:19,619 INFO waiting for xvfb, vnc, novnc to die
selenium_chrome | 2024-12-06 19:53:22,624 WARN stopped: novnc (terminated by SIGTERM)
selenium_chrome | 2024-12-06 19:53:22,625 INFO waiting for xvfb, vnc to die
selenium_chrome | 2024-12-06 19:53:23,628 WARN stopped: vnc (terminated by SIGTERM)
selenium_chrome | 2024-12-06 19:53:24,631 WARN stopped: xvfb (terminated by SIGTERM)Operating System
MacOS
Docker Selenium version (image tag)
latest
Selenium Grid chart version (chart version)
latest