Closed
Description
Your current environment
=> ERROR [mamba-builder 3/3] RUN pip --verbose wheel -r requirements-mamba.txt --no-build-isolation --no-deps --no-cache-dir
909.8s
------
> [mamba-builder 3/3] RUN pip --verbose wheel -r requirements-mamba.txt --no-build-isolation --no-deps --no-cache-dir:
1.518 Collecting mamba-ssm>=1.2.2 (from -r requirements-mamba.txt (line 2))
1.776 Downloading mamba_ssm-2.2.2.tar.gz (85 kB)
1.904 Preparing metadata (setup.py): started
1.904 Running command python setup.py egg_info
4.070 No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'
4.146
4.146
4.147 torch.__version__ = 2.4.0+cu121
4.147
4.148
4.149 running egg_info
4.149 creating /tmp/pip-pip-egg-info-d2_c2trw/mamba_ssm.egg-info
4.154 writing /tmp/pip-pip-egg-info-d2_c2trw/mamba_ssm.egg-info/PKG-INFO
4.154 writing dependency_links to /tmp/pip-pip-egg-info-d2_c2trw/mamba_ssm.egg-info/dependency_links.txt
4.155 writing requirements to /tmp/pip-pip-egg-info-d2_c2trw/mamba_ssm.egg-info/requires.txt
4.156 writing top-level names to /tmp/pip-pip-egg-info-d2_c2trw/mamba_ssm.egg-info/top_level.txt
4.156 writing manifest file '/tmp/pip-pip-egg-info-d2_c2trw/mamba_ssm.egg-info/SOURCES.txt'
4.250 reading manifest file '/tmp/pip-pip-egg-info-d2_c2trw/mamba_ssm.egg-info/SOURCES.txt'
4.250 adding license file 'LICENSE'
4.251 adding license file 'AUTHORS'
4.252 writing manifest file '/tmp/pip-pip-egg-info-d2_c2trw/mamba_ssm.egg-info/SOURCES.txt'
4.670 Preparing metadata (setup.py): finished with status 'done'
4.964 Collecting causal-conv1d>=1.2.0 (from -r requirements-mamba.txt (line 3))
5.029 Downloading causal_conv1d-1.4.0.tar.gz (9.3 kB)
5.048 Preparing metadata (setup.py): started
5.049 Running command python setup.py egg_info
7.259 No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'
7.351
7.352
7.352 torch.__version__ = 2.4.0+cu121
7.353
7.353
7.354 running egg_info
7.355 creating /tmp/pip-pip-egg-info-uye1h_am/causal_conv1d.egg-info
7.363 writing /tmp/pip-pip-egg-info-uye1h_am/causal_conv1d.egg-info/PKG-INFO
7.364 writing dependency_links to /tmp/pip-pip-egg-info-uye1h_am/causal_conv1d.egg-info/dependency_links.txt
7.364 writing requirements to /tmp/pip-pip-egg-info-uye1h_am/causal_conv1d.egg-info/requires.txt
7.365 writing top-level names to /tmp/pip-pip-egg-info-uye1h_am/causal_conv1d.egg-info/top_level.txt
7.366 writing manifest file '/tmp/pip-pip-egg-info-uye1h_am/causal_conv1d.egg-info/SOURCES.txt'
7.458 reading manifest file '/tmp/pip-pip-egg-info-uye1h_am/causal_conv1d.egg-info/SOURCES.txt'
7.459 adding license file 'LICENSE'
7.460 adding license file 'AUTHORS'
7.460 writing manifest file '/tmp/pip-pip-egg-info-uye1h_am/causal_conv1d.egg-info/SOURCES.txt'
7.917 Preparing metadata (setup.py): finished with status 'done'
7.928 Building wheels for collected packages: mamba-ssm, causal-conv1d
7.929 Building wheel for mamba-ssm (setup.py): started
7.930 Running command python setup.py bdist_wheel
10.18 No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'
10.18
10.18
10.18 torch.__version__ = 2.4.0+cu121
10.18
10.18
10.23 running bdist_wheel
10.26 Guessing wheel URL: https://github.com/state-spaces/mamba/releases/download/v2.2.2/mamba_ssm-2.2.2+cu122torch2.4cxx11abiFALSE-cp310-cp310-linux_x86_64.whl
623.7 error: <urlopen error retrieval incomplete: got only 178257920 out of 323988104 bytes>
624.1 error: subprocess-exited-with-error
624.1
624.1 × python setup.py bdist_wheel did not run successfully.
624.1 │ exit code: 1
624.1 ╰─> See above for output.
624.1
624.1 note: This error originates from a subprocess, and is likely not a problem with pip.
624.1 # - It imports setuptools before invoking setup.py, to enable projects that directly
624.1 # import from `distutils.core` to work with newer packaging standards.
624.1 # - It provides a clear error message when setuptools is not installed.
624.1 # - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
624.1 # setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
624.1 # manifest_maker: standard file '"'"'-c'"'"' not found".
624.1 # - It generates a shim setup.py, for handling setup.cfg-only projects.
624.1 import os, sys, tokenize
624.1
624.1 try:
624.1 import setuptools
624.1 except ImportError as error:
624.1 print(
624.1 "ERROR: Can not execute `setup.py` since setuptools is not available in "
624.1 "the build environment.",
624.1 file=sys.stderr,
624.1 )
624.1 sys.exit(1)
624.1
624.1 __file__ = %r
624.1 sys.argv[0] = __file__
624.1
624.1 if os.path.exists(__file__):
624.1 filename = __file__
624.1 with tokenize.open(__file__) as f:
624.1 setup_py_code = f.read()
624.1 else:
624.1 filename = "<auto-generated setuptools caller>"
624.1 setup_py_code = "from setuptools import setup; setup()"
624.1
624.1 exec(compile(setup_py_code, filename, "exec"))
624.1 '"'"''"'"''"'"' % ('"'"'/tmp/pip-wheel-uaoqe42l/mamba-ssm_d3adad62e7824b8383a22aabf455e8de/setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' bdist_wheel -d /tmp/pip-wheel-0tek0r5o
624.1 cwd: /tmp/pip-wheel-uaoqe42l/mamba-ssm_d3adad62e7824b8383a22aabf455e8de/
624.1 Building wheel for mamba-ssm (setup.py): finished with status 'error'
624.1 ERROR: Failed building wheel for mamba-ssm
624.1 Running setup.py clean for mamba-ssm
624.1 Running command python setup.py clean
626.1 No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'
626.2
626.2
626.2 torch.__version__ = 2.4.0+cu121
626.2
626.2
626.2 running clean
626.2 'build/lib.linux-x86_64-cpython-310' does not exist -- can't clean it
626.2 'build/bdist.linux-x86_64' does not exist -- can't clean it
626.2 'build/scripts-3.10' does not exist -- can't clean it
626.6 Building wheel for causal-conv1d (setup.py): started
626.6 Running command python setup.py bdist_wheel
628.6 No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'
628.6
628.6
628.6 torch.__version__ = 2.4.0+cu121
628.6
628.6
628.7 running bdist_wheel
628.7 Guessing wheel URL: https://github.com/Dao-AILab/causal-conv1d/releases/download/v1.4.0/causal_conv1d-1.4.0+cu122torch2.4cxx11abiFALSE-cp310-cp310-linux_x86_64.whl
908.5 Raw wheel path /tmp/pip-wheel-mfpcfgry/causal_conv1d-1.4.0-cp310-cp310-linux_x86_64.whl
908.8 Building wheel for causal-conv1d (setup.py): finished with status 'done'
909.0 Created wheel for causal-conv1d: filename=causal_conv1d-1.4.0-cp310-cp310-linux_x86_64.whl size=104867883 sha256=b5e7cf7e964b5e99275d97ba1e1b0ee4e3073f4593743ba1f1c6aa394a3008cc
909.0 Stored in directory: /tmp/pip-ephem-wheel-cache-62nr0jbv/wheels/e3/dd/4c/205f24e151736bd22f5980738dd10a19af6f093b6f4dcab006
909.0 Successfully built causal-conv1d
909.0 Failed to build mamba-ssm
909.6 ERROR: Failed to build one or more wheels
------
Dockerfile.longshine:152
--------------------
151 | # Download the wheel or build it if a pre-compiled release doesn't exist
152 | >>> RUN pip --verbose wheel -r requirements-mamba.txt \
153 | >>> --no-build-isolation --no-deps --no-cache-dir
154 |
--------------------
ERROR: failed to solve: process "/bin/sh -c pip --verbose wheel -r requirements-mamba.txt --no-build-isolation --no-deps --no-cache-dir" did not complete successfully: exit code: 1
How you are installing vllm
vllm version: v0.5.2, v0.5.3, v0.5.4 (versions that have mamba)
cuda tool kit: cuda 12.1
cuda driver: 535.183.01
device: RTX 4090
CPU: intel
docker build -t xxxx -f Dockerfile .