-
Notifications
You must be signed in to change notification settings - Fork 26
Description
Help me!
(venv) user@DESKTOP-ULK7M66:~/Open-Sora$ pip install git+https://github.com/hpcaitech/TensorNVMe.git
Collecting git+https://github.com/hpcaitech/TensorNVMe.git
Cloning https://github.com/hpcaitech/TensorNVMe.git to /tmp/pip-req-build-64o7_c6v
Running command git clone --filter=blob:none --quiet https://github.com/hpcaitech/TensorNVMe.git /tmp/pip-req-build-64o7_c6v
Resolved https://github.com/hpcaitech/TensorNVMe.git to commit 6403388
Preparing metadata (setup.py) ... done
Requirement already satisfied: packaging in ./venv/lib/python3.11/site-packages (from tensornvme==0.1.0) (24.2)
Requirement already satisfied: click in ./venv/lib/python3.11/site-packages (from tensornvme==0.1.0) (8.1.8)
Requirement already satisfied: torch in ./venv/lib/python3.11/site-packages (from tensornvme==0.1.0) (2.2.2)
Requirement already satisfied: filelock in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (3.16.1)
Requirement already satisfied: typing-extensions>=4.8.0 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (4.12.2)
Requirement already satisfied: sympy in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (1.13.3)
Requirement already satisfied: networkx in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (3.4.2)
Requirement already satisfied: jinja2 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (3.1.5)
Requirement already satisfied: fsspec in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (2024.12.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105)
Requirement already satisfied: nvidia-cudnn-cu12==8.9.2.26 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (8.9.2.26)
Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.3.1)
Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (11.0.2.54)
Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (10.3.2.106)
Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (11.4.5.107)
Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.0.106)
Requirement already satisfied: nvidia-nccl-cu12==2.19.3 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (2.19.3)
Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105)
Requirement already satisfied: triton==2.2.0 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (2.2.0)
Requirement already satisfied: nvidia-nvjitlink-cu12 in ./venv/lib/python3.11/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch->tensornvme==0.1.0) (12.6.85)
Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.11/site-packages (from jinja2->torch->tensornvme==0.1.0) (2.1.5)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in ./venv/lib/python3.11/site-packages (from sympy->torch->tensornvme==0.1.0) (1.3.0)
Building wheels for collected packages: tensornvme
Building wheel for tensornvme (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [176 lines of output]
-- The CXX compiler identification is GNU 13.3.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
liburing is found in /home/user/.tensornvme/lib/liburing.so
libaio is found in /home/user/.tensornvme/lib/libaio.so
-- Configuring done (0.3s)
-- Generating done (0.0s)
-- Build files have been written to: /tmp/pip-req-build-64o7_c6v/cmake-build
make: *** No rule to make target 'extern_uring'. Stop.
make: *** No rule to make target 'extern_aio'. Stop.
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-cpython-311/tensornvme
copying tensornvme/async_file_io.py -> build/lib.linux-x86_64-cpython-311/tensornvme
copying tensornvme/offload.py -> build/lib.linux-x86_64-cpython-311/tensornvme
copying tensornvme/init.py -> build/lib.linux-x86_64-cpython-311/tensornvme
creating build/lib.linux-x86_64-cpython-311/tensornvme/cli
copying tensornvme/cli/cli.py -> build/lib.linux-x86_64-cpython-311/tensornvme/cli
copying tensornvme/cli/init.py -> build/lib.linux-x86_64-cpython-311/tensornvme/cli
copying tensornvme/cli/check.py -> build/lib.linux-x86_64-cpython-311/tensornvme/cli
running build_ext
building 'tensornvme._C' extension
creating /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc
Emitting ninja build file /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o
c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /tmp/pip-req-build-64o7_c6v/include/pthread_backend.h:13,
from /tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.cpp:1:
/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/cuda/CUDAStream.h:6:10: fatal error: cuda_runtime_api.h: No such file or directory
6 | #include <cuda_runtime_api.h>
| ^~~~~~~~~~~~~~~~~~~~
compilation terminated.
[2/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/space_mgr.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/space_mgr.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/space_mgr.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[3/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o
c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /tmp/pip-req-build-64o7_c6v/include/pthread_backend.h:13,
from /tmp/pip-req-build-64o7_c6v/csrc/backend.cpp:15:
/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/cuda/CUDAStream.h:6:10: fatal error: cuda_runtime_api.h: No such file or directory
6 | #include <cuda_runtime_api.h>
| ^~~~~~~~~~~~~~~~~~~~
compilation terminated.
[4/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/async_file_io.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/async_file_io.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/async_file_io.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[5/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/aio.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/aio.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /usr/include/c++/13/memory:78,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/util/C++17.h:8,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/util/TypeList.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/util/Metaprogramming.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/core/DispatchKeySet.h:4,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/core/Backend.h:5,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/core/Layout.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/ATen/core/TensorBody.h:12,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/ATen/core/Tensor.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/ATen/Tensor.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/function_hook.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:2,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/variable.h:6,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/autograd.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include/torch/torch.h:3,
from /tmp/pip-req-build-64o7_c6v/include/aio.h:4,
from /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:1:
In member function ‘void std::default_delete<_Tp>::operator()(_Tp*) const [with _Tp = io_event]’,
inlined from ‘std::unique_ptr<_Tp, _Dp>::~unique_ptr() [with _Tp = io_event; _Dp = std::default_delete<io_event>]’ at /usr/include/c++/13/bits/unique_ptr.h:404:17,
inlined from ‘virtual void AIOAsyncIO::get_event(WaitType)’ at /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:45:1:
/usr/include/c++/13/bits/unique_ptr.h:99:9: warning: ‘void operator delete(void*, std::size_t)’ called on pointer returned from a mismatched allocation function [-Wmismatched-new-delete]
99 | delete __ptr;
| ^~~~~~~~~~~~
/tmp/pip-req-build-64o7_c6v/csrc/aio.cpp: In member function ‘virtual void AIOAsyncIO::get_event(WaitType)’:
/tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:23:63: note: returned from ‘void* operator new ’
23 | std::unique_ptr<io_event> events(new io_event[this->max_nr]);
| ^
In member function ‘void std::default_delete<_Tp>::operator()(_Tp*) const [with _Tp = io_event]’,
inlined from ‘std::unique_ptr<_Tp, _Dp>::~unique_ptr() [with _Tp = io_event; _Dp = std::default_delete<io_event>]’ at /usr/include/c++/13/bits/unique_ptr.h:404:17,
inlined from ‘virtual void AIOAsyncIO::get_event(WaitType)’ at /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:45:1:
/usr/include/c++/13/bits/unique_ptr.h:99:9: warning: ‘void operator delete(void*, std::size_t)’ called on pointer returned from a mismatched allocation function [-Wmismatched-new-delete]
99 | delete __ptr;
| ^~~~~~~~~~~~
/tmp/pip-req-build-64o7_c6v/csrc/aio.cpp: In member function ‘virtual void AIOAsyncIO::get_event(WaitType)’:
/tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:23:63: note: returned from ‘void* operator new ’
23 | std::unique_ptr<io_event> events(new io_event[this->max_nr]);
| ^
[6/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/uring.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/uring.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/uring.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[7/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/offload.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/offload.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_write(const at::Tensor&, const std::string&)’:
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:85:10: warning: ignoring return value of ‘ssize_t write(int, const void*, size_t)’ declared with attribute ‘warn_unused_result’ [-Wunused-result]
85 | write(this->fd, tensor.data_ptr(), bytes);
| ~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_read(const at::Tensor&, const std::string&)’:
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:93:9: warning: ignoring return value of ‘ssize_t read(int, void*, size_t)’ declared with attribute ‘warn_unused_result’ [-Wunused-result]
93 | read(this->fd, tensor.data_ptr(), bytes);
| ~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_writev(const std::vectorat::Tensor&, const std::string&)’:
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:182:11: warning: ignoring return value of ‘ssize_t writev(int, const iovec*, int)’ declared with attribute ‘warn_unused_result’ [-Wunused-result]
182 | writev(this->fd, iov, tensors.size());
| ~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_readv(const std::vectorat::Tensor&, const std::string&)’:
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:192:10: warning: ignoring return value of ‘ssize_t readv(int, const iovec*, int)’ declared with attribute ‘warn_unused_result’ [-Wunused-result]
192 | readv(this->fd, iov, tensors.size());
| ~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[8/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/py_api.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/py_api.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/py_api.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2096, in _run_ninja_build
subprocess.run(
File "/usr/lib/python3.11/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "/tmp/pip-req-build-64o7_c6v/setup.py", line 172, in <module>
setup(
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/__init__.py", line 117, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 183, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 199, in run_commands
dist.run_commands()
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 954, in run_commands
self.run_command(cmd)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/dist.py", line 995, in run_command
super().run_command(command)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 973, in run_command
cmd_obj.run()
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/command/bdist_wheel.py", line 381, in run
self.run_command("build")
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
self.distribution.run_command(command)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/dist.py", line 995, in run_command
super().run_command(command)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 973, in run_command
cmd_obj.run()
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
self.distribution.run_command(command)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/dist.py", line 995, in run_command
super().run_command(command)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 973, in run_command
cmd_obj.run()
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 99, in run
_build_ext.run(self)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 359, in run
self.build_extensions()
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 871, in build_extensions
build_ext.build_extensions(self)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 476, in build_extensions
self._build_extensions_serial()
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 502, in _build_extensions_serial
self.build_extension(ext)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 264, in build_extension
_build_ext.build_extension(self, ext)
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 557, in build_extension
objects = self.compiler.compile(
^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 684, in unix_wrap_ninja_compile
_write_ninja_file_and_compile_objects(
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1774, in _write_ninja_file_and_compile_objects
_run_ninja_build(
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2112, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tensornvme
Running setup.py clean for tensornvme
Failed to build tensornvme
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (tensornvme)