MultiScaleDeformableAttention 模块编译安装

相关环境

pytorch

torch                         2.6.0+cu124
torchaudio                    2.6.0+cu124
torchvision                   0.21.0+cu124

nvcc -V

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Thu_Mar_28_02:18:24_PDT_2024
Cuda compilation tools, release 12.4, V12.4.131
Build cuda_12.4.r12.4/compiler.34097967_0

nvidia-smi

						Mon Sep 22 19:46:03 2025       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 560.35.03              Driver Version: 560.35.03      CUDA Version: 12.6     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 4090        On  |   00000000:16:00.0 Off |                  Off |
| 30%   26C    P8             16W /  450W |       1MiB /  24564MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+

gcc -v

Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/11/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none:amdgcn-amdhsa
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 11.4.0-1ubuntu1~22.04' --with-bugurl=file:///usr/share/doc/gcc-11/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --prefix=/usr --with-gcc-major-version-only --program-suffix=-11 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --enable-bootstrap --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-plugin --enable-default-pie --with-system-zlib --enable-libphobos-checking=release --with-target-system-zlib=auto --enable-objc-gc=auto --enable-multiarch --disable-werror --enable-cet --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-build-config=bootstrap-lto-lean --enable-link-serialization=2
Thread model: posix
Supported LTO compression algorithms: zlib zstd
gcc version 11.4.0 (Ubuntu 11.4.0-1ubuntu1~22.04) 

g++ -v

Using built-in specs.
COLLECT_GCC=g++
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/11/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none:amdgcn-amdhsa
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 11.4.0-1ubuntu1~22.04' --with-bugurl=file:///usr/share/doc/gcc-11/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --prefix=/usr --with-gcc-major-version-only --program-suffix=-11 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --enable-bootstrap --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-plugin --enable-default-pie --with-system-zlib --enable-libphobos-checking=release --with-target-system-zlib=auto --enable-objc-gc=auto --enable-multiarch --disable-werror --enable-cet --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-build-config=bootstrap-lto-lean --enable-link-serialization=2
Thread model: posix
Supported LTO compression algorithms: zlib zstd
gcc version 11.4.0 (Ubuntu 11.4.0-1ubuntu1~22.04) 

python

Python 3.12.11 | packaged by Anaconda, Inc. | (main, Jun  5 2025, 13:09:17) [GCC 11.2.0] on linux

下载好MultiScaleDeformableAttention模块的源代码
MultiScaleDeformableAttention源代码
点击传送门即可下载

编译安装

第一步

进入ops命令,检查当前目录是否为ops根目录也就是setup.py文件的目录

(mambavision) root@autodl-container-01c74bb1c0-8eafbf69:~/autodl-tmp/workspace/DINO/models/dino/ops# pwd                                         
/root/autodl-tmp/workspace/DINO/models/dino/ops

进入 ops 目录执行安装命令
使用 pip 安装使用pip 命令

pip install --no-build-isolation . --verbose

使用 python 安装使用python命令

python setup.py build install

这两个编译安装命令哪个都行,笔者使用的是pip命令也就是

pip install --no-build-isolation . --verbose

这个命令是使用 pip 安装本地 Python 包的一个具体方式,要看清楚了–no-build-isolation后面还有一个点(.)表示当前目录的意思,现在让我们来解析各个部分的含义:

  • pip install - 这是 Python 包管理工具 pip 的基本安装命令

  • –no-build-isolation - 这个选项禁用了构建隔离功能: 默认情况下,pip 会创建一个临时的隔离环境来构建包 禁用后,会使用当前环境中的依赖来构建包 通常用于调试或当你需要确保使用特定版本的构建依赖时

  • . - 表示安装当前目录下的包,通常这个目录包含 setup.py 或 pyproject.toml 文件

  • –verbose - 启用详细输出模式:

    会显示更多安装过程中的细节,如下载地址、编译步骤等 有助于调试安装过程中出现的问题

第二步

执行编译指令

pip install --no-build-isolation . --verbose

报错输出

(mambavision) root@autodl-container-01c74bb1c0-8eafbf69:~/autodl-tmp/workspace/DINO/models/dino/ops# pip install --no-build-isolation . --verbose
Using pip 25.2 from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/pip (python 3.12)
Looking in indexes: http://mirrors.aliyun.com/pypi/simple
Processing /root/autodl-tmp/workspace/DINO/models/dino/ops
  Running command python setup.py egg_info
  running egg_info
  creating /tmp/pip-pip-egg-info-wwugbbbq/MultiScaleDeformableAttention.egg-info
  writing /tmp/pip-pip-egg-info-wwugbbbq/MultiScaleDeformableAttention.egg-info/PKG-INFO
  writing dependency_links to /tmp/pip-pip-egg-info-wwugbbbq/MultiScaleDeformableAttention.egg-info/dependency_links.txt
  writing top-level names to /tmp/pip-pip-egg-info-wwugbbbq/MultiScaleDeformableAttention.egg-info/top_level.txt
  writing manifest file '/tmp/pip-pip-egg-info-wwugbbbq/MultiScaleDeformableAttention.egg-info/SOURCES.txt'
  reading manifest file '/tmp/pip-pip-egg-info-wwugbbbq/MultiScaleDeformableAttention.egg-info/SOURCES.txt'
  writing manifest file '/tmp/pip-pip-egg-info-wwugbbbq/MultiScaleDeformableAttention.egg-info/SOURCES.txt'
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: MultiScaleDeformableAttention
  DEPRECATION: Building 'MultiScaleDeformableAttention' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'MultiScaleDeformableAttention'. Discussion can be found at https://github.com/pypa/pip/issues/6334                                                                                                                                                                                       
  Running command python setup.py bdist_wheel                                                                                                                                                                                       
  running bdist_wheel
  running build
  running build_py
  creating build/lib.linux-x86_64-cpython-312/functions
  copying functions/ms_deform_attn_func.py -> build/lib.linux-x86_64-cpython-312/functions
  copying functions/__init__.py -> build/lib.linux-x86_64-cpython-312/functions
  creating build/lib.linux-x86_64-cpython-312/modules
  copying modules/ms_deform_attn.py -> build/lib.linux-x86_64-cpython-312/modules
  copying modules/__init__.py -> build/lib.linux-x86_64-cpython-312/modules
  running build_ext
  building 'MultiScaleDeformableAttention' extension
  creating /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu
  creating /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/utils/cpp_extension.py:2061: UserWarning: TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation.
  If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'].
    warnings.warn(
  Emitting ninja build file /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/build.ninja...
  Compiling objects...
  Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
  [1/3] c++ -MMD -MF /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.o.d -pthread -B /root/miniconda3/envs/mambavision/compiler_compat -fno-strict-overflow -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -isystem /root/miniconda3/envs/mambavision/include -fPIC -O2 -isystem /root/miniconda3/envs/mambavision/include -fPIC -DWITH_CUDA -I/root/autodl-tmp/workspace/DINO/models/dino/ops/src -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/TH -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/THC -I/usr/local/cuda/include -I/root/miniconda3/envs/mambavision/include/python3.12 -c -c /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.cpp -o /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=MultiScaleDeformableAttention -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
  [2/3] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.o.d -DWITH_CUDA -I/root/autodl-tmp/workspace/DINO/models/dino/ops/src -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/TH -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/THC -I/usr/local/cuda/include -I/root/miniconda3/envs/mambavision/include/python3.12 -c -c /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu -o /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -DCUDA_HAS_FP16=1 -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=MultiScaleDeformableAttention -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_89,code=compute_89 -gencode=arch=compute_89,code=sm_89 -std=c++17
  FAILED: [code=2] /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.o
  /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.o.d -DWITH_CUDA -I/root/autodl-tmp/workspace/DINO/models/dino/ops/src -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/TH -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/THC -I/usr/local/cuda/include -I/root/miniconda3/envs/mambavision/include/python3.12 -c -c /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu -o /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -DCUDA_HAS_FP16=1 -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=MultiScaleDeformableAttention -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_89,code=compute_89 -gencode=arch=compute_89,code=sm_89 -std=c++17
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu(64): error: no suitable conversion function from "const at::DeprecatedTypeProperties" to "c10::ScalarType" exists
            [&] { const auto& the_type = value.type(); constexpr const char* at_dispatch_name = "ms_deform_attn_forward_cuda"; at::ScalarType _st = ::detail::scalar_type(the_type); ; switch (_st) { case at::ScalarType::Double: { do { if constexpr (!at::should_include_kernel_dtype( at_dispatch_name, at::ScalarType::Double)) { if (!(false)) { ::c10::detail::torchCheckFail( __func__, "/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu", static_cast<uint32_t>(64), (::c10::detail::torchCheckMsgImpl( "Expected " "false" " to be true, but got false.  " "(Could this error message be improved?  If so, " "please report an enhancement request to PyTorch.)", "dtype '", toString(at::ScalarType::Double), "' not selected for kernel tag ", at_dispatch_name))); }; } } while (0); using scalar_t [[maybe_unused]] = c10::impl::ScalarTypeToCPPTypeT<at::ScalarType::Double>; return ([&] { ms_deformable_im2col_cuda(at::cuda::getCurrentCUDAStream(), value.data<scalar_t>() + n * im2col_step_ * per_value_size, spatial_shapes.data<int64_t>(), level_start_index.data<int64_t>(), sampling_loc.data<scalar_t>() + n * im2col_step_ * per_sample_loc_size, attn_weight.data<scalar_t>() + n * im2col_step_ * per_attn_weight_size, batch_n, spatial_size, num_heads, channels, num_levels, num_query, num_point, columns.data<scalar_t>()); })(); } case at::ScalarType::Float: { do { if constexpr (!at::should_include_kernel_dtype( at_dispatch_name, at::ScalarType::Float)) { if (!(false)) { ::c10::detail::torchCheckFail( __func__, "/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu", static_cast<uint32_t>(64), (::c10::detail::torchCheckMsgImpl( "Expected " "false" " to be true, but got false.  " "(Could this error message be improved?  If so, " "please report an enhancement request to PyTorch.)", "dtype '", toString(at::ScalarType::Float), "' not selected for kernel tag ", at_dispatch_name))); }; } } while (0); using scalar_t [[maybe_unused]] = c10::impl::ScalarTypeToCPPTypeT<at::ScalarType::Float>; return ([&] { ms_deformable_im2col_cuda(at::cuda::getCurrentCUDAStream(), value.data<scalar_t>() + n * im2col_step_ * per_value_size, spatial_shapes.data<int64_t>(), level_start_index.data<int64_t>(), sampling_loc.data<scalar_t>() + n * im2col_step_ * per_sample_loc_size, attn_weight.data<scalar_t>() + n * im2col_step_ * per_attn_weight_size, batch_n, spatial_size, num_heads, channels, num_levels, num_query, num_point, columns.data<scalar_t>()); })(); } default: if (!(false)) { ::c10::detail::torchCheckFail( __func__, "/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu", static_cast<uint32_t>(64), (::c10::detail::torchCheckMsgImpl( "Expected " "false" " to be true, but got false.  " "(Could this error message be improved?  If so, " "please report an enhancement request to PyTorch.)", '"', at_dispatch_name, "\" not implemented for '", toString(_st), "'"))); }; } }()
                                                                                                                                                                          ^

  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu(134): error: no suitable conversion function from "const at::DeprecatedTypeProperties" to "c10::ScalarType" exists
            [&] { const auto& the_type = value.type(); constexpr const char* at_dispatch_name = "ms_deform_attn_backward_cuda"; at::ScalarType _st = ::detail::scalar_type(the_type); ; switch (_st) { case at::ScalarType::Double: { do { if constexpr (!at::should_include_kernel_dtype( at_dispatch_name, at::ScalarType::Double)) { if (!(false)) { ::c10::detail::torchCheckFail( __func__, "/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu", static_cast<uint32_t>(134), (::c10::detail::torchCheckMsgImpl( "Expected " "false" " to be true, but got false.  " "(Could this error message be improved?  If so, " "please report an enhancement request to PyTorch.)", "dtype '", toString(at::ScalarType::Double), "' not selected for kernel tag ", at_dispatch_name))); }; } } while (0); using scalar_t [[maybe_unused]] = c10::impl::ScalarTypeToCPPTypeT<at::ScalarType::Double>; return ([&] { ms_deformable_col2im_cuda(at::cuda::getCurrentCUDAStream(), grad_output_g.data<scalar_t>(), value.data<scalar_t>() + n * im2col_step_ * per_value_size, spatial_shapes.data<int64_t>(), level_start_index.data<int64_t>(), sampling_loc.data<scalar_t>() + n * im2col_step_ * per_sample_loc_size, attn_weight.data<scalar_t>() + n * im2col_step_ * per_attn_weight_size, batch_n, spatial_size, num_heads, channels, num_levels, num_query, num_point, grad_value.data<scalar_t>() + n * im2col_step_ * per_value_size, grad_sampling_loc.data<scalar_t>() + n * im2col_step_ * per_sample_loc_size, grad_attn_weight.data<scalar_t>() + n * im2col_step_ * per_attn_weight_size); })(); } case at::ScalarType::Float: { do { if constexpr (!at::should_include_kernel_dtype( at_dispatch_name, at::ScalarType::Float)) { if (!(false)) { ::c10::detail::torchCheckFail( __func__, "/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu", static_cast<uint32_t>(134), (::c10::detail::torchCheckMsgImpl( "Expected " "false" " to be true, but got false.  " "(Could this error message be improved?  If so, " "please report an enhancement request to PyTorch.)", "dtype '", toString(at::ScalarType::Float), "' not selected for kernel tag ", at_dispatch_name))); }; } } while (0); using scalar_t [[maybe_unused]] = c10::impl::ScalarTypeToCPPTypeT<at::ScalarType::Float>; return ([&] { ms_deformable_col2im_cuda(at::cuda::getCurrentCUDAStream(), grad_output_g.data<scalar_t>(), value.data<scalar_t>() + n * im2col_step_ * per_value_size, spatial_shapes.data<int64_t>(), level_start_index.data<int64_t>(), sampling_loc.data<scalar_t>() + n * im2col_step_ * per_sample_loc_size, attn_weight.data<scalar_t>() + n * im2col_step_ * per_attn_weight_size, batch_n, spatial_size, num_heads, channels, num_levels, num_query, num_point, grad_value.data<scalar_t>() + n * im2col_step_ * per_value_size, grad_sampling_loc.data<scalar_t>() + n * im2col_step_ * per_sample_loc_size, grad_attn_weight.data<scalar_t>() + n * im2col_step_ * per_attn_weight_size); })(); } default: if (!(false)) { ::c10::detail::torchCheckFail( __func__, "/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu", static_cast<uint32_t>(134), (::c10::detail::torchCheckMsgImpl( "Expected " "false" " to be true, but got false.  " "(Could this error message be improved?  If so, " "please report an enhancement request to PyTorch.)", '"', at_dispatch_name, "\" not implemented for '", toString(_st), "'"))); }; } }()
                                                                                                                                                                           ^

  2 errors detected in the compilation of "/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu".
  [3/3] c++ -MMD -MF /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.o.d -pthread -B /root/miniconda3/envs/mambavision/compiler_compat -fno-strict-overflow -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -isystem /root/miniconda3/envs/mambavision/include -fPIC -O2 -isystem /root/miniconda3/envs/mambavision/include -fPIC -DWITH_CUDA -I/root/autodl-tmp/workspace/DINO/models/dino/ops/src -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/TH -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/THC -I/usr/local/cuda/include -I/root/miniconda3/envs/mambavision/include/python3.12 -c -c /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp -o /root/autodl-tmp/workspace/DINO/models/dino/ops/build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=MultiScaleDeformableAttention -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
  In file included from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp:11:
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h: In function ‘at::Tensor ms_deform_attn_forward(const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, int):
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h:29:19: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     29 |     if (value.type().is_cuda())
        |         ~~~~~~~~~~^~
  In file included from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:2,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:6,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/extension.h:5,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.h:12,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h:13,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp:11:
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:30: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        |                              ^~~~
  In file included from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp:11:
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h: In function ‘std::vector<at::Tensor> ms_deform_attn_backward(const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, int):
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h:51:19: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     51 |     if (value.type().is_cuda())
        |         ~~~~~~~~~~^~
  In file included from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:2,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:6,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/extension.h:5,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.h:12,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h:13,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp:11:
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:30: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        |                              ^~~~
  ninja: build stopped: subcommand failed.
  Traceback (most recent call last):
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2211, in _run_ninja_build
      subprocess.run(
    File "/root/miniconda3/envs/mambavision/lib/python3.12/subprocess.py", line 571, in run
      raise CalledProcessError(retcode, process.args,
  subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 2.

  The above exception was the direct cause of the following exception:

  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 35, in <module>
    File "/root/autodl-tmp/workspace/DINO/models/dino/ops/setup.py", line 64, in <module>
      setup(
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/__init__.py", line 117, in setup
      return distutils.core.setup(**attrs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
      return run_commands(dist)
             ^^^^^^^^^^^^^^^^^^
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
      dist.run_commands()
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
      self.run_command(cmd)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
      super().run_command(command)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py", line 370, in run
      self.run_command("build")
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
      self.distribution.run_command(command)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
      super().run_command(command)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 135, in run
      self.run_command(cmd_name)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
      self.distribution.run_command(command)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
      super().run_command(command)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
      cmd_obj.run()
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run
      _build_ext.run(self)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
      self.build_extensions()
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 902, in build_extensions
      build_ext.build_extensions(self)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 484, in build_extensions
      self._build_extensions_serial()
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 510, in _build_extensions_serial
      self.build_extension(ext)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 264, in build_extension
      _build_ext.build_extension(self, ext)
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 565, in build_extension
      objects = self.compiler.compile(
                ^^^^^^^^^^^^^^^^^^^^^^
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 715, in unix_wrap_ninja_compile
      _write_ninja_file_and_compile_objects(
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 1871, in _write_ninja_file_and_compile_objects
      _run_ninja_build(
    File "/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2227, in _run_ninja_build
      raise RuntimeError(message) from e
  RuntimeError: Error compiling objects for extension
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> See above for output.
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: /root/miniconda3/envs/mambavision/bin/python3.12 -u -c '
  exec(compile('"'"''"'"''"'"'
  # This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
  #
  # - It imports setuptools before invoking setup.py, to enable projects that directly
  #   import from `distutils.core` to work with newer packaging standards.
  # - It provides a clear error message when setuptools is not installed.
  # - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
  #   setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
  #     manifest_maker: standard file '"'"'-c'"'"' not found".
  # - It generates a shim setup.py, for handling setup.cfg-only projects.
  import os, sys, tokenize, traceback
  
  try:
      import setuptools
  except ImportError:
      print(
          "ERROR: Can not execute `setup.py` since setuptools failed to import in "
          "the build environment with exception:",
          file=sys.stderr,
      )
      traceback.print_exc()
      sys.exit(1)
  
  __file__ = %r
  sys.argv[0] = __file__
  
  if os.path.exists(__file__):
      filename = __file__
      with tokenize.open(__file__) as f:
          setup_py_code = f.read()
  else:
      filename = "<auto-generated setuptools caller>"
      setup_py_code = "from setuptools import setup; setup()"
  
  exec(compile(setup_py_code, filename, "exec"))
  '"'"''"'"''"'"' % ('"'"'/root/autodl-tmp/workspace/DINO/models/dino/ops/setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' bdist_wheel -d /tmp/pip-wheel-ejvhhx_1
  cwd: /root/autodl-tmp/workspace/DINO/models/dino/ops/
  Building wheel for MultiScaleDeformableAttention (setup.py) ... error
  ERROR: Failed building wheel for MultiScaleDeformableAttention
  Running setup.py clean for MultiScaleDeformableAttention                                                                                                                                                                          
  Running command python setup.py clean
  running clean
  removing 'build/temp.linux-x86_64-cpython-312' (and everything under it)
  removing 'build/lib.linux-x86_64-cpython-312' (and everything under it)
  'build/bdist.linux-x86_64' does not exist -- can't clean it
  'build/scripts-3.12' does not exist -- can't clean it
  removing 'build'
Failed to build MultiScaleDeformableAttention
error: failed-wheel-build-for-install

× Failed to build installable wheels for some pyproject.toml based projects
╰─> MultiScaleDeformableAttention

第三步

分析报错
找出报错输出中的重点信息
重点1

 2 errors detected in the compilation of "/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu".

这说明代码中有两处错误,那接下来根据报错信息分析出哪里错了

重点2

  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu(64): error: no suitable conversion function from "const at::DeprecatedTypeProperties" to "c10::ScalarType" exists

说明

 /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu(64)

这个路径下的ms_deform_attn_cuda.cu文件64行有错误,错误信息为

error: no suitable conversion function from "const at::DeprecatedTypeProperties" to "c10::ScalarType" exists

重点3

 /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu(134): error: no suitable conversion function from "const at::DeprecatedTypeProperties" to "c10::ScalarType" exists

说明

 /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu(134)

这个路径下的/ms_deform_attn_cuda.cu文件在134行有错误,错误信息为

 error: no suitable conversion function from "const at::DeprecatedTypeProperties" to "c10::ScalarType" exists

重点4
两处有明显的报错提示
提示1

 29 |     if (value.type().is_cuda())
        |         ~~~~~~~~~~^~
  In file included from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:2,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:6,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/extension.h:5,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.h:12,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h:13,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp:11:

提示2

     51 |     if (value.type().is_cuda())
        |         ~~~~~~~~~~^~
  In file included from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:2,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:6,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/extension.h:5,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.h:12,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h:13,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp:11:

根据以上信息查阅资料发现这个错误通常是由于 PyTorch 版本兼容性问题导致的,具体来说是代码中使用了旧版本 PyTorch 的类型获取方式,而当前环境的 PyTorch 版本已经更新了相关 API。
错误核心在于:value.type()返回的at::DeprecatedTypeProperties类型无法转换为c10::ScalarType,这是因为 PyTorch 在较新版本中废弃了旧的类型获取方式。
解决方法
修改代码中获取标量类型的方式,将旧的通过type()获取类型的方式改为直接获取标量类型

第四步

修复代码
找到代码中的64行(根据重点2得到的)

AT_DISPATCH_FLOATING_TYPES(value.type(), "ms_deform_attn_forward_cuda", ([&] {

修改为

AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {

找到代码中的134行(根据重点3得到的)

AT_DISPATCH_FLOATING_TYPES(value.type(), "ms_deform_attn_backward_cuda", ([&] {

修改为

AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {

解释
在新版本 PyTorch 中:
value.type() 返回的是已废弃的 const at::DeprecatedTypeProperties
应该使用 value.scalar_type() 直接获取 c10::ScalarType 类型,避免类型转换问题

尝试重新编译

执行编译指令

pip install --no-build-isolation . --verbose

编译成功

(mambavision) root@autodl-container-01c74bb1c0-8eafbf69:~/autodl-tmp/workspace/DINO/models/dino/ops# pip install --no-build-isolation . --verbose
Using pip 25.2 from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/pip (python 3.12)
Looking in indexes: http://mirrors.aliyun.com/pypi/simple
Processing /root/autodl-tmp/workspace/DINO/models/dino/ops
  Running command python setup.py egg_info
  running egg_info
  creating /tmp/pip-pip-egg-info-iftlfgko/MultiScaleDeformableAttention.egg-info
  writing /tmp/pip-pip-egg-info-iftlfgko/MultiScaleDeformableAttention.egg-info/PKG-INFO
  writing dependency_links to /tmp/pip-pip-egg-info-iftlfgko/MultiScaleDeformableAttention.egg-info/dependency_links.txt
  writing top-level names to /tmp/pip-pip-egg-info-iftlfgko/MultiScaleDeformableAttention.egg-info/top_level.txt
  writing manifest file '/tmp/pip-pip-egg-info-iftlfgko/MultiScaleDeformableAttention.egg-info/SOURCES.txt'
  reading manifest file '/tmp/pip-pip-egg-info-iftlfgko/MultiScaleDeformableAttention.egg-info/SOURCES.txt'
  writing manifest file '/tmp/pip-pip-egg-info-iftlfgko/MultiScaleDeformableAttention.egg-info/SOURCES.txt'
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: MultiScaleDeformableAttention
  DEPRECATION: Building 'MultiScaleDeformableAttention' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'MultiScaleDeformableAttention'. Discussion can be found at https://github.com/pypa/pip/issues/6334
  Running command python setup.py bdist_wheel
  running bdist_wheel
  running build
  running build_py
  creating build/lib.linux-x86_64-cpython-312/functions
  copying functions/ms_deform_attn_func.py -> build/lib.linux-x86_64-cpython-312/functions
  copying functions/__init__.py -> build/lib.linux-x86_64-cpython-312/functions
  creating build/lib.linux-x86_64-cpython-312/modules
  copying modules/ms_deform_attn.py -> build/lib.linux-x86_64-cpython-312/modules
  copying modules/__init__.py -> build/lib.linux-x86_64-cpython-312/modules
  running build_ext
  building 'MultiScaleDeformableAttention' extension
  creating build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu
  creating build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda
  g++ -pthread -B /root/miniconda3/envs/mambavision/compiler_compat -fno-strict-overflow -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -isystem /root/miniconda3/envs/mambavision/include -fPIC -O2 -isystem /root/miniconda3/envs/mambavision/include -fPIC -DWITH_CUDA -I/root/autodl-tmp/workspace/DINO/models/dino/ops/src -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/TH -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/THC -I/usr/local/cuda/include -I/root/miniconda3/envs/mambavision/include/python3.12 -c /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.cpp -o build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.o -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -DTORCH_EXTENSION_NAME=MultiScaleDeformableAttention -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/utils/cpp_extension.py:2061: UserWarning: TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation.
  If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'].
    warnings.warn(
  /usr/local/cuda/bin/nvcc -DWITH_CUDA -I/root/autodl-tmp/workspace/DINO/models/dino/ops/src -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/TH -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/THC -I/usr/local/cuda/include -I/root/miniconda3/envs/mambavision/include/python3.12 -c /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu -o build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -DCUDA_HAS_FP16=1 -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -DTORCH_EXTENSION_NAME=MultiScaleDeformableAttention -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_89,code=compute_89 -gencode=arch=compute_89,code=sm_89 -std=c++17
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_im2col_cuda.cuh(261): warning #177-D: variable "q_col" was declared but never referenced
        const int q_col = _temp % num_query;
                  ^
            detected during instantiation of "void ms_deformable_im2col_cuda(cudaStream_t, const scalar_t *, const int64_t *, const int64_t *, const scalar_t *, const scalar_t *, int, int, int, int, int, int, int, scalar_t *) [with scalar_t=double]" at line 64 of /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu

  Remark: The warnings can be suppressed with "-diag-suppress <warning-number>"

  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_im2col_cuda.cuh(762): warning #177-D: variable "q_col" was declared but never referenced
        const int q_col = _temp % num_query;
                  ^
            detected during instantiation of "void ms_deformable_col2im_cuda(cudaStream_t, const scalar_t *, const scalar_t *, const int64_t *, const int64_t *, const scalar_t *, const scalar_t *, int, int, int, int, int, int, int, scalar_t *, scalar_t *, scalar_t *) [with scalar_t=double]" at line 134 of /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu

  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_im2col_cuda.cuh(872): warning #177-D: variable "q_col" was declared but never referenced
        const int q_col = _temp % num_query;
                  ^
            detected during instantiation of "void ms_deformable_col2im_cuda(cudaStream_t, const scalar_t *, const scalar_t *, const int64_t *, const int64_t *, const scalar_t *, const scalar_t *, int, int, int, int, int, int, int, scalar_t *, scalar_t *, scalar_t *) [with scalar_t=double]" at line 134 of /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu

  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_im2col_cuda.cuh(331): warning #177-D: variable "q_col" was declared but never referenced
        const int q_col = _temp % num_query;
                  ^
            detected during instantiation of "void ms_deformable_col2im_cuda(cudaStream_t, const scalar_t *, const scalar_t *, const int64_t *, const int64_t *, const scalar_t *, const scalar_t *, int, int, int, int, int, int, int, scalar_t *, scalar_t *, scalar_t *) [with scalar_t=double]" at line 134 of /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu

  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_im2col_cuda.cuh(436): warning #177-D: variable "q_col" was declared but never referenced
        const int q_col = _temp % num_query;
                  ^
            detected during instantiation of "void ms_deformable_col2im_cuda(cudaStream_t, const scalar_t *, const scalar_t *, const int64_t *, const int64_t *, const scalar_t *, const scalar_t *, int, int, int, int, int, int, int, scalar_t *, scalar_t *, scalar_t *) [with scalar_t=double]" at line 134 of /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu

  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_im2col_cuda.cuh(544): warning #177-D: variable "q_col" was declared but never referenced
        const int q_col = _temp % num_query;
                  ^
            detected during instantiation of "void ms_deformable_col2im_cuda(cudaStream_t, const scalar_t *, const scalar_t *, const int64_t *, const int64_t *, const scalar_t *, const scalar_t *, int, int, int, int, int, int, int, scalar_t *, scalar_t *, scalar_t *) [with scalar_t=double]" at line 134 of /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu

  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_im2col_cuda.cuh(649): warning #177-D: variable "q_col" was declared but never referenced
        const int q_col = _temp % num_query;
                  ^
            detected during instantiation of "void ms_deformable_col2im_cuda(cudaStream_t, const scalar_t *, const scalar_t *, const int64_t *, const int64_t *, const scalar_t *, const scalar_t *, int, int, int, int, int, int, int, scalar_t *, scalar_t *, scalar_t *) [with scalar_t=double]" at line 134 of /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu

  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu: In function ‘at::Tensor ms_deform_attn_cuda_forward(const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, int):
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:34:61: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     34 |     AT_ASSERTM(value.type().is_cuda(), "value must be a CUDA tensor");
        |                                                   ~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:35:70: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     35 |     AT_ASSERTM(spatial_shapes.type().is_cuda(), "spatial_shapes must be a CUDA tensor");
        |                                                   ~~~~~~~~~~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:36:73: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     36 |     AT_ASSERTM(level_start_index.type().is_cuda(), "level_start_index must be a CUDA tensor");
        |                                                   ~~~~~~~~~~~~~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:37:68: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     37 |     AT_ASSERTM(sampling_loc.type().is_cuda(), "sampling_loc must be a CUDA tensor");
        |                                                   ~~~~~~~~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:38:67: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     38 |     AT_ASSERTM(attn_weight.type().is_cuda(), "attn_weight must be a CUDA tensor");
        |                                                   ~~~~~~~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu: In lambda function:
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:984: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:1070: warning: ‘T* at::Tensor::data() const [with T = long int]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:1113: warning: ‘T* at::Tensor::data() const [with T = long int]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:1146: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:1229: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:1387: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu: In lambda function:
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:2181: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:2267: warning: ‘T* at::Tensor::data() const [with T = long int]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:2310: warning: ‘T* at::Tensor::data() const [with T = long int]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:2342: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:2424: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:64:2581: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
     64 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_forward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu: In function ‘std::vector<at::Tensor> ms_deform_attn_cuda_backward(const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, int):
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:100:61: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
    100 |     AT_ASSERTM(value.type().is_cuda(), "value must be a CUDA tensor");
        |                                                   ~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:101:70: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
    101 |     AT_ASSERTM(spatial_shapes.type().is_cuda(), "spatial_shapes must be a CUDA tensor");
        |                                                   ~~~~~~~~~~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:102:73: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
    102 |     AT_ASSERTM(level_start_index.type().is_cuda(), "level_start_index must be a CUDA tensor");
        |                                                   ~~~~~~~~~~~~~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:103:68: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
    103 |     AT_ASSERTM(sampling_loc.type().is_cuda(), "sampling_loc must be a CUDA tensor");
        |                                                   ~~~~~~~~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:104:67: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
    104 |     AT_ASSERTM(attn_weight.type().is_cuda(), "attn_weight must be a CUDA tensor");
        |                                                   ~~~~~~~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:105:67: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
    105 |     AT_ASSERTM(grad_output.type().is_cuda(), "grad_output must be a CUDA tensor");
        |                                                   ~~~~~~~~~~~~~~~~^~
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:1: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu: In lambda function:
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:994: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:1020: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:1106: warning: ‘T* at::Tensor::data() const [with T = long int]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:1149: warning: ‘T* at::Tensor::data() const [with T = long int]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:1182: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:1265: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:1426: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:1510: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:1598: warning: ‘T* at::Tensor::data() const [with T = double]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu: In lambda function:
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:2453: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:2478: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:2564: warning: ‘T* at::Tensor::data() const [with T = long int]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:2607: warning: ‘T* at::Tensor::data() const [with T = long int]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:2639: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:2721: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:2881: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:2964: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.cu:134:3051: warning: ‘T* at::Tensor::data() const [with T = float]is deprecated: Tensor.data<T>() is deprecated. Please use Tensor.data_ptr<T>() instead. [-Wdeprecated-declarations]
    134 |         AT_DISPATCH_FLOATING_TYPES(value.scalar_type(), "ms_deform_attn_backward_cuda", ([&] {
        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           ^
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:247:1: note: declared here
    247 |   T * data() const {
        | ^ ~~
  g++ -pthread -B /root/miniconda3/envs/mambavision/compiler_compat -fno-strict-overflow -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -isystem /root/miniconda3/envs/mambavision/include -fPIC -O2 -isystem /root/miniconda3/envs/mambavision/include -fPIC -DWITH_CUDA -I/root/autodl-tmp/workspace/DINO/models/dino/ops/src -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/TH -I/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/THC -I/usr/local/cuda/include -I/root/miniconda3/envs/mambavision/include/python3.12 -c /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp -o build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.o -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -DTORCH_EXTENSION_NAME=MultiScaleDeformableAttention -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
  In file included from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp:11:
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h: In function ‘at::Tensor ms_deform_attn_forward(const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, int):
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h:29:19: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     29 |     if (value.type().is_cuda())
        |         ~~~~~~~~~~^~
  In file included from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:2,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:6,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/extension.h:5,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.h:12,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h:13,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp:11:
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:30: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        |                              ^~~~
  In file included from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp:11:
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h: In function ‘std::vector<at::Tensor> ms_deform_attn_backward(const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, int):
  /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h:51:19: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     51 |     if (value.type().is_cuda())
        |         ~~~~~~~~~~^~
  In file included from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/Tensor.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/function_hook.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:2,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/variable.h:6,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/autograd/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:3,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
                   from /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/torch/extension.h:5,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.h:12,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/ms_deform_attn.h:13,
                   from /root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.cpp:11:
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/include/ATen/core/TensorBody.h:225:30: note: declared here
    225 |   DeprecatedTypeProperties & type() const {
        |                              ^~~~
  g++ -pthread -B /root/miniconda3/envs/mambavision/compiler_compat -fno-strict-overflow -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -isystem /root/miniconda3/envs/mambavision/include -fPIC -O2 -isystem /root/miniconda3/envs/mambavision/include -pthread -B /root/miniconda3/envs/mambavision/compiler_compat -shared -Wl,-rpath,/root/miniconda3/envs/mambavision/lib -Wl,-rpath-link,/root/miniconda3/envs/mambavision/lib -L/root/miniconda3/envs/mambavision/lib -Wl,-rpath,/root/miniconda3/envs/mambavision/lib -Wl,-rpath-link,/root/miniconda3/envs/mambavision/lib -L/root/miniconda3/envs/mambavision/lib build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cpu/ms_deform_attn_cpu.o build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/cuda/ms_deform_attn_cuda.o build/temp.linux-x86_64-cpython-312/root/autodl-tmp/workspace/DINO/models/dino/ops/src/vision.o -L/root/miniconda3/envs/mambavision/lib/python3.12/site-packages/torch/lib -L/usr/local/cuda/lib64 -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-cpython-312/MultiScaleDeformableAttention.cpython-312-x86_64-linux-gnu.so
  /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
  !!

          ********************************************************************************
          Please avoid running ``setup.py`` directly.
          Instead, use pypa/build, pypa/installer or other
          standards-based tools.

          See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
          ********************************************************************************

  !!
    self.initialize_options()
  installing to build/bdist.linux-x86_64/wheel
  running install
  running install_lib
  creating build/bdist.linux-x86_64/wheel
  creating build/bdist.linux-x86_64/wheel/functions
  copying build/lib.linux-x86_64-cpython-312/functions/ms_deform_attn_func.py -> build/bdist.linux-x86_64/wheel/./functions
  copying build/lib.linux-x86_64-cpython-312/functions/__init__.py -> build/bdist.linux-x86_64/wheel/./functions
  creating build/bdist.linux-x86_64/wheel/modules
  copying build/lib.linux-x86_64-cpython-312/modules/ms_deform_attn.py -> build/bdist.linux-x86_64/wheel/./modules
  copying build/lib.linux-x86_64-cpython-312/modules/__init__.py -> build/bdist.linux-x86_64/wheel/./modules
  copying build/lib.linux-x86_64-cpython-312/MultiScaleDeformableAttention.cpython-312-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/wheel/.
  running install_egg_info
  running egg_info
  creating MultiScaleDeformableAttention.egg-info
  writing MultiScaleDeformableAttention.egg-info/PKG-INFO
  writing dependency_links to MultiScaleDeformableAttention.egg-info/dependency_links.txt
  writing top-level names to MultiScaleDeformableAttention.egg-info/top_level.txt
  writing manifest file 'MultiScaleDeformableAttention.egg-info/SOURCES.txt'
  reading manifest file 'MultiScaleDeformableAttention.egg-info/SOURCES.txt'
  writing manifest file 'MultiScaleDeformableAttention.egg-info/SOURCES.txt'
  Copying MultiScaleDeformableAttention.egg-info to build/bdist.linux-x86_64/wheel/./MultiScaleDeformableAttention-1.0-py3.12.egg-info
  running install_scripts
  creating build/bdist.linux-x86_64/wheel/multiscaledeformableattention-1.0.dist-info/WHEEL
  creating '/tmp/pip-wheel-wb_3317q/multiscaledeformableattention-1.0-cp312-cp312-linux_x86_64.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
  adding 'MultiScaleDeformableAttention.cpython-312-x86_64-linux-gnu.so'
  adding 'functions/__init__.py'
  adding 'functions/ms_deform_attn_func.py'
  adding 'modules/__init__.py'
  adding 'modules/ms_deform_attn.py'
  adding 'multiscaledeformableattention-1.0.dist-info/METADATA'
  adding 'multiscaledeformableattention-1.0.dist-info/WHEEL'
  adding 'multiscaledeformableattention-1.0.dist-info/top_level.txt'
  adding 'multiscaledeformableattention-1.0.dist-info/RECORD'
  removing build/bdist.linux-x86_64/wheel
  Building wheel for MultiScaleDeformableAttention (setup.py) ... done
  Created wheel for MultiScaleDeformableAttention: filename=multiscaledeformableattention-1.0-cp312-cp312-linux_x86_64.whl size=250486 sha256=a70f88a47c143f8d60967a58f69720a310b8a6dc7a3cc9dbb69f22f0d89d62ca
  Stored in directory: /tmp/pip-ephem-wheel-cache-pg5f_s1f/wheels/3e/f0/ba/ed644116c8001539468d5e30f877872cf7a6a2da29eba68c47
Successfully built MultiScaleDeformableAttention
Installing collected packages: MultiScaleDeformableAttention
Successfully installed MultiScaleDeformableAttention-1.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
(mambavision) root@autodl-container-01c74bb1c0-8eafbf69:~/autodl-tmp/workspace/DINO/models/dino/ops# pip uninstall deformable-attention
Found existing installation: deformable-attention 0.0.20
Uninstalling deformable-attention-0.0.20:
  Would remove:
    /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/deformable_attention-0.0.20.dist-info/*
    /root/miniconda3/envs/mambavision/lib/python3.12/site-packages/deformable_attention/*
Proceed (Y/n)? y
  Successfully uninstalled deformable-attention-0.0.20
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
(mambavision) root@autodl-container-01c74bb1c0-8eafbf69:~/autodl-tmp/workspace/DINO/models/dino/ops# 

附加教程

如果出现

【Python】LINK :fatal error LNK1181:_link : fatal error lnk1181: 无法打开输入文件

或者
出现ninja字样的相关错误可以尝试把打开ops根目录的setup.py文件修改

cmdclass={"build_ext": torch.utils.cpp_extension.BuildExtension},

cmdclass={"build_ext": torch.utils.cpp_extension.BuildExtension.with_options(use_ninja=False)},

可能解决相关问题

Logo

DAMO开发者矩阵,由阿里巴巴达摩院和中国互联网协会联合发起,致力于探讨最前沿的技术趋势与应用成果,搭建高质量的交流与分享平台,推动技术创新与产业应用链接,围绕“人工智能与新型计算”构建开放共享的开发者生态。

更多推荐