Skip to content

mamba-ssm fails to build on torch==2.7.0 #720

Open
@mgoin

Description

@mgoin

This causes the package to fail to install by default since the torch version is unpinned.

It works if i disable build isolation with torch==2.6.0 already installed i.e. uv pip install mamba-ssm==2.2.4 --no-build-isolation, so we have to patch the vLLM installation manually vllm-project/vllm#17070

Found in the vllm ci https://buildkite.com/vllm/ci/builds/18314/steps?jid=01966392-20ef-480d-af0d-9d14c5b0e699#01966392-20ef-480d-af0d-9d14c5b0e699/130-10994


[2025-04-23T17:19:15Z] #41 35.20   × Failed to build `mamba-ssm==2.2.4`
--
  | [2025-04-23T17:19:15Z] #41 35.20   ├─▶ The build backend returned an error
  | [2025-04-23T17:19:16Z] #41 35.20   ╰─▶ Call to `setuptools.build_meta.build_wheel` failed (exit status: 1)
  | [2025-04-23T17:19:16Z] #41 35.20
  | [2025-04-23T17:19:16Z] #41 35.20       [stdout]
  | [2025-04-23T17:19:16Z] #41 35.20
  | [2025-04-23T17:19:16Z] #41 35.20
  | [2025-04-23T17:19:16Z] #41 35.20       torch.__version__  = 2.7.0+cu126
  | [2025-04-23T17:19:16Z] #41 35.20
  | [2025-04-23T17:19:16Z] #41 35.20
  | [2025-04-23T17:19:16Z] #41 35.20       running bdist_wheel
  | [2025-04-23T17:19:16Z] #41 35.20       Guessing wheel URL:
  | [2025-04-23T17:19:16Z] #41 35.20       https://github.com/state-spaces/mamba/releases/download/v2.2.4/mamba_ssm-2.2.4+cu12torch2.7cxx11abiTRUE-cp312-cp312-linux_x86_64.whl
  | [2025-04-23T17:19:16Z] #41 35.20       Precompiled wheel not found. Building from source...
  | [2025-04-23T17:19:16Z] #41 35.20       running build
  | [2025-04-23T17:19:16Z] #41 35.20       running build_py
  | [2025-04-23T17:19:16Z] #41 35.20       creating build/lib.linux-x86_64-cpython-312/mamba_ssm
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/__init__.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm
  | [2025-04-23T17:19:16Z] #41 35.20       creating build/lib.linux-x86_64-cpython-312/mamba_ssm/distributed
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/distributed/__init__.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/distributed
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/distributed/distributed_utils.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/distributed
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/distributed/tensor_parallel.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/distributed
  | [2025-04-23T17:19:16Z] #41 35.20       creating build/lib.linux-x86_64-cpython-312/mamba_ssm/models
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/models/__init__.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/models
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/models/config_mamba.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/models
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/models/mixer_seq_simple.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/models
  | [2025-04-23T17:19:16Z] #41 35.20       creating build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/modules/__init__.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/modules/block.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/modules/mamba2.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/modules/mamba2_simple.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/modules/mamba_simple.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/modules/mha.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/modules/mlp.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/modules/ssd_minimal.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/modules
  | [2025-04-23T17:19:16Z] #41 35.20       creating build/lib.linux-x86_64-cpython-312/mamba_ssm/ops
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/__init__.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/selective_scan_interface.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops
  | [2025-04-23T17:19:16Z] #41 35.20       creating build/lib.linux-x86_64-cpython-312/mamba_ssm/utils
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/utils/__init__.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/utils
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/utils/generation.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/utils
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/utils/hf.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/utils
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/utils/torch.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/utils
  | [2025-04-23T17:19:16Z] #41 35.20       creating build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/__init__.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/k_activations.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/layer_norm.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/layernorm_gated.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/selective_state_update.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/softplus.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/ssd_bmm.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/ssd_chunk_scan.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/ssd_chunk_state.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/ssd_combined.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       copying mamba_ssm/ops/triton/ssd_state_passing.py ->
  | [2025-04-23T17:19:16Z] #41 35.20       build/lib.linux-x86_64-cpython-312/mamba_ssm/ops/triton
  | [2025-04-23T17:19:16Z] #41 35.20       running egg_info
  | [2025-04-23T17:19:16Z] #41 35.20       writing mamba_ssm.egg-info/PKG-INFO
  | [2025-04-23T17:19:16Z] #41 35.20       writing dependency_links to mamba_ssm.egg-info/dependency_links.txt
  | [2025-04-23T17:19:16Z] #41 35.20       writing requirements to mamba_ssm.egg-info/requires.txt
  | [2025-04-23T17:19:16Z] #41 35.20       writing top-level names to mamba_ssm.egg-info/top_level.txt
  | [2025-04-23T17:19:16Z] #41 35.20       reading manifest file 'mamba_ssm.egg-info/SOURCES.txt'
  | [2025-04-23T17:19:16Z] #41 35.20       adding license file 'LICENSE'
  | [2025-04-23T17:19:16Z] #41 35.20       adding license file 'AUTHORS'
  | [2025-04-23T17:19:16Z] #41 35.20       writing manifest file 'mamba_ssm.egg-info/SOURCES.txt'
  | [2025-04-23T17:19:16Z] #41 35.20       running build_ext
  | [2025-04-23T17:19:16Z] #41 35.20       building 'selective_scan_cuda' extension
  | [2025-04-23T17:19:16Z] #41 35.20       creating
  | [2025-04-23T17:19:16Z] #41 35.20       /root/.cache/uv/sdists-v9/pypi/mamba-ssm/2.2.4/-WVSrLyluQdBNplm8_RXR/src/build/temp.linux-x86_64-cpython-312/csrc/selective_scan
  | [2025-04-23T17:19:16Z] #41 35.20       ninja: error:
  | [2025-04-23T17:19:16Z] #41 35.20       '/root/.cache/uv/sdists-v9/pypi/mamba-ssm/2.2.4/-WVSrLyluQdBNplm8_RXR/src/csrc/selective_scan/selective_scan.cpp',
  | [2025-04-23T17:19:16Z] #41 35.20       needed by
  | [2025-04-23T17:19:16Z] #41 35.20       '/root/.cache/uv/sdists-v9/pypi/mamba-ssm/2.2.4/-WVSrLyluQdBNplm8_RXR/src/build/temp.linux-x86_64-cpython-312/csrc/selective_scan/selective_scan.o',
  | [2025-04-23T17:19:16Z] #41 35.20       missing and no known rule to make it


Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions