CMake configuration failure while trying to build libc++: "/usr/lib/llvm-19/lib/libLibcTableGenUtil.a" but this file does not exist.

[Zingam]

@sylvestre reporting as suggested here: #92359
I am trying to build libc++ on WSL Ubuntu 24.04.
LLVM19 was installed originally via llvm.sh. I updated today.

$ clang --version
Ubuntu clang version 19.0.0 (++20240721081714+0caf0c93e759-1exp120240721081828.299)
Target: x86_64-pc-linux-gnu
Thread model: posix
InstalledDir: /usr/lib/llvm-19/bin

I build via VSCode and I have the following CMakePresets.json file put in /runtimes

{
    "version": 9,
    "cmakeMinimumRequired": {
      "major": 3,
      "minor": 30,
      "patch": 0
    },
    "configurePresets": [
      {
        "name": "default",
        "displayName": "Default Config",
        "description": "Default build using Ninja generator",
        "hidden": true,
        "generator": "Ninja",
        "binaryDir": "${sourceParentDir}/build/${presetName}"
      },
      {
        "name": "default.debug.libcxx",
        "displayName": "Debug libc++",
        "description": "libc++ debug configuration",
        "inherits": [
          "default"
        ],
        "cacheVariables": {
          "LLVM_ENABLE_RUNTIMES": {
            "type": "STRING",
            "value": "libcxx;libcxxabi;libunwind"
          },
          "CMAKE_EXPORT_COMPILE_COMMANDS": {
            "type": "BOOL",
            "value": "ON"
          },
          "CMAKE_BUILD_TYPE": {
            "type": "STRING",
            "value": "Debug"
          },
          "LIBCXX_ENABLE_DEBUG_MODE": {
            "type": "BOOL",
            "value": "ON"
          },
          "LIBCXX_HARDENING_MODE": {
            "type": "STRING",
            "value": "debug"
          },
          "CMAKE_C_COMPILER": {
            "type": "STRING",
            "value": "clang"
          },
          "CMAKE_CXX_COMPILER": {
            "type": "STRING",
            "value": "clang++"
          }
        }
      }
    ],
    "buildPresets": [
      {
        "name": "default",
        "configurePreset": "default.debug.libcxx"
      }
    ]
  }

[cmake] -- Could NOT find CURL (missing: CURL_LIBRARY CURL_INCLUDE_DIR)
[cmake] CMake Error at /usr/lib/llvm-19/lib/cmake/llvm/LLVMExports.cmake:1914 (message):
[cmake] The imported target "LibcTableGenUtil" references the file
[cmake]
[cmake] "/usr/lib/llvm-19/lib/libLibcTableGenUtil.a"
[cmake]
[cmake] but this file does not exist. Possible reasons include:
[cmake]
[cmake] * The file was deleted, renamed, or moved to another location.
[cmake]
[cmake] * An install or uninstall procedure did not complete successfully.
[cmake]
[cmake] * The installation package was faulty and contained
[cmake]
[cmake] "/usr/lib/llvm-19/lib/cmake/llvm/LLVMExports.cmake"
[cmake]
[cmake] but not all the files it references.
[cmake]
[cmake] Call Stack (most recent call first):
[cmake] /usr/lib/llvm-19/lib/cmake/llvm/LLVMConfig.cmake:370 (include)
[cmake] /usr/lib/cmake/clang-19/ClangConfig.cmake:11 (find_package)
[cmake] /home/hristo/Projects/llvm-project/libcxx/test/tools/clang_tidy_checks/CMakeLists.txt:11 (find_package)
[cmake]
[cmake]
[cmake] -- Configuring incomplete, errors occurred!

[Zingam]

Same if I install LLVM20:

[cmake] The imported target "LibcTableGenUtil" references the file
[cmake]
[cmake] "/usr/lib/llvm-20/lib/libLibcTableGenUtil.a"

[Zingam]

Same if I install LLVM18:

[cmake] CMake Error at /usr/lib/llvm-18/lib/cmake/clang/ClangTargets.cmake:833 (message):
[cmake] The imported target "clangBasic" references the file
[cmake]
[cmake] "/usr/lib/llvm-18/lib/libclangBasic.a"

[dr-m]

@Zingam, can you please explain how this was fixed or can be worked around? I am running into this same issue when trying to build a -fsanitize=memory instrumented libc++ on a Debian Sid system, using clang-19 from 1:19.1.0~++20240813124017+28f2d04b3ca3-1~exp1~20240813124123.26 and invoking this script attached to this ticket with CLANG=19.

It would be very convenient if a -fsanitize=memory instrumented libc++.so could be made available in the LLVM package repositories, because it would basically bring the same level of support for C and C++. (For C, there are built-in interceptors for the GNU libc.)

[H-G-Hristov]

@dr-m Have you tried installing libllvmlibc-20-dev:

[dr-m]

Thank you. I was missing the packages libllvmlibc-19-dev and libclang-19-dev.

I also adjusted my build script slightly (not sure if all that is needed):

--- build-msan18.sh
+++ build-msan19.sh
@@ -1,6 +1,6 @@
 #!/bin/sh
 set -eux
-: ${CLANG=18}
+: ${CLANG=19}
 : ${MSAN_LIBDIR=..}
 : ${PARALLEL=$(nproc)}
 
@@ -15,14 +15,17 @@
 fi
 
 sudo apt -o APT::Get::Assume-Yes=true install \
-    clang-$CLANG libc++-$CLANG-dev libc++abi-$CLANG-dev automake
+    clang-$CLANG libc++-$CLANG-dev libc++abi-$CLANG-dev \
+    libclang-$CLANG-dev libllvmlibc-$CLANG-dev automake
 apt -o APT::Get::Assume-Yes=true source \
     llvm-toolchain-$CLANG libgnutls28-dev libnettle8 libidn2 libgmp10
 
 mkdir -p ll-build
 cd ll-build
 cmake ../llvm-toolchain-$CLANG-$CLANG.*/runtimes -DCMAKE_BUILD_TYPE=Release \
-      -DLLVM_ENABLE_RUNTIMES="libcxx;libcxxabi;libunwind" \
+      -DLLVM_ENABLE_RUNTIMES="libc;libcxx;libcxxabi;libunwind" \
+      -DLLVM_INCLUDE_TESTS=OFF -DLLVM_INCLUDE_DOCS=OFF \
+      -DLLVM_ENABLE_SPHINX=OFF \
       -DCMAKE_C_COMPILER=clang-$CLANG \
       -DCMAKE_CXX_COMPILER=clang++-$CLANG \
       -DLLVM_USE_SANITIZER=MemoryWithOrigins

This exercise was rewarded: I got the fix D158943 that I was looking for. (Note: the automake in the above diff is not related to clang, but some other libraries that I need to compile with -fsanitize=memory.)

Still, it would be really great if a -fsanitize=memory instrumented libc++ package could be provided. After all, -fsanitize=memory is rather useless for pretty much any C++ code without that.

[Zingam]

Thank you. I was missing the packages libllvmlibc-19-dev and libclang-19-dev.

Great! Now the real question would be: Why the llvm.sh script fails to install these?

[dr-m]

I’m sorry, I just now realize that there could be an officially maintained llvm.sh script that I might use to avoid issues when compiling libc++ for various LLVM versions. Where is that script available? I could not find it on my system or in the package search at https://packages.debian.org.

I am using my own script, which my comments identify. The title of this ticket does exactly match my usage scenario: trying to build a -fsanitizer=memory instrumented version of libc++. There was no build-time dependency on libclang-18-dev or libllvmlibc-18-dev for the libc++ of LLVM 18.

[Zingam]

@dr-m Please check: https://apt.llvm.org/