<table border="1" cellspacing="0" cellpadding="8">
<tr>
<th>Issue</th>
<td>
<a href=https://github.com/llvm/llvm-project/issues/54621>54621</a>
</td>
</tr>
<tr>
<th>Summary</th>
<td>
[OpenMP][OMPD] Build error: 'hwloc.h' file not found at build time despite it being found during configure
</td>
</tr>
<tr>
<th>Labels</th>
<td>
</td>
</tr>
<tr>
<th>Assignees</th>
<td>
</td>
</tr>
<tr>
<th>Reporter</th>
<td>
s-sajid-ali
</td>
</tr>
</table>
<pre>
Hi LLVM-developers,
`llvm-14.0.0` fails to build due to an issue with the `ompd` library, specifically the `omp-icv.cpp` does not get the location of the `hwloc` header in the list of include paths.
A full explanation is available at https://github.com/spack/spack/issues/29751, with a short summary included below.
### Error message
Relevant error message:
```
>> 26468 FAILED: openmp/libompd/src/CMakeFiles/ompd.dir/omp-icv.cpp.o
26469 /tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-build-lmdeeji/./bin/clang++ --target=x86_64-unknown-linux-gnu -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -Dom
pd_EXPORTS -I/tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-src/openmp/libompd/src -I/tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-build-lmdeej
i/runtimes/runtimes-bins/openmp/runtime/src -I/tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-src/openmp/runtime/src -std=c++11 -fPIC -fno-semantic-interposition -fvisibility-inlines-h
idden -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovered-switch-default -Wno-noexcept-type -Wn
on-virtual-dtor -Wdelete-non-virtual-dtor -Wsuggest-override -Wno-comment -Wstring-conversion -Wmisleading-indentation -fdiagnostics-color -ffunction-sections -fdata-sections -Wall -Wcast-qual -Wformat-pedantic -Wimplicit-
fallthrough -Wsign-compare -Wno-extra -Wno-pedantic -std=c++14 -std=c++11 -O3 -DNDEBUG -fPIC -MD -MT openmp/libompd/src/CMakeFiles/ompd.dir/omp-icv.cpp.o -MF openmp/libompd/src/CMakeFiles/ompd.dir/omp-icv.cpp.o.d -o openmp
/libompd/src/CMakeFiles/ompd.dir/omp-icv.cpp.o -c /tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-src/openmp/libompd/src/omp-icv.cpp
26470 In file included from /tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-src/openmp/libompd/src/omp-icv.cpp:21:
>> 26471 /tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-src/openmp/runtime/src/kmp.h:96:10: fatal error: 'hwloc.h' file not found
26472 #include "hwloc.h"
26473 ^~~~~~~~~
26474 1 error generated.
```
This occurs, despite the fact that spack passes `'-DLIBOMP_USE_HWLOC:BOOL=ON' '-DLIBOMP_HWLOC_INSTALL_DIR:STRING=/home/sajid/packages/spack/opt/spack/linux-ubuntu20.04-zen2/gcc-11.2.0/hwloc-2.7.0-5ttjykgyd7bxnhegnydeesc53ufojjmb' ` and the fact that `hwloc` is indeed found during configuration (for `runtimes-bins`) :
```
-- Looking for hwloc.h
-- Looking for hwloc.h - found
-- Looking for hwloc_topology_init in /home/sajid/packages/spack/opt/spack/linux-ubuntu20.04-zen2/gcc-11.2.0/hwloc-2.7.0-5ttjykgyd7bxnhegnydeesc53ufojjmb/lib/libhwloc.so
-- Looking for hwloc_topology_init in /home/sajid/packages/spack/opt/spack/linux-ubuntu20.04-zen2/gcc-11.2.0/hwloc-2.7.0-5ttjykgyd7bxnhegnydeesc53ufojjmb/lib/libhwloc.so - found
```
For reference, the generated build recipe (`spack-build-lmdeeji/runtimes/runtimes-bins/build.ninja`) for the failing file is:
```
build openmp/libompd/src/CMakeFiles/ompd.dir/omp-icv.cpp.o: CXX_COMPILER__ompd_Release /tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-src/openmp/libompd/src/omp-icv.cpp || cmake_object_order_depends_target_ompd
DEFINES = -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -Dompd_EXPORTS
DEP_FILE = openmp/libompd/src/CMakeFiles/ompd.dir/omp-icv.cpp.o.d
FLAGS = -std=c++11 -fPIC -fno-semantic-interposition -fvisibility-inlines-hidden -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovered-switch-default -Wno-noexcept-type -Wnon-virtual-dtor -Wdelete-non-virtual-dtor -Wsuggest-override -Wno-comment -Wstring-conversion -Wmisleading-indentation -fdiagnostics-color -ffunction-sections -fdata-sections -Wall -Wcast-qual -Wformat-pedantic -Wimplicit-fallthrough -Wsign-compare -Wno-extra -Wno-pedantic -std=c++14 -std=c++11 -O3 -DNDEBUG -fPIC
INCLUDES = -I/tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-src/openmp/libompd/src -I/tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-build-lmdeeji/runtimes/runtimes-bins/openmp/runtime/src -I/tmp/sajid/spack-stage/spack-stage-llvm-14.0.0-lmdeejip2qzq4j4ntm7tbgx6pqua2z26/spack-src/openmp/runtime/src
OBJECT_DIR = openmp/libompd/src/CMakeFiles/ompd.dir
OBJECT_FILE_DIR = openmp/libompd/src/CMakeFiles/ompd.dir
TARGET_COMPILE_PDB = openmp/libompd/src/CMakeFiles/ompd.dir/
TARGET_PDB = openmp/libompd/src/libompd.pdb
```
### Further diagnosis
The recipe for `ompd` has the following includes:
```
include_directories (
${CMAKE_CURRENT_SOURCE_DIR}
${LIBOMP_INCLUDE_DIR}
${LIBOMP_SRC_DIR}
)
```
per [`openmp/libompd/src/CMakeLists.txt`](https://github.com/llvm/llvm-project/blob/main/openmp/libompd/src/CMakeLists.txt).
Now, `LIBOMP_INCLUDE_DIR` is set in [`openmp/runtime/src/CMakeLists.txt`](https://github.com/llvm/llvm-project/blob/main/openmp/runtime/src/CMakeLists.txt) to be only that directory (via `CMAKE_CURRENT_BINARY_DIR`) and `LIBOMP_SRC_DIR` is set in [`/main/openmp/runtime/CMakeLists.txt`](https://github.com/llvm/llvm-project/blob/main/openmp/runtime/CMakeLists.txt) to be `${LIBOMP_BASE_DIR}/src`.
> perhaps a missing dependency in the cmake target for ompd?
In light of the above this is probably the cause of the issue as the includes set for `omp-icv.cpp` expand as they are programmed to, but they do not contain the path for `hwloc`. I think the set of includes for `ompd` (and hence `omp-icv.cpp`) should also include `LIBOMP_HWLOC_INSTALL_DIR/include`.
</pre>
<img width="1px" height="1px" alt="" src="http://email.email.llvm.org/o/eJzlWVtzozoS_jXOiwrKxrf4IQ--zvGuE6ccZ8_sEyVAgBKQGCSSeH79dguIIfFkzk7OpGZnUwQDarX6ptbXkieDw8UfnGw2_7q0AvbAEpmxXHWcOel0F53utLqPuknykFq9gd21u_BGQsoTRbQkXsGTgAQFwxcqCFcKnh-5jomOGQFamWYBdkm4l9P8gLxVxnwecp8myaFBZnH_wfazDKkDyRQRUpOIaUOSSJ9qLgWRYd0lfoSPSBwzGrCccFFScqWRigs_KQJGMqpjZbcUmpKwSBLCnrKEipItV4Q-gFbUSxihmsRaZ6rTn3acFVwRKFR4ti9TeFEZ9e8bv0ZnMNrKmYyHPVTQ6E-JimWuiSrSFBSv5QmIB2Z-tFsGdvrlRZZ5LnOSMqVoxJokO5awByo0YS2K_vSlp6rLvBLS6S_hIs5oMDon8LearjfLBXYDT4s0A6nBMcZHoFDuw31-Se_ZiidGJWyxA56Xj7WHbFnzhz_kPcEHoNGGo6J3PKgNZCmNgrberEY4WUkaMHbHM-fL1y-Du4HQ6Vh70dMo-1JQ56szeu5qYq0mh682_HtcwN0HN0YdZwYXsSxNc4iaTn_xdD5yRwOrEPdCPgor4aJ4siJREGvhujf7xdydb69u9tOrvXs5ne-2N8eG1XZ3OX39ebO-XDe-Qjgc7fD8lwXu8vP1drcHkvXPNkrps9PO_IDhmz45ZQv0U14IzVMTTvWjBX5TTbmrhg-T-4XZXgyvdADh45cR1esRK7xez-EupKVYCrOQ-xYXmuWZVNykDyt84Ip7POH6AE0QaqBkfNIiQcCA_k8zj2GUgGpm4eCNb4WICppDrrCqnFTyFewRiCBrIumTzin8gkiFKBSQZjSnKQOh4OtjzoGr0jkXkYJ3nyptgQ2wZwr5Cj5bIWfgOi5AAZrwr5D3oZGnWcJ9rq0QhtFxLosoxv7ygeUwhoLM5sewVIS0SHQ5vJDsyWeZtvQhQyXEKa2lsB54rkECK9ASRQwgoYGM4nWLKqKIgbw4Zs4DVg4DuTdlAscs1YIPAgiUsT4qlcAqgN-5AANrWrkl4DQSUoHHFPRIcIAwLISPzeBM86uQjmraeK-s3LRbKPOUaitjgQmAprFOadw2oOKRQBXASZU-DQceWbYDb3AiErd9yDtXi-Xs9lMdlpcL-N-_M6EDi9U7WdgBsWTN44RFflw0_6evLW-l0bY87ZVv3MWHtSAhKHFc4sNcpr-SzP2p00Mw8woVjHsfsXK_lW3hfp9mdgziTUZw63URnYQwHRNS5UPAOM7YoD0gc8alrREchrIQwQuHOKVC_Rr-dRznuavzgrbfjs_hsjP-xtXuN8CHXgXFIiZYDkk8sE9isPK-jwFgSt8vSnQdMJVBhjZ4NaQ-QlzAnMZYgFeVAvCLDJyxtdisZ9vLa_f2Zun-8edmOwdzzLbbDWSF7RUao0lkCNw1YprNxl2sd0B8s9-trz4BORg6lqXVKy_jcOBT1cCyMtONtxIxFR74q3DA4wPrKxMO4mHft3o924FqALiieS3HHkNIDLW-O9xHh2DsPYmYReIAIaL8Yb8I5d1d6hmJAbJTEbxQvgnowVaYxXEioYehvsCMTyDjhzwq8jK3d5xzSMnYr40q0G4T0kDGbX9YFtlIeY_8sHsdG2-0EasZaKdoXC0zWFuig4vLKRYiv4ixMSmU91IXJX8LJdoeOTnhVqBWzkJALcJnOOUw2p6nalW35lCHZpgizqH36SLjDfBqSG3BxR2tgg5tWUY1ADa0rVkU1DdjsZTinZUYMJ9__gylzOU11HY710VKF-tFqtgvtAiRzngOF_FT0MqV3h2ALVcCys3dgEH_QLll5WYUqDPuYrlaXy1vYD4v_say7ViiHce5dldgPzPQe3FQzXS1mX6qRP-7Sorfv3z4vUuFjyoL6hBcX803t4t6Av0_bUf8L2491F7bzv6xnO8Rwf1IPmozwaz2Tk776e7Tcl8vMe71YvZjafIFv-_yqd7tLPDeWOqPu6erIoflNyfVTIaVtwXBWb3gV7ix3pqOqSqXbZkk8hEX7qp4-PbKXRG4oBckAplzROwAI1plb8cZdMaz-eX0n0t3frvbLWHFutne7ubGH53x4hR5BeWreft9wpvdvEUEOOQNW2Vgnc5whsq_6bwNV1rZ-klj_yHUDudvbIjjNKh-rCyXuLAjPEokwraUmi3avzqcM2lv1V_JR3McMeqeMExZKihWotW2Wi-LzJ-s1neGA3CIpyWMSGHOPKDgqUPngIHzwCnq2I6V2fpquvt3pSmywKrpaIna8yes8KaAH2aJb9nACNgI4dn05jnQS_uNuu3zkf6SQOTGNFOEkgqBkBI1Ar4_1Ec_BlqSEkWaSW4irb9q8loLkvAo1vVBEvUAPMAT1pyKgHYe9apjKZ8CMqrpypOtKlPU-cFY_ZhNmidY7ClDd5UdDgQXeGAeAchKof7QEqPaK3TZGkiznwE4RdNKFzy2qlnXhbFN1iipuDcUOPbxnEu9zGrgUhQgxgLotXzoDRXLAuoPmkBF9bxd8hxerzcTnFVFZUQ5Cy76waQ_oWea64RdQORtwSGX1xhOQ2QBPwsyMzXOX9rJwXO3siQygLbeJIFi1GNlqXpiM4CdFXly8V8H7_Oh3XAwcnpn8cUkDLvh-Lw3HEIADJ0JoyMvnIxD5lNv3O8NzgBHs0ShmqDWGb9wuo7T7TuT3rg3HJzbA284cYLByJ-MxhPg2Rl0AdfzxMaBbZlHZ_mFkcErIgWNiZkXz41UIRZkrOZPCx3L_EJZBoVYALHPjMgXRt7_ADJnlL4">