[llvm-dev] Help run benchmark test for arm

[Sjoerd Meijer via llvm-dev]

Hi Ben,

I didn't quite understand this:

> I do not have an arm-linux board, but an android userdebug phone. So I planned to run on PC with qemu-arm.

But it looks like you want to benchmark on qemu, but I don't think qemu will give you representative performance numbers. So yeah, for benchmarking I think a dev board would be best. A phone could work too, but then you need to be really careful in setting up the environment (frequency scaling etc.), but then I'm guessing running the llvm-suite might be tricky. Alternatively, there are a few cloud services available that you can use to generate numbers, but I don't have any experience in setting that up, so don't know how easy/convenient that is. But I think I know which phab diff your query is related to, so will leave a comment there too.

Cheers,
Sjoerd.


________________________________
From: llvm-dev <llvm-dev-bounces at lists.llvm.org> on behalf of Ben Shi via llvm-dev <llvm-dev at lists.llvm.org>
Sent: 28 July 2020 10:58
To: llvm-dev <llvm-dev at lists.llvm.org>
Subject: [llvm-dev] Help run benchmark test for arm

Hello,

I am trying to run benchmark test for llvm with llvm-test-suite, but failed. I do not have an arm-linux board, but an android userdebug phone. So I planned to run on PC with qemu-arm.

My step (on ubuntu 18.04)

1. git clone https://github.com/llvm/llvm-test-suite
2. apt-get install qemu arm-linux-gnueabihf-gcc -y
3. cd llvm-test-suite
4. mkdir build & cd build
5.  cmake -DCMAKE_C_COMPILER=/home/llvm-dev-3/build/bin/clang -DCMAKE_C_FLAGS=" -O2 --target=arm-linux-gnueabihf -I/usr/arm-linux-gnueabihf/include/ " -DCMAKE_BUILD_TYPE=Release -DTEST_SUITE_RUN_UNDER=qemu-arm -DTEST_SUITE_BENCHMARKING_ONLY=On  -DTEST_SUITE_RUN_BENCHMARKS=On -DCMAKE_INCLUDE_PATH=/usr/arm-linux-gnueabihf/include  ../

But got errors like,
CMake Error at /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:137 (message):
  Could NOT find Threads (missing: Threads_FOUND)
Call Stack (most recent call first):
  /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE)
  /usr/share/cmake-3.10/Modules/FindThreads.cmake:205 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
  MicroBenchmarks/libs/benchmark-1.3.0/CMakeLists.txt:189 (find_package)
-- Configuring incomplete, errors occurred!

The pthread.h does exist in /usr/arm-linux-gnueabihf/include/, why cmake still can not find it?

Or any other suggestion to run benchmark on arm? Do I need to by a raspberry-pi board? Or qemu and anrdoird dev phone are OK enough?

Ben
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20200728/54dfa0fb/attachment.html>