[LLVMdev] How to run regression tests for ARM?

markhor markhor at ispras.ru
Thu Sep 9 02:19:11 PDT 2010


Hello.

I experience a problem when I try to run LLVM tests on the ARM "Beagle"
board with Debian Lenny installed on it. When I execute "make check", I get
the following output:


llvm[0]: Running test suite
make[1]: Entering directory `/mnt/markhor/llvm/nativeBuild/test'
Making a new site.exp file...
( ulimit -t 600 ; ulimit -d 512000 ; ulimit -m 512000 ; ulimit -v 512000 ; \
	 
PATH="/mnt/markhor/llvm/nativeBuild/Release-Asserts/bin:/mnt/markhor/llvm/test/Scripts:/bin:/home/markhor/Development/install/nativeArm/bin:/usr/local/bin:/usr/bin:/bin:/usr/games"
\
	  /usr/bin/runtest --ignore "llvm2cpp.exp" )
WARNING: No tool specified
Test Run By markhor on Thu Sep  9 13:13:09 2010
Target is armv7l-unknown-linux-gnueabi
Host   is armv7l-unknown-linux-gnu

		===  tests ===

Schedule of variations:
    unix

Running target unix
Using /usr/share/dejagnu/baseboards/unix.exp as board description file for
target.
Using /usr/share/dejagnu/config/unix.exp as generic interface file for
target.
WARNING: Couldn't find tool config file for unix, using default.
WARNING: Assuming target board is the local machine (which is probably
wrong).
You may need to set your DEJAGNU environment variable.
Running /mnt/markhor/llvm/test/Analysis/BasicAA/dg.exp ...
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/2003-09-19-LocalArgument.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/BasicAA/2003-09-19-LocalArgument.ll -gvn
-instcombine -S | not /bin/grep sub
couldn't execute "not": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/2003-11-04-SimpleCases.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/BasicAA/2003-11-04-SimpleCases.ll -aa-eval
-print-may-aliases -disable-output  |& not /bin/grep May:
couldn't execute "not": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/2003-12-11-ConstExprGEP.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/BasicAA/2003-12-11-ConstExprGEP.ll -aa-eval
-print-may-aliases -disable-output  |& not /bin/grep May:
couldn't execute "not": no such file or directory
FAIL:
/mnt/markhor/llvm/test/Analysis/BasicAA/2007-01-13-BasePointerBadNoAlias.ll
for PR1109
Failed with posix(ENOENT,no such file or directory) at line 2
while running:  opt <
/mnt/markhor/llvm/test/Analysis/BasicAA/2007-01-13-BasePointerBadNoAlias.ll
-basicaa -gvn -instcombine -S |  not /bin/grep {ret i32 0}
couldn't execute "not": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/2009-10-13-AtomicModRef.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt -gvn -instcombine -S <
/mnt/markhor/llvm/test/Analysis/BasicAA/2009-10-13-AtomicModRef.ll |
FileCheck /mnt/markhor/llvm/test/Analysis/BasicAA/2009-10-13-AtomicModRef.ll
couldn't execute "FileCheck": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/featuretest.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt < /mnt/markhor/llvm/test/Analysis/BasicAA/featuretest.ll
-basicaa -gvn -instcombine -dce -S | not /bin/grep REMOVE
couldn't execute "not": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/gcsetest.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt < /mnt/markhor/llvm/test/Analysis/BasicAA/gcsetest.ll
-basicaa -gvn -instcombine -dce -S  | not /bin/grep load
couldn't execute "not": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/gep-alias.ll for PR1143
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt < /mnt/markhor/llvm/test/Analysis/BasicAA/gep-alias.ll
-gvn -instcombine -S |& FileCheck
/mnt/markhor/llvm/test/Analysis/BasicAA/gep-alias.ll
couldn't execute "FileCheck": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/global-size.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt < /mnt/markhor/llvm/test/Analysis/BasicAA/global-size.ll
-basicaa -gvn -instcombine -S | not /bin/grep load
couldn't execute "not": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/modref.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt < /mnt/markhor/llvm/test/Analysis/BasicAA/modref.ll
-basicaa -gvn -dse -S | FileCheck
/mnt/markhor/llvm/test/Analysis/BasicAA/modref.ll
couldn't execute "FileCheck": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/phi-and-select.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/BasicAA/phi-and-select.ll -aa-eval
-print-all-alias-modref-info -disable-output  |& /bin/grep {NoAlias:double\*
[%]a, double\* [%]b$} | count 4
couldn't execute "count": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/pure-const-dce.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/BasicAA/pure-const-dce.ll -basicaa -gvn -S |
/bin/grep TestConst | count 2
couldn't execute "count": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/BasicAA/store-promote.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/BasicAA/store-promote.ll -basicaa -licm -S |
FileCheck /mnt/markhor/llvm/test/Analysis/BasicAA/store-promote.ll
couldn't execute "FileCheck": no such file or directory
Running /mnt/markhor/llvm/test/Analysis/CallGraph/dg.exp ...
FAIL: /mnt/markhor/llvm/test/Analysis/CallGraph/2008-09-09-DirectCall.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/CallGraph/2008-09-09-DirectCall.ll
-print-callgraph -disable-output |&  /bin/grep {Calls function 'callee'} |
count 2
couldn't execute "count": no such file or directory
Running /mnt/markhor/llvm/test/Analysis/Dominators/dg.exp ...
Running /mnt/markhor/llvm/test/Analysis/GlobalsModRef/dg.exp ...
FAIL:
/mnt/markhor/llvm/test/Analysis/GlobalsModRef/2008-09-03-ReadGlobals.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/GlobalsModRef/2008-09-03-ReadGlobals.ll
-globalsmodref-aa -gvn -S | /bin/grep call | count 2
couldn't execute "count": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/GlobalsModRef/aliastest.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/GlobalsModRef/aliastest.ll -globalsmodref-aa
-gvn -S | not /bin/grep load
couldn't execute "not": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/GlobalsModRef/chaining-analysis.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/GlobalsModRef/chaining-analysis.ll
-globalsmodref-aa -gvn -S | not /bin/grep load
couldn't execute "not": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/GlobalsModRef/modreftest.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/GlobalsModRef/modreftest.ll
-globalsmodref-aa -gvn -S | not /bin/grep load
couldn't execute "not": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/GlobalsModRef/purecse.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/GlobalsModRef/purecse.ll -globalsmodref-aa
-gvn -instcombine |   llvm-dis | not /bin/grep sub
couldn't execute "not": no such file or directory
Running /mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/dg.exp ...
FAIL: /mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/alias.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/alias.ll -analyze
-lda | FileCheck
/mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/alias.ll
couldn't execute "FileCheck": no such file or directory
FAIL: /mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/siv-strong.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/siv-strong.ll
-analyze -lda | FileCheck
/mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/siv-strong.ll
couldn't execute "FileCheck": no such file or directory
FAIL:
/mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/siv-weak-crossing.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/siv-weak-crossing.ll
-analyze -lda | FileCheck
/mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/siv-weak-crossing.ll
couldn't execute "FileCheck": no such file or directory
FAIL:
/mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/siv-weak-zero.ll
Failed with posix(ENOENT,no such file or directory) at line 1
while running:  opt <
/mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/siv-weak-zero.ll
-analyze -lda | FileCheck
/mnt/markhor/llvm/test/Analysis/LoopDependenceAnalysis/siv-weak-zero.ll
couldn't execute "FileCheck": no such file or directory
^Cgot a INT signal, interrupted by user 

		===  Summary ===

# of expected passes		37
# of unexpected failures	23
make[1]: *** [check-local] Error 1
make: *** [check] Interrupt


Please explain what are such tools as "not", "count" and "FileCheck" that
for sure do not exist on my system.

runtest --version
Expect version is	5.43.0
Tcl version is		8.4
Framework version is	1.4.99


Thanks,
  Markovtsev Vadim, ISP RAS.
-- 
View this message in context: http://old.nabble.com/How-to-run-regression-tests-for-ARM--tp29647583p29647583.html
Sent from the LLVM - Dev mailing list archive at Nabble.com.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20100909/3fc59f1d/attachment.html>


More information about the llvm-dev mailing list