[llvm-testresults] Grawp-PIC nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Wed Feb 3 05:40:51 PST 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5141/
Name: grawp.apple.com
Nickname: Grawp-PIC:4
Run: 5141, Start Time: 2010-02-03 03:23:21, End Time: 2010-02-03 05:40:30
Comparing To: 5121, Start Time: 2010-02-02 04:21:23, End Time: 2010-02-02 07:00:21
--- Changes Summary ---
New Test Passes: 0
New Test Failures: 264
Added Tests: 0
Removed Tests: 0
Significant Changes: 74
--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 2039
Total Test Failures By Type:
CBE: 119
JIT: 433
JIT codegen: 433
LLC: 94
LLC compile: 94
LLC-BETA: 433
LLC_BETA compile: 433
--- Changes Detail ---
New Test Passes:
New Test Failures:
Externals/Nurbs/nurbs [CBE, LLC, LLC compile]
Externals/Povray/povray [CBE, LLC, LLC compile]
Externals/SPEC/CFP2000/177_mesa/177_mesa [CBE, LLC, LLC compile]
Externals/SPEC/CFP2006/444_namd/444_namd [LLC, LLC compile]
Externals/SPEC/CFP2006/447_dealII/447_dealII [LLC, LLC compile]
Externals/SPEC/CFP2006/450_soplex/450_soplex [LLC, LLC compile]
Externals/SPEC/CINT2000/176_gcc/176_gcc [LLC, LLC compile]
Externals/SPEC/CINT2000/252_eon/252_eon [CBE, LLC, LLC compile]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [LLC, LLC compile]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [LLC, LLC compile]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC compile]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [CBE, LLC, LLC compile]
MultiSource/Applications/ClamAV/clamscan [CBE, LLC, LLC compile]
MultiSource/Applications/JM/ldecod/ldecod [CBE, LLC, LLC compile]
MultiSource/Applications/JM/lencod/lencod [CBE, LLC, LLC compile]
MultiSource/Applications/SIBsim4/SIBsim4 [LLC, LLC compile]
MultiSource/Applications/SPASS/SPASS [CBE, LLC, LLC compile]
MultiSource/Applications/d/make_dparser [LLC, LLC compile]
MultiSource/Applications/hexxagon/hexxagon [CBE, LLC, LLC compile]
MultiSource/Applications/kimwitu++/kc [CBE, LLC, LLC compile]
MultiSource/Applications/lambda-0_1_3/lambda [CBE, LLC, LLC compile]
MultiSource/Applications/lemon/lemon [CBE, LLC, LLC compile]
MultiSource/Applications/lua/lua [LLC, LLC compile]
MultiSource/Applications/minisat/minisat [LLC, LLC compile]
MultiSource/Applications/oggenc/oggenc [CBE, LLC, LLC compile]
MultiSource/Applications/siod/siod [CBE, LLC, LLC compile]
MultiSource/Applications/sqlite3/sqlite3 [LLC, LLC compile]
MultiSource/Applications/treecc/treecc [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Bullet/bullet [LLC, LLC compile]
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 [CBE, LLC, LLC compile]
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount [CBE, LLC, LLC compile]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [CBE, LLC, LLC compile]
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame [CBE, LLC, LLC compile]
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset [LLC, LLC compile]
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell [CBE, LLC, LLC compile]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Olden/mst/mst [CBE, LLC, LLC compile]
MultiSource/Benchmarks/PAQ8p/paq8p [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/city/city [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/employ/employ [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/family/family [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/garage/garage [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/life/life [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/objects/objects [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/office/office [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/primes/primes [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/simul/simul [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/trees/trees [CBE, LLC, LLC compile]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [CBE, LLC, LLC compile]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [CBE, LLC, LLC compile]
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 [LLC, LLC compile]
SingleSource/Benchmarks/CoyoteBench/fftbench [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Misc-C++/bigfib [LLC, LLC compile]
SingleSource/Benchmarks/Misc-C++/oopack_v1p8 [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Misc-C++/ray [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Misc-C++/sphereflake [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Misc-C++/stepanov_container [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/ackermann [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/ary [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/ary2 [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/ary3 [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/fibo [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/hash [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/hash2 [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/heapsort [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/hello [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/lists [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/lists1 [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/matrix [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/methcall [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/nestedloop [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/objinst [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/random [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/reversefile [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/sieve [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/spellcheck [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/strcat [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/sumcol [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/wc [CBE, LLC, LLC compile]
SingleSource/Regression/C++/EH/exception_spec_test [LLC, LLC compile]
SingleSource/Regression/C++/global_ctor [CBE, LLC, LLC compile]
SingleSource/Regression/C++/pointer_method [CBE, LLC, LLC compile]
SingleSource/UnitTests/2003-05-14-AtExit [CBE, LLC, LLC compile]
SingleSource/UnitTests/2003-10-29-ScalarReplBug [CBE, LLC, LLC compile]
Added Tests:
Removed Tests:
Significant Changes in Test Results:
LLC:
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -10.00% (0.3000 => 0.2700)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -7.75% (1.2900 => 1.1900)
SingleSource/Benchmarks/Misc/fbench: 9.29% (2.2600 => 2.4700)
SingleSource/Benchmarks/Shootout-C++/moments: -7.14% (0.2800 => 0.2600)
GCCAS:
Externals/Nurbs/nurbs: -13.53% (0.5305 => 0.4587)
Externals/Povray/povray: -16.64% (6.6367 => 5.5324)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -19.51% (4.4250 => 3.5615)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -9.14% (33.1001 => 30.0741)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -5.96% (39.9665 => 37.5829)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -24.88% (7.5583 => 5.6775)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -6.58% (3.1279 => 2.9222)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -14.78% (5.0226 => 4.2805)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -6.38% (36.3640 => 34.0449)
MultiSource/Applications/kimwitu++/kc: -9.27% (5.5629 => 5.0474)
MultiSource/Applications/lambda-0_1_3/lambda: -8.96% (0.2534 => 0.2307)
MultiSource/Applications/lemon/lemon: -9.89% (0.5048 => 0.4549)
MultiSource/Applications/lua/lua: -36.06% (1.8663 => 1.1933)
MultiSource/Applications/oggenc/oggenc: -8.00% (2.1357 => 1.9648)
MultiSource/Applications/sqlite3/sqlite3: -8.07% (4.5192 => 4.1544)
MultiSource/Applications/treecc/treecc: -40.38% (0.9296 => 0.5542)
MultiSource/Benchmarks/Bullet/bullet: -6.86% (11.0898 => 10.3290)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -58.33% (1.7930 => 0.7472)
MultiSource/Benchmarks/PAQ8p/paq8p: -9.57% (1.0542 => 0.9533)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -59.15% (1.8343 => 0.7493)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -20.87% (9.2707 => 7.3358)
Bitcode:
Externals/Nurbs/nurbs: -15.90% (105472.0000 => 88704.0000)
Externals/Povray/povray: -24.38% (1477072.0000 => 1116928.0000)
Externals/SPEC/CFP2000/177_mesa/177_mesa: -22.00% (963568.0000 => 751536.0000)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -55.73% (1302224.0000 => 576480.0000)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -5.79% (669552.0000 => 630768.0000)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 5.27% (59776.0000 => 62928.0000)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -18.07% (2605024.0000 => 2134288.0000)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -13.99% (8644336.0000 => 7435104.0000)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -17.57% (3488320.0000 => 2875472.0000)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -19.44% (311664.0000 => 251088.0000)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -93.95% (1446976.0000 => 87552.0000)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -7.76% (8077616.0000 => 7451056.0000)
MultiSource/Applications/kimwitu++/kc: -6.06% (1599136.0000 => 1502272.0000)
MultiSource/Applications/lambda-0_1_3/lambda: -7.98% (70736.0000 => 65088.0000)
MultiSource/Applications/lua/lua: -83.11% (475600.0000 => 80320.0000)
MultiSource/Applications/oggenc/oggenc: -23.45% (799552.0000 => 612096.0000)
MultiSource/Applications/sqlite3/sqlite3: -11.38% (942784.0000 => 835536.0000)
MultiSource/Applications/treecc/treecc: -43.26% (236224.0000 => 134032.0000)
MultiSource/Applications/viterbi/viterbi: 5.56% (6048.0000 => 6384.0000)
MultiSource/Benchmarks/Bullet/bullet: -21.10% (1208320.0000 => 953360.0000)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.65% (4528.0000 => 4784.0000)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.24% (3360.0000 => 3184.0000)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -69.94% (186352.0000 => 56016.0000)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -62.80% (74016.0000 => 27536.0000)
MultiSource/Benchmarks/PAQ8p/paq8p: -9.43% (189584.0000 => 171712.0000)
MultiSource/Benchmarks/Prolangs-C++/employ/employ: -17.07% (11808.0000 => 9792.0000)
MultiSource/Benchmarks/Prolangs-C++/family/family: -7.04% (3408.0000 => 3168.0000)
MultiSource/Benchmarks/Prolangs-C++/garage/garage: -26.21% (6960.0000 => 5136.0000)
MultiSource/Benchmarks/Prolangs-C++/objects/objects: -13.24% (10032.0000 => 8704.0000)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -14.26% (8192.0000 => 7024.0000)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -14.62% (10288.0000 => 8784.0000)
MultiSource/Benchmarks/Prolangs-C++/simul/simul: -37.31% (4160.0000 => 2608.0000)
MultiSource/Benchmarks/Prolangs-C++/trees/trees: -16.55% (11120.0000 => 9280.0000)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -62.81% (74032.0000 => 27536.0000)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -61.35% (156672.0000 => 60560.0000)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -17.93% (1857248.0000 => 1524304.0000)
SingleSource/Benchmarks/Misc-C++/ray: -29.70% (9968.0000 => 7008.0000)
SingleSource/Benchmarks/Shootout-C++/heapsort: -5.13% (1872.0000 => 1776.0000)
SingleSource/Benchmarks/Shootout-C++/hello: -5.77% (1664.0000 => 1568.0000)
SingleSource/Benchmarks/Shootout-C++/methcall: -19.74% (3648.0000 => 2928.0000)
SingleSource/Benchmarks/Shootout-C++/objinst: -18.52% (3888.0000 => 3168.0000)
SingleSource/Regression/C++/EH/exception_spec_test: -23.72% (2496.0000 => 1904.0000)
SingleSource/Regression/C++/global_ctor: -27.78% (1440.0000 => 1040.0000)
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 5.88% (816.0000 => 864.0000)
SingleSource/UnitTests/2003-05-14-AtExit: -11.11% (720.0000 => 640.0000)
LLC compile:
MultiSource/Applications/spiff/spiff: -7.30% (0.4124 => 0.3823)
CBE:
MultiSource/Benchmarks/Ptrdist/ft/ft: -13.27% (1.1300 => 0.9800)
SingleSource/Benchmarks/Dhrystone/dry: 10.00% (0.4000 => 0.4400)
SingleSource/Benchmarks/Dhrystone/fldry: 15.70% (1.2100 => 1.4000)
More information about the llvm-testresults
mailing list