[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Tue Nov 10 09:33:42 PST 2009
http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/2909/
Name: grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4
Buildstatus: OK
Run: 2909, Start Time: 2009-11-10 06:32:23
Comparing To: 2859, Start Time: 2009-11-07 06:08:14
--- Changes Summary ---
New Test Passes: 8
New Test Failures: 4
Added Tests: 0
Removed Tests: 0
Significant Changes: 144
--- Tests Summary ---
Total Tests: 3861
Total Test Failures: 931
Total Test Failures By Type:
CBE: 69
JIT: 429
JIT codegen: 429
LLC: 1
LLC compile: 1
LLC-BETA: 1
LLC_BETA compile: 1
--- Changes Detail ---
New Test Passes:
Externals/SPEC/CINT2000/252_eon/252_eon [CBE]
SingleSource/Regression/C/packssdw-1 [CBE, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
New Test Failures:
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [CBE]
SingleSource/Benchmarks/Misc-C++/stepanov_container [CBE]
SingleSource/Benchmarks/Shootout-C++/moments [CBE]
SingleSource/Regression/C/2004-03-15-IndirectGoto [CBE]
Added Tests:
Removed Tests:
Significant Changes in Test Results:
Bitcode:
Externals/SPEC/CFP2006/450_soplex/450_soplex: 6.11% (841232.0000 => 892640.0000)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 9.48% (86784.0000 => 95008.0000)
Externals/SPEC/CINT2000/197_parser/197_parser: 9.68% (278976.0000 => 305968.0000)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 9.34% (142016.0000 => 155280.0000)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 5.73% (50512.0000 => 53408.0000)
MultiSource/Applications/kimwitu++/kc: 7.63% (1953504.0000 => 2102608.0000)
MultiSource/Applications/lua/lua: 7.64% (329648.0000 => 354848.0000)
MultiSource/Applications/sqlite3/sqlite3: 10.21% (1202192.0000 => 1324976.0000)
MultiSource/Benchmarks/Fhourstones/fhourstones: 7.74% (10128.0000 => 10912.0000)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (81968.0000 => 92576.0000)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.53% (3744.0000 => 4288.0000)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 7.52% (4256.0000 => 4576.0000)
MultiSource/Benchmarks/McCat/08-main/main: 5.54% (27744.0000 => 29280.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.37% (122864.0000 => 130688.0000)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.28% (4832.0000 => 4480.0000)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 9.91% (3552.0000 => 3904.0000)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.75% (80448.0000 => 85072.0000)
MultiSource/Benchmarks/NPB-serial/is/is: 33.75% (6448.0000 => 8624.0000)
MultiSource/Benchmarks/Olden/bh/bh: 6.87% (25632.0000 => 27392.0000)
MultiSource/Benchmarks/Olden/bisort/bisort: 20.07% (4544.0000 => 5456.0000)
MultiSource/Benchmarks/Olden/em3d/em3d: 5.38% (9808.0000 => 10336.0000)
MultiSource/Benchmarks/Olden/health/health: 8.42% (7408.0000 => 8032.0000)
MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.99% (5504.0000 => 6384.0000)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 11.71% (1776.0000 => 1984.0000)
MultiSource/Benchmarks/PAQ8p/paq8p: 7.70% (190768.0000 => 205456.0000)
MultiSource/Benchmarks/Prolangs-C++/life/life: 6.70% (6208.0000 => 6624.0000)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.18% (11808.0000 => 12656.0000)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.33% (84944.0000 => 92016.0000)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.95% (44688.0000 => 48688.0000)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 48.23% (26272.0000 => 38944.0000)
MultiSource/Benchmarks/Prolangs-C/football/football: 14.71% (75712.0000 => 86848.0000)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.05% (39776.0000 => 43376.0000)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.11% (8480.0000 => 9168.0000)
MultiSource/Benchmarks/Ptrdist/bc/bc: 7.54% (94208.0000 => 101312.0000)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 13.41% (2864.0000 => 3248.0000)
MultiSource/Benchmarks/mafft/pairlocalalign: 6.83% (650480.0000 => 694928.0000)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.95% (15648.0000 => 16736.0000)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.75% (80448.0000 => 85072.0000)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 32.16% (2408768.0000 => 3183456.0000)
SingleSource/Benchmarks/BenchmarkGame/n-body: 30.43% (3680.0000 => 4800.0000)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.56% (1152.0000 => 1216.0000)
SingleSource/Benchmarks/BenchmarkGame/recursive: 10.00% (2880.0000 => 3168.0000)
SingleSource/Benchmarks/CoyoteBench/lpbench: 14.32% (6256.0000 => 7152.0000)
SingleSource/Benchmarks/Misc/ReedSolomon: 11.27% (8800.0000 => 9792.0000)
SingleSource/Benchmarks/Misc/mandel: 35.44% (1264.0000 => 1712.0000)
SingleSource/Benchmarks/Misc/richards_benchmark: 21.96% (6848.0000 => 8352.0000)
SingleSource/Benchmarks/Shootout-C++/ackermann: 8.12% (9456.0000 => 10224.0000)
SingleSource/Benchmarks/Shootout-C++/ary: 5.94% (8080.0000 => 8560.0000)
SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (9104.0000 => 9584.0000)
SingleSource/Benchmarks/Shootout-C++/except: 6.05% (10576.0000 => 11216.0000)
SingleSource/Benchmarks/Shootout-C++/fibo: 10.26% (6864.0000 => 7568.0000)
SingleSource/Benchmarks/Shootout-C++/hello: 6.36% (7296.0000 => 7760.0000)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.99% (6864.0000 => 7344.0000)
SingleSource/Benchmarks/Shootout-C++/random: 7.19% (6896.0000 => 7392.0000)
SingleSource/Benchmarks/Shootout/fib2: 21.67% (960.0000 => 1168.0000)
SingleSource/Benchmarks/Shootout/hash: 7.59% (3584.0000 => 3856.0000)
SingleSource/Benchmarks/Shootout/strcat: 7.59% (1264.0000 => 1360.0000)
SingleSource/Benchmarks/Stanford/Quicksort: 14.56% (3296.0000 => 3776.0000)
SingleSource/Regression/C++/EH/exception_spec_test: 12.18% (2496.0000 => 2800.0000)
SingleSource/Regression/C++/EH/throw_rethrow_test: 10.83% (1920.0000 => 2128.0000)
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 7.84% (816.0000 => 880.0000)
SingleSource/UnitTests/SignlessTypes/cast-bug: 5.00% (640.0000 => 672.0000)
CBE:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -16.14% (3.7800 => 3.1700)
MultiSource/Benchmarks/Olden/bh/bh: -6.70% (4.0300 => 3.7600)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -6.52% (0.4600 => 0.4300)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.10% (2.1000 => 1.9300)
SingleSource/Benchmarks/BenchmarkGame/recursive: -9.09% (1.7600 => 1.6000)
SingleSource/Benchmarks/Misc/ReedSolomon: 6.81% (7.7800 => 8.3100)
SingleSource/Benchmarks/Misc/richards_benchmark: -6.36% (1.7300 => 1.6200)
SingleSource/Benchmarks/Shootout/fib2: -8.45% (0.7100 => 0.6500)
SingleSource/Benchmarks/Shootout/lists: -17.50% (8.2300 => 6.7900)
LLC-BETA:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -14.97% (3.5400 => 3.0100)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -5.05% (2.1800 => 2.0700)
MultiSource/Applications/ClamAV/clamscan: 12.00% (0.2500 => 0.2800)
MultiSource/Applications/hexxagon/hexxagon: -5.23% (14.9100 => 14.1300)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 7.14% (0.2800 => 0.3000)
MultiSource/Benchmarks/Olden/bh/bh: 21.75% (4.2300 => 5.1500)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.56% (0.3600 => 0.3400)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -8.89% (0.4500 => 0.4100)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.85% (2.0500 => 1.9300)
SingleSource/Benchmarks/BenchmarkGame/recursive: -16.23% (1.5400 => 1.2900)
SingleSource/Benchmarks/Misc/richards_benchmark: -17.14% (1.7500 => 1.4500)
SingleSource/Benchmarks/Shootout-C++/except: -13.89% (0.3600 => 0.3100)
LLC compile:
Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.70% (4.9188 => 5.1994)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 8.01% (0.5765 => 0.6227)
Externals/SPEC/CINT2000/197_parser/197_parser: 10.12% (1.8696 => 2.0588)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 9.50% (0.8188 => 0.8966)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 5.93% (0.4263 => 0.4516)
MultiSource/Applications/ClamAV/clamscan: 6.49% (7.3172 => 7.7918)
MultiSource/Applications/kimwitu++/kc: 7.65% (9.9789 => 10.7421)
MultiSource/Applications/lua/lua: 7.81% (2.2147 => 2.3877)
MultiSource/Applications/spiff/spiff: 5.37% (0.3482 => 0.3669)
MultiSource/Applications/sqlite3/sqlite3: 9.78% (7.5567 => 8.2956)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.98% (0.5933 => 0.6466)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.83% (0.8865 => 0.9825)
MultiSource/Benchmarks/PAQ8p/paq8p: 6.96% (1.2266 => 1.3120)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.27% (0.6580 => 0.7124)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.39% (0.3154 => 0.3387)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.64% (0.3845 => 0.3628)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 51.58% (0.2402 => 0.3641)
MultiSource/Benchmarks/Prolangs-C/football/football: 17.02% (0.6015 => 0.7039)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.33% (0.3143 => 0.3342)
MultiSource/Benchmarks/Ptrdist/bc/bc: 9.91% (0.6681 => 0.7343)
MultiSource/Benchmarks/mafft/pairlocalalign: 5.09% (4.4501 => 4.6764)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.55% (0.3724 => 0.3968)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 17.41% (6.8481 => 8.0403)
GCCAS:
Externals/SPEC/CINT2000/255_vortex/255_vortex: 5.71% (0.2173 => 0.2297)
MultiSource/Applications/kimwitu++/kc: 7.87% (0.4246 => 0.4580)
MultiSource/Applications/sqlite3/sqlite3: 11.10% (0.2776 => 0.3084)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 26.59% (0.3795 => 0.4804)
LLC:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -14.97% (3.5400 => 3.0100)
MultiSource/Applications/hexxagon/hexxagon: -5.76% (14.9400 => 14.0800)
MultiSource/Applications/sqlite3/sqlite3: 5.17% (5.6100 => 5.9000)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 7.14% (0.2800 => 0.3000)
MultiSource/Benchmarks/Olden/bh/bh: 29.80% (3.9600 => 5.1400)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.56% (0.3600 => 0.3400)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.24% (2.1000 => 1.9900)
SingleSource/Benchmarks/BenchmarkGame/recursive: -16.77% (1.5500 => 1.2900)
SingleSource/Benchmarks/Misc/richards_benchmark: -15.70% (1.7200 => 1.4500)
SingleSource/Benchmarks/Shootout-C++/except: -16.67% (0.3600 => 0.3000)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: -5.00% (0.6000 => 0.5700)
LLC-BETA compile:
Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.08% (4.9507 => 5.2020)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 7.39% (0.5794 => 0.6222)
Externals/SPEC/CINT2000/197_parser/197_parser: 10.82% (1.8747 => 2.0776)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 10.08% (0.8262 => 0.9095)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 6.04% (0.4287 => 0.4546)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 5.00% (9.7194 => 10.2058)
MultiSource/Applications/ClamAV/clamscan: 6.24% (7.3626 => 7.8221)
MultiSource/Applications/kimwitu++/kc: 8.19% (10.0343 => 10.8562)
MultiSource/Applications/lua/lua: 8.47% (2.2263 => 2.4148)
MultiSource/Applications/sqlite3/sqlite3: 10.87% (7.5736 => 8.3970)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.78% (0.5949 => 0.6531)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.29% (0.8882 => 0.9885)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.12% (0.3727 => 0.4067)
MultiSource/Benchmarks/PAQ8p/paq8p: 6.95% (1.2426 => 1.3290)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.37% (0.6663 => 0.7154)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.11% (0.3180 => 0.3406)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.91% (0.3879 => 0.3611)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 53.37% (0.2432 => 0.3730)
MultiSource/Benchmarks/Prolangs-C/football/football: 16.52% (0.6061 => 0.7062)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.60% (0.3177 => 0.3355)
MultiSource/Benchmarks/Ptrdist/bc/bc: 9.43% (0.6722 => 0.7356)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.79% (0.3736 => 0.4027)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 18.24% (6.9465 => 8.2137)
More information about the llvm-testresults
mailing list