[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Thu Nov 19 09:12:58 PST 2009
http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/3150/
Name: grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4
Buildstatus: OK
Run: 3150, Start Time: 2009-11-19 06:18:53
Comparing To: 3125, Start Time: 2009-11-18 05:46:26
--- Changes Summary ---
New Test Passes: 1
New Test Failures: 4
Added Tests: 0
Removed Tests: 0
Significant Changes: 182
--- Tests Summary ---
Total Tests: 3852
Total Test Failures: 929
Total Test Failures By Type:
CBE: 69
JIT: 428
JIT codegen: 428
LLC: 1
LLC compile: 1
LLC-BETA: 1
LLC_BETA compile: 1
--- Changes Detail ---
New Test Passes:
Externals/SPEC/CFP2000/188_ammp/188_ammp [CBE]
New Test Failures:
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [CBE]
SingleSource/Benchmarks/Misc-C++/stepanov_container [CBE]
SingleSource/Benchmarks/Shootout-C++/moments [CBE]
SingleSource/Regression/C/2004-03-15-IndirectGoto [CBE]
Added Tests:
Removed Tests:
Significant Changes in Test Results:
Bitcode:
Externals/SPEC/CFP2000/183_equake/183_equake: -10.63% (40352.0000 => 36064.0000)
Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.65% (843616.0000 => 891312.0000)
Externals/SPEC/CFP2006/470_lbm/470_lbm: -7.04% (23408.0000 => 21760.0000)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 6.95% (88656.0000 => 94816.0000)
Externals/SPEC/CINT2000/197_parser/197_parser: 9.33% (278784.0000 => 304800.0000)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 9.57% (142640.0000 => 156288.0000)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 6.14% (50560.0000 => 53664.0000)
MultiSource/Applications/kimwitu++/kc: 7.61% (1953264.0000 => 2101952.0000)
MultiSource/Applications/lua/lua: 8.11% (327952.0000 => 354560.0000)
MultiSource/Applications/siod/siod: 5.10% (260112.0000 => 273376.0000)
MultiSource/Applications/sqlite3/sqlite3: 10.66% (1198304.0000 => 1326016.0000)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -12.42% (7984.0000 => 6992.0000)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.35% (9008.0000 => 8256.0000)
MultiSource/Benchmarks/Fhourstones/fhourstones: 6.07% (10272.0000 => 10896.0000)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.82% (81968.0000 => 92480.0000)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 10.42% (3840.0000 => 4240.0000)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 5.54% (4336.0000 => 4576.0000)
MultiSource/Benchmarks/McCat/08-main/main: 14.65% (25232.0000 => 28928.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.45% (123936.0000 => 130688.0000)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.65% (5440.0000 => 4480.0000)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 9.91% (3552.0000 => 3904.0000)
MultiSource/Benchmarks/NPB-serial/is/is: 33.50% (6448.0000 => 8608.0000)
MultiSource/Benchmarks/Olden/bh/bh: 7.50% (25184.0000 => 27072.0000)
MultiSource/Benchmarks/Olden/bisort/bisort: 19.50% (4512.0000 => 5392.0000)
MultiSource/Benchmarks/Olden/health/health: 9.13% (7360.0000 => 8032.0000)
MultiSource/Benchmarks/Olden/perimeter/perimeter: 27.57% (5456.0000 => 6960.0000)
MultiSource/Benchmarks/Olden/power/power: -13.27% (10608.0000 => 9200.0000)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 8.04% (1792.0000 => 1936.0000)
MultiSource/Benchmarks/Prolangs-C++/life/life: 8.27% (6192.0000 => 6704.0000)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 5.61% (11968.0000 => 12640.0000)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.84% (86096.0000 => 91984.0000)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (45584.0000 => 48688.0000)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.50% (54672.0000 => 51120.0000)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 57.91% (26304.0000 => 41536.0000)
MultiSource/Benchmarks/Prolangs-C/football/football: 12.70% (77200.0000 => 87008.0000)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.70% (27536.0000 => 30208.0000)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.81% (40640.0000 => 43408.0000)
MultiSource/Benchmarks/Ptrdist/ks/ks: 6.88% (12560.0000 => 13424.0000)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 14.04% (2848.0000 => 3248.0000)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -14.80% (8000.0000 => 6816.0000)
MultiSource/Benchmarks/llubenchmark/llu: -9.70% (4288.0000 => 3872.0000)
MultiSource/Benchmarks/mafft/pairlocalalign: 5.62% (657072.0000 => 694016.0000)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.57% (15648.0000 => 16832.0000)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 29.83% (2429376.0000 => 3154160.0000)
SingleSource/Benchmarks/BenchmarkGame/fasta: -7.85% (3056.0000 => 2816.0000)
SingleSource/Benchmarks/BenchmarkGame/n-body: 29.57% (3680.0000 => 4768.0000)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 9.13% (3504.0000 => 3824.0000)
SingleSource/Benchmarks/CoyoteBench/lpbench: 14.25% (6288.0000 => 7184.0000)
SingleSource/Benchmarks/Misc-C++/mandel-text: -5.80% (1104.0000 => 1040.0000)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.65% (11552.0000 => 12320.0000)
SingleSource/Benchmarks/Misc/mandel: 35.44% (1264.0000 => 1712.0000)
SingleSource/Benchmarks/Misc/richards_benchmark: 18.64% (7040.0000 => 8352.0000)
SingleSource/Benchmarks/Misc/salsa20: -16.26% (3248.0000 => 2720.0000)
SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (7216.0000 => 7584.0000)
SingleSource/Benchmarks/Shootout/ackermann: 21.31% (976.0000 => 1184.0000)
SingleSource/Benchmarks/Shootout/fib2: 21.67% (960.0000 => 1168.0000)
SingleSource/Benchmarks/Shootout/lists: 5.54% (6064.0000 => 6400.0000)
SingleSource/Benchmarks/Shootout/matrix: -16.06% (5680.0000 => 4768.0000)
SingleSource/Benchmarks/Shootout/nestedloop: -6.06% (1056.0000 => 992.0000)
SingleSource/Benchmarks/Shootout/strcat: 7.59% (1264.0000 => 1360.0000)
SingleSource/Benchmarks/Stanford/Perm: 5.77% (2496.0000 => 2640.0000)
SingleSource/Benchmarks/Stanford/Queens: 15.43% (3008.0000 => 3472.0000)
SingleSource/Benchmarks/Stanford/Quicksort: 14.56% (3296.0000 => 3776.0000)
SingleSource/Benchmarks/Stanford/Towers: -6.20% (4384.0000 => 4112.0000)
SingleSource/Regression/C++/2003-05-14-expr_stmt: 9.38% (512.0000 => 560.0000)
SingleSource/Regression/C++/EH/exception_spec_test: 12.18% (2496.0000 => 2800.0000)
SingleSource/Regression/C++/EH/throw_rethrow_test: 10.83% (1920.0000 => 2128.0000)
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 5.88% (816.0000 => 864.0000)
SingleSource/Regression/C/PR640: 11.39% (1264.0000 => 1408.0000)
SingleSource/Regression/C/badidx: 7.69% (832.0000 => 896.0000)
SingleSource/Regression/C/bigstack: -6.12% (4704.0000 => 4416.0000)
SingleSource/Regression/C/sumarraymalloc: -5.33% (1200.0000 => 1136.0000)
SingleSource/UnitTests/2003-07-09-LoadShorts: 10.00% (1600.0000 => 1760.0000)
SingleSource/UnitTests/SignlessTypes/cast-bug: 5.00% (640.0000 => 672.0000)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: -19.07% (7552.0000 => 6112.0000)
SingleSource/UnitTests/Vector/SSE/sse_stepfft: -50.39% (16544.0000 => 8208.0000)
SingleSource/UnitTests/Vector/multiplies: 5.77% (1664.0000 => 1760.0000)
CBE:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -16.62% (3.7900 => 3.1600)
MultiSource/Benchmarks/Olden/bh/bh: -7.18% (4.0400 => 3.7500)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.18% (8.4900 => 8.9300)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.10% (2.1000 => 1.9300)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -38.20% (0.8900 => 0.5500)
SingleSource/Benchmarks/BenchmarkGame/recursive: -9.60% (1.7700 => 1.6000)
SingleSource/Benchmarks/Misc/richards_benchmark: -6.36% (1.7300 => 1.6200)
SingleSource/Benchmarks/Shootout-C++/random: -59.40% (6.0100 => 2.4400)
SingleSource/Benchmarks/Shootout/fib2: -8.45% (0.7100 => 0.6500)
SingleSource/Benchmarks/Shootout/lists: -16.12% (8.1900 => 6.8700)
SingleSource/Benchmarks/Shootout/matrix: -10.92% (5.2200 => 4.6500)
SingleSource/Benchmarks/Shootout/methcall: 19.78% (4.6000 => 5.5100)
LLC-BETA:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -13.41% (3.5800 => 3.1000)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -6.36% (13.5300 => 12.6700)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 8.33% (0.2400 => 0.2600)
MultiSource/Applications/siod/siod: 7.53% (4.2500 => 4.5700)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 7.14% (0.2800 => 0.3000)
MultiSource/Benchmarks/Olden/bh/bh: 21.75% (4.2300 => 5.1500)
MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.16% (0.3800 => 0.4300)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -8.89% (0.4500 => 0.4100)
MultiSource/Benchmarks/Ptrdist/ks/ks: 6.86% (1.7500 => 1.8700)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -10.23% (9.6800 => 8.6900)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.34% (2.0500 => 1.9200)
SingleSource/Benchmarks/BenchmarkGame/fasta: 7.27% (1.1000 => 1.1800)
SingleSource/Benchmarks/BenchmarkGame/recursive: -17.31% (1.5600 => 1.2900)
SingleSource/Benchmarks/McGill/chomp: 12.20% (1.2300 => 1.3800)
SingleSource/Benchmarks/Misc/fbench: -11.88% (2.6100 => 2.3000)
SingleSource/Benchmarks/Misc/salsa20: 12.66% (9.3200 => 10.5000)
SingleSource/Benchmarks/Shootout-C++/except: -14.29% (0.3500 => 0.3000)
SingleSource/Benchmarks/Shootout/lists: -11.41% (7.1000 => 6.2900)
SingleSource/Benchmarks/Shootout/matrix: 34.26% (3.9400 => 5.2900)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.16% (0.4900 => 0.5300)
LLC compile:
Externals/SPEC/CFP2006/444_namd/444_namd: 5.16% (3.2762 => 3.4453)
Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.79% (4.9196 => 5.2046)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 7.93% (0.5786 => 0.6245)
Externals/SPEC/CINT2000/176_gcc/176_gcc: 5.26% (19.7327 => 20.7709)
Externals/SPEC/CINT2000/197_parser/197_parser: 10.72% (1.8642 => 2.0640)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 6.39% (8.0067 => 8.5181)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 14.31% (0.8175 => 0.9345)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 8.39% (0.4241 => 0.4597)
MultiSource/Applications/ClamAV/clamscan: 6.19% (7.3599 => 7.8155)
MultiSource/Applications/kimwitu++/kc: 8.91% (9.9724 => 10.8613)
MultiSource/Applications/lua/lua: 8.12% (2.2070 => 2.3862)
MultiSource/Applications/sqlite3/sqlite3: 11.31% (7.4804 => 8.3262)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.43% (0.5886 => 0.6559)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.98% (0.8919 => 0.9898)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.28% (0.3729 => 0.3963)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.31% (0.6598 => 0.7146)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.12% (0.3174 => 0.3400)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -7.08% (0.3857 => 0.3584)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 53.10% (0.2437 => 0.3731)
MultiSource/Benchmarks/Prolangs-C/football/football: 16.03% (0.6050 => 0.7020)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 11.68% (0.2269 => 0.2534)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.57% (0.3159 => 0.3335)
MultiSource/Benchmarks/Ptrdist/bc/bc: 9.31% (0.6724 => 0.7350)
MultiSource/Benchmarks/mafft/pairlocalalign: 5.69% (4.4903 => 4.7460)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.20% (0.3766 => 0.3962)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.43% (6.8884 => 7.8825)
GCCAS:
Externals/SPEC/CINT2000/255_vortex/255_vortex: 5.13% (0.2183 => 0.2295)
MultiSource/Applications/kimwitu++/kc: 6.85% (0.4279 => 0.4572)
MultiSource/Applications/sqlite3/sqlite3: 10.53% (0.2782 => 0.3075)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 25.42% (0.3820 => 0.4791)
LLC:
Externals/SPEC/CFP2000/177_mesa/177_mesa: -17.50% (3.6000 => 2.9700)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 7.14% (0.2800 => 0.3000)
MultiSource/Benchmarks/Olden/bh/bh: 29.47% (3.9700 => 5.1400)
MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.53% (0.3800 => 0.4200)
MultiSource/Benchmarks/Olden/power/power: -5.44% (2.9400 => 2.7800)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -6.67% (0.4500 => 0.4200)
MultiSource/Benchmarks/Ptrdist/ks/ks: 6.86% (1.7500 => 1.8700)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -10.34% (9.6700 => 8.6700)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.71% (2.1000 => 1.9800)
SingleSource/Benchmarks/BenchmarkGame/fasta: 9.09% (1.1000 => 1.2000)
SingleSource/Benchmarks/BenchmarkGame/recursive: -16.67% (1.5600 => 1.3000)
SingleSource/Benchmarks/McGill/chomp: 13.93% (1.2200 => 1.3900)
SingleSource/Benchmarks/Misc/salsa20: 13.97% (9.1600 => 10.4400)
SingleSource/Benchmarks/Shootout-C++/except: -14.29% (0.3500 => 0.3000)
SingleSource/Benchmarks/Shootout/matrix: 32.49% (3.9400 => 5.2200)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: 16.33% (0.4900 => 0.5700)
LLC-BETA compile:
Externals/SPEC/CFP2006/444_namd/444_namd: 5.30% (3.2879 => 3.4622)
Externals/SPEC/CFP2006/450_soplex/450_soplex: 5.35% (4.9390 => 5.2033)
Externals/SPEC/CINT2000/164_gzip/164_gzip: 7.30% (0.5822 => 0.6247)
Externals/SPEC/CINT2000/197_parser/197_parser: 10.71% (1.8727 => 2.0733)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 6.31% (8.0688 => 8.5781)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 14.32% (0.8269 => 0.9453)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 6.92% (0.4304 => 0.4602)
MultiSource/Applications/ClamAV/clamscan: 7.02% (7.3473 => 7.8629)
MultiSource/Applications/kimwitu++/kc: 9.32% (10.0319 => 10.9664)
MultiSource/Applications/lemon/lemon: 5.23% (0.7634 => 0.8033)
MultiSource/Applications/lua/lua: 8.50% (2.2109 => 2.3989)
MultiSource/Applications/spiff/spiff: 5.31% (0.3524 => 0.3711)
MultiSource/Applications/sqlite3/sqlite3: 11.54% (7.5349 => 8.4043)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.72% (0.6007 => 0.6591)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.36% (0.8981 => 0.9911)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.86% (0.3733 => 0.3989)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.53% (0.6664 => 0.7166)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.3213 => 0.3432)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -7.52% (0.3885 => 0.3593)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 57.44% (0.2427 => 0.3821)
MultiSource/Benchmarks/Prolangs-C/football/football: 15.18% (0.6088 => 0.7012)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 11.57% (0.2290 => 0.2555)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.36% (0.3158 => 0.3359)
MultiSource/Benchmarks/Ptrdist/bc/bc: 9.24% (0.6795 => 0.7423)
MultiSource/Benchmarks/mafft/pairlocalalign: 6.60% (4.5085 => 4.8062)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.26% (0.3740 => 0.3974)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.24% (6.9856 => 7.9801)
More information about the llvm-testresults
mailing list