[llvm-testresults] Geryon-X86-64-PIC nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Sat Feb 27 04:54:38 PST 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5799/
Name: clattner2.apple.com
Nickname: Geryon-X86-64-PIC:5
Run: 5799, Start Time: 2010-02-27 01:55:02, End Time: 2010-02-27 04:54:27
Comparing To: 5784, Start Time: 2010-02-26 12:22:18, End Time: 2010-02-26 15:53:40
--- Changes Summary ---
New Test Passes: 18
New Test Failures: 4
Added Tests: 0
Removed Tests: 0
Significant Changes: 163
--- Tests Summary ---
Total Tests: 3879
Total Test Failures: 133
Total Test Failures By Type:
CBE: 51
JIT: 25
JIT codegen: 57
--- Changes Detail ---
New Test Passes:
Externals/SPEC/CFP2000/177_mesa/177_mesa [CBE]
MultiSource/Applications/JM/ldecod/ldecod [CBE]
MultiSource/Applications/oggenc/oggenc [CBE]
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame [CBE]
MultiSource/Benchmarks/Olden/health/health [JIT codegen, LLC, JIT, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/PAQ8p/paq8p [CBE]
SingleSource/UnitTests/2009-12-07-StructReturn [JIT codegen, LLC, JIT, LLC-BETA, CBE, LLC compile, LLC_BETA compile]
New Test Failures:
MultiSource/Applications/JM/lencod/lencod [CBE]
SingleSource/Regression/C/2004-03-15-IndirectGoto [JIT codegen, JIT, CBE]
Added Tests:
Removed Tests:
Significant Changes in Test Results:
Bitcode:
Externals/SPEC/CFP2000/179_art/179_art: 10.21% (28832.0000 => 31776.0000)
Externals/SPEC/CFP2000/183_equake/183_equake: 7.18% (28288.0000 => 30320.0000)
Externals/SPEC/CFP2006/433_milc/433_milc: -17.89% (254016.0000 => 208560.0000)
Externals/SPEC/CFP2006/444_namd/444_namd: 20.04% (790160.0000 => 948512.0000)
Externals/SPEC/CINT2000/254_gap/254_gap: -6.93% (1389824.0000 => 1293504.0000)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -14.12% (457056.0000 => 392528.0000)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 9.58% (57600.0000 => 63120.0000)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 5.48% (1160736.0000 => 1224352.0000)
MultiSource/Applications/SIBsim4/SIBsim4: 6.17% (91024.0000 => 96640.0000)
MultiSource/Applications/SPASS/SPASS: 10.16% (1848720.0000 => 2036560.0000)
MultiSource/Applications/aha/aha: 6.33% (7072.0000 => 7520.0000)
MultiSource/Applications/d/make_dparser: 5.76% (310464.0000 => 328352.0000)
MultiSource/Applications/lemon/lemon: 14.29% (113328.0000 => 129520.0000)
MultiSource/Applications/lua/lua: -5.19% (543424.0000 => 515216.0000)
MultiSource/Applications/spiff/spiff: 5.08% (56336.0000 => 59200.0000)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.28% (487520.0000 => 518128.0000)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: 7.22% (2880.0000 => 3088.0000)
MultiSource/Benchmarks/FreeBench/neural/neural: 10.37% (9568.0000 => 10560.0000)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.23% (420656.0000 => 455280.0000)
MultiSource/Benchmarks/McCat/04-bisect/bisect: 7.72% (4352.0000 => 4688.0000)
MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (7744.0000 => 8160.0000)
MultiSource/Benchmarks/McCat/09-vor/vor: 5.84% (21104.0000 => 22336.0000)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.07% (4480.0000 => 4976.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 158.81% (296496.0000 => 767360.0000)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.75% (165184.0000 => 176336.0000)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.06% (81840.0000 => 86800.0000)
MultiSource/Benchmarks/VersaBench/bmm/bmm: 10.00% (3040.0000 => 3344.0000)
MultiSource/Benchmarks/sim/sim: 6.31% (29424.0000 => 31280.0000)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.76% (1938592.0000 => 2050320.0000)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.89% (292576.0000 => 350768.0000)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.11% (2736.0000 => 3040.0000)
SingleSource/Benchmarks/McGill/chomp: 21.68% (5536.0000 => 6736.0000)
SingleSource/Benchmarks/Misc/ReedSolomon: 5.49% (10192.0000 => 10752.0000)
SingleSource/Benchmarks/Misc/ffbench: 8.50% (4704.0000 => 5104.0000)
SingleSource/Benchmarks/Misc/oourafft: 9.54% (14752.0000 => 16160.0000)
SingleSource/Benchmarks/Shootout-C++/wc: -16.67% (2784.0000 => 2320.0000)
SingleSource/Benchmarks/Stanford/Oscar: 8.38% (3056.0000 => 3312.0000)
SingleSource/Benchmarks/Stanford/Quicksort: 5.31% (1808.0000 => 1904.0000)
SingleSource/Regression/C++/2003-05-14-array-init: -7.14% (672.0000 => 624.0000)
SingleSource/Regression/C++/BuiltinTypeInfo: -6.00% (800.0000 => 752.0000)
SingleSource/Regression/C/2004-03-15-IndirectGoto: -8.47% (944.0000 => 864.0000)
SingleSource/UnitTests/2002-08-02-CastTest: -6.98% (688.0000 => 640.0000)
SingleSource/UnitTests/2002-10-13-BadLoad: -6.98% (688.0000 => 640.0000)
SingleSource/UnitTests/2005-05-12-Int64ToFP: -6.25% (768.0000 => 720.0000)
SingleSource/UnitTests/2005-11-29-LongSwitch: -6.98% (688.0000 => 640.0000)
SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -5.36% (896.0000 => 848.0000)
SingleSource/UnitTests/2007-01-04-KNR-Args: -6.25% (768.0000 => 720.0000)
SingleSource/UnitTests/2007-04-10-BitfieldTest: -6.98% (688.0000 => 640.0000)
SingleSource/UnitTests/2009-12-07-StructReturn: -8.20% (976.0000 => 896.0000)
SingleSource/UnitTests/AtomicOps: 5.66% (848.0000 => 896.0000)
SingleSource/UnitTests/Vector/SSE/sse_isamax: -7.32% (3280.0000 => 3040.0000)
JIT codegen:
MultiSource/Applications/JM/lencod/lencod: 11.75% (7.1093 => 7.9449)
MultiSource/Applications/d/make_dparser: 7.79% (1.0389 => 1.1198)
MultiSource/Applications/spiff/spiff: 7.94% (0.3286 => 0.3547)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.60% (2.3809 => 2.7047)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.94% (1.6866 => 1.7868)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 27.63% (1.6176 => 2.0645)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.80% (0.2309 => 0.2443)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.25% (0.6076 => 0.5757)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.36% (4.9756 => 5.3417)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.58% (1.6807 => 1.8586)
CBE:
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 9.85% (2.7400 => 3.0100)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -15.89% (5.1600 => 4.3400)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -9.93% (1.4100 => 1.2700)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 6.41% (5.1500 => 5.4800)
MultiSource/Benchmarks/sim/sim: 5.35% (5.0500 => 5.3200)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.17% (1.7400 => 1.6500)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -20.83% (8.6400 => 6.8400)
SingleSource/Benchmarks/Dhrystone/dry: -48.81% (0.8400 => 0.4300)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -12.18% (11.4900 => 10.0900)
SingleSource/Benchmarks/Shootout-C++/lists1: -5.56% (0.7200 => 0.6800)
LLC-BETA:
Externals/SPEC/CINT2000/197_parser/197_parser: -5.84% (2.9100 => 2.7400)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 5.24% (6.6800 => 7.0300)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -16.90% (2.9000 => 2.4100)
MultiSource/Applications/aha/aha: -5.68% (2.6400 => 2.4900)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -14.34% (5.0200 => 4.3000)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.21% (0.9600 => 1.0100)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.8100 => 0.9500)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 9.20% (0.8700 => 0.9500)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -7.74% (4.5200 => 4.1700)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.79% (1.6200 => 1.5100)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -14.45% (3.3900 => 2.9000)
SingleSource/Benchmarks/CoyoteBench/huffbench: -5.72% (17.1300 => 16.1500)
SingleSource/Benchmarks/Dhrystone/dry: 7.55% (0.5300 => 0.5700)
SingleSource/Benchmarks/Dhrystone/fldry: 12.82% (0.3900 => 0.4400)
SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.0400 => 1.1100)
SingleSource/Benchmarks/Shootout/ary3: -11.88% (4.2100 => 3.7100)
LLC compile:
Externals/SPEC/CFP2006/444_namd/444_namd: 7.35% (2.8647 => 3.0752)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 7.06% (0.5187 => 0.5553)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -14.00% (4.2883 => 3.6879)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 5.29% (0.3307 => 0.3482)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 11.51% (8.0158 => 8.9382)
MultiSource/Applications/JM/lencod/lencod: 9.87% (9.4694 => 10.4042)
MultiSource/Applications/SIBsim4/SIBsim4: 5.21% (0.7262 => 0.7640)
MultiSource/Applications/d/make_dparser: 5.73% (1.2834 => 1.3570)
MultiSource/Applications/spiff/spiff: 14.47% (0.4298 => 0.4920)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.25% (3.2727 => 3.7389)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.08% (2.6024 => 2.7866)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 22.16% (2.0918 => 2.5554)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 45.40% (1.3074 => 1.9010)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.40% (5.6616 => 6.1374)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.56% (1.7036 => 1.9517)
GCCAS:
Externals/SPEC/CFP2006/447_dealII/447_dealII: 5.74% (28.6473 => 30.2930)
Externals/SPEC/CINT2000/175_vpr/175_vpr: 5.02% (1.1898 => 1.2495)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -30.61% (2.4654 => 1.7108)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -11.49% (4.2156 => 3.7312)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -14.51% (47.6538 => 40.7400)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -5.81% (1.0726 => 1.0103)
Externals/SPEC/CINT2006/473_astar/473_astar: 6.09% (0.2990 => 0.3172)
MultiSource/Applications/minisat/minisat: 5.45% (0.2516 => 0.2653)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.52% (6.7558 => 6.3153)
MultiSource/Benchmarks/Ptrdist/bc/bc: -13.56% (0.4779 => 0.4131)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.98% (7.2238 => 7.7280)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.12% (1.0242 => 1.1279)
JIT:
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -6.30% (10.0000 => 9.3700)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -6.17% (3.0800 => 2.8900)
MultiSource/Applications/JM/lencod/lencod: 6.58% (14.5900 => 15.5500)
MultiSource/Applications/d/make_dparser: 7.56% (1.1900 => 1.2800)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.35% (2.4300 => 2.5600)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 22.84% (1.9700 => 2.4200)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.00% (0.2500 => 0.2700)
MultiSource/Benchmarks/Ptrdist/ft/ft: 8.18% (1.1000 => 1.1900)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 7.78% (0.9000 => 0.9700)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -7.14% (4.4800 => 4.1600)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.88% (0.6800 => 0.6400)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.90% (6.1000 => 6.4600)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.39% (2.6600 => 2.8300)
SingleSource/Benchmarks/McGill/chomp: 32.26% (0.9300 => 1.2300)
SingleSource/Benchmarks/Shootout-C++/heapsort: -5.10% (3.9200 => 3.7200)
LLC:
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 5.48% (4.5600 => 4.8100)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -18.34% (2.8900 => 2.3600)
MultiSource/Applications/aha/aha: -7.34% (2.5900 => 2.4000)
MultiSource/Applications/hexxagon/hexxagon: 5.23% (8.8000 => 9.2600)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -13.48% (4.9700 => 4.3000)
MultiSource/Benchmarks/Fhourstones/fhourstones: 8.49% (1.0600 => 1.1500)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.00% (0.4000 => 0.3800)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.53% (0.9300 => 1.0000)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.74% (0.9500 => 0.8100)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 9.20% (0.8700 => 0.9500)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -7.74% (4.5200 => 4.1700)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.33% (1.5800 => 1.4800)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -14.45% (3.3900 => 2.9000)
SingleSource/Benchmarks/CoyoteBench/huffbench: -5.72% (17.1300 => 16.1500)
SingleSource/Benchmarks/Dhrystone/dry: 7.55% (0.5300 => 0.5700)
SingleSource/Benchmarks/Dhrystone/fldry: 12.82% (0.3900 => 0.4400)
SingleSource/Benchmarks/Shootout-C++/methcall: -6.48% (5.2500 => 4.9100)
LLC-BETA compile:
Externals/SPEC/CFP2006/444_namd/444_namd: 7.45% (2.8715 => 3.0853)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 7.59% (0.5188 => 0.5582)
Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -13.85% (4.2579 => 3.6681)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 5.19% (0.3292 => 0.3463)
Externals/SPEC/CINT2006/464_h264ref/464_h264ref: 11.86% (7.9955 => 8.9441)
MultiSource/Applications/JM/lencod/lencod: 7.98% (9.6671 => 10.4383)
MultiSource/Applications/SIBsim4/SIBsim4: 5.35% (0.7231 => 0.7618)
MultiSource/Applications/d/make_dparser: 6.42% (1.2862 => 1.3688)
MultiSource/Applications/oggenc/oggenc: 5.25% (1.8899 => 1.9891)
MultiSource/Applications/spiff/spiff: 15.52% (0.4130 => 0.4771)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.99% (3.2766 => 3.7351)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.40% (2.5859 => 2.7772)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.08% (2.1042 => 2.5478)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 43.84% (1.3297 => 1.9127)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.57% (0.6340 => 0.6693)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.60% (5.5459 => 5.9676)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.20% (1.7058 => 1.9481)
More information about the llvm-testresults
mailing list