[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Wed Jul 29 03:47:55 PDT 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//918
Name:  grawp.apple.com
Nickname: Grawp:4
Buildstatus: OK

Run: 918, Start Time: 2009-07-29 00:31:16
Comparing To: 900, Start Time: 2009-07-28 00:14:55

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 36
Added Tests: 0
Removed Tests: 0
Significant Changes: 113

--- Tests Summary ---
Total Tests: 3852
Total Test Failures: 131

Total Test Failures By Type:
  CBE: 43
  JIT: 24
  JIT codegen: 24
  LLC: 10
  LLC compile: 10
  LLC-BETA: 10
  LLC_BETA compile: 10

--- Changes Detail ---
New Test Passes:

New Test Failures:
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/ctor_dtor_count [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/ctor_dtor_count-2 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/exception_spec_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/function_try_block [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/simple_rethrow [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/simple_throw [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/throw_rethrow_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
JIT codegen:
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 5.17% (5.4628 => 5.7454)
CBE:
 MultiSource/Applications/sgefa/sgefa: -8.33% (0.7200 => 0.6600)
 SingleSource/Benchmarks/Dhrystone/fldry: -6.54% (2.1400 => 2.0000)
LLC-BETA:
 MultiSource/Applications/sgefa/sgefa: 7.04% (0.7100 => 0.7600)
LLC compile:
 Externals/Nurbs/nurbs: -5.80% (0.6557 => 0.6177)
 Externals/Povray/povray: -5.96% (8.0858 => 7.6035)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -5.96% (5.4862 => 5.1590)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: -5.33% (1.4852 => 1.4060)
 Externals/SPEC/CFP2006/433_milc/433_milc: -5.62% (0.7897 => 0.7453)
 Externals/SPEC/CFP2006/444_namd/444_namd: -8.35% (2.3237 => 2.1296)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: -5.09% (5.9367 => 5.6343)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: -5.53% (3.5894 => 3.3910)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: -5.87% (0.4003 => 0.3768)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: -5.03% (1.5142 => 1.4381)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: -5.58% (2.1919 => 2.0697)
 Externals/SPEC/CINT2000/252_eon/252_eon: -7.39% (2.2989 => 2.1289)
 Externals/SPEC/CINT2000/254_gap/254_gap: -5.32% (6.9166 => 6.5489)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: -7.97% (5.1726 => 4.7602)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -6.36% (0.3426 => 0.3208)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: -5.45% (2.3039 => 2.1784)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -5.55% (17.8079 => 16.8190)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -5.61% (0.6899 => 0.6512)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: -5.12% (47.4626 => 45.0322)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -5.75% (9.7615 => 9.2004)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -5.19% (1.1817 => 1.1204)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -6.88% (0.3954 => 0.3682)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -6.20% (5.8242 => 5.4632)
 Externals/SPEC/CINT2006/473_astar/473_astar: -6.50% (0.3186 => 0.2979)
 MultiSource/Applications/JM/ldecod/ldecod: -6.03% (3.2574 => 3.0609)
 MultiSource/Applications/JM/lencod/lencod: -5.98% (7.1554 => 6.7274)
 MultiSource/Applications/SIBsim4/SIBsim4: -5.30% (0.5439 => 0.5151)
 MultiSource/Applications/SPASS/SPASS: -5.05% (6.2645 => 5.9482)
 MultiSource/Applications/lua/lua: -5.78% (2.9014 => 2.7337)
 MultiSource/Applications/minisat/minisat: -5.64% (0.2447 => 0.2309)
 MultiSource/Applications/oggenc/oggenc: -7.04% (1.4212 => 1.3211)
 MultiSource/Applications/spiff/spiff: -5.02% (0.3189 => 0.3029)
 MultiSource/Applications/sqlite3/sqlite3: -5.30% (6.4664 => 6.1238)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.67% (3.1424 => 2.9641)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.95% (0.3937 => 0.3624)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.33% (2.3618 => 2.2360)
 MultiSource/Benchmarks/MallocBench/gs/gs: -5.74% (1.8785 => 1.7707)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.50% (0.3018 => 0.2852)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.08% (0.9832 => 0.9333)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.36% (1.2980 => 1.2284)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.76% (6.5609 => 6.1832)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.16% (0.2940 => 0.2700)
 MultiSource/Benchmarks/PAQ8p/paq8p: -6.16% (1.0292 => 0.9658)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.42% (2.9741 => 2.8129)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.69% (0.3605 => 0.3400)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.02% (0.7515 => 0.7138)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -7.08% (0.2190 => 0.2035)
 MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.64% (0.3543 => 0.3343)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.52% (0.2592 => 0.2449)
 MultiSource/Benchmarks/Ptrdist/bc/bc: -5.02% (0.7098 => 0.6742)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.53% (0.3111 => 0.2939)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.39% (0.2911 => 0.2696)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.00% (0.5730 => 0.5386)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.24% (5.2866 => 4.9568)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -9.65% (1.6977 => 1.5339)
JIT:
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 6.69% (12.8500 => 13.7100)
 MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 14.81% (0.2700 => 0.3100)
 MultiSource/Benchmarks/Ptrdist/bc/bc: -6.25% (1.7600 => 1.6500)
 SingleSource/Benchmarks/Misc/richards_benchmark: 5.36% (1.1200 => 1.1800)
 SingleSource/Benchmarks/Shootout-C++/ary3: 12.32% (4.2200 => 4.7400)
 SingleSource/Benchmarks/Shootout/lists: -9.17% (6.6500 => 6.0400)
 SingleSource/Benchmarks/Shootout/methcall: 8.46% (5.9100 => 6.4100)
LLC:
 MultiSource/Applications/sgefa/sgefa: -6.85% (0.7300 => 0.6800)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.92% (1.5200 => 1.6100)
 SingleSource/Benchmarks/Shootout-C++/ary3: 9.78% (4.0900 => 4.4900)
LLC-BETA compile:
 Externals/Povray/povray: -5.86% (8.7927 => 8.2778)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -5.35% (5.9299 => 5.6128)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: -5.35% (1.5966 => 1.5112)
 Externals/SPEC/CFP2006/433_milc/433_milc: -5.39% (0.8601 => 0.8137)
 Externals/SPEC/CFP2006/444_namd/444_namd: -5.87% (2.5399 => 2.3907)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: -5.06% (3.8810 => 3.6847)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: -5.02% (0.4243 => 0.4030)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: -5.66% (2.3713 => 2.2372)
 Externals/SPEC/CINT2000/252_eon/252_eon: -6.32% (2.5635 => 2.4016)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: -6.40% (5.4678 => 5.1179)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -5.06% (0.3615 => 0.3432)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: -5.23% (2.4755 => 2.3460)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -5.12% (19.0694 => 18.0938)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -5.39% (0.7417 => 0.7017)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -5.43% (10.5009 => 9.9310)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -5.32% (1.2578 => 1.1909)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -6.97% (0.4306 => 0.4006)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -5.78% (6.2856 => 5.9225)
 Externals/SPEC/CINT2006/473_astar/473_astar: -6.05% (0.3506 => 0.3294)
 MultiSource/Applications/JM/ldecod/ldecod: -5.65% (3.5389 => 3.3391)
 MultiSource/Applications/JM/lencod/lencod: -5.48% (7.7628 => 7.3375)
 MultiSource/Applications/hbd/hbd: -5.22% (0.4786 => 0.4536)
 MultiSource/Applications/lua/lua: -5.19% (3.1248 => 2.9627)
 MultiSource/Applications/minisat/minisat: -5.22% (0.2642 => 0.2504)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.13% (3.3853 => 3.2117)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.78% (0.4456 => 0.4154)
 MultiSource/Benchmarks/MallocBench/gs/gs: -5.78% (2.0437 => 1.9256)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.24% (0.3319 => 0.3145)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.13% (1.0657 => 1.0110)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.78% (1.4249 => 1.3425)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.15% (7.1514 => 6.7828)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.24% (0.8305 => 0.7870)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.62% (0.3280 => 0.3030)
 MultiSource/Benchmarks/PAQ8p/paq8p: -5.82% (1.1831 => 1.1142)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.37% (3.1944 => 3.0229)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.22% (0.5765 => 0.5464)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.83% (0.3894 => 0.3667)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.87% (0.2403 => 0.2262)
 MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.06% (0.3859 => 0.3625)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.08% (0.3207 => 0.3012)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.22% (0.8892 => 0.8428)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.38% (0.6186 => 0.5853)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.59% (5.8837 => 5.5547)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.36% (1.7404 => 1.6471)



More information about the llvm-testresults mailing list