[llvm-testresults] Geryon-X86-64-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Sat Sep 19 05:07:04 PDT 2009 

http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//1875
Name:  clattner2.apple.com
Nickname: Geryon-X86-64-PIC:2
Buildstatus: OK

Run: 1875, Start Time: 2009-09-19 02:01:39
Comparing To: 1859, Start Time: 2009-09-18 02:23:45

--- Changes Summary ---
New Test Passes: 112
New Test Failures: 14
Added Tests: 0
Removed Tests: 0
Significant Changes: 100

--- Tests Summary ---
Total Tests: 3834
Total Test Failures: 141

Total Test Failures By Type:
  Bitcode: 1
  CBE: 53
  GCCAS: 1
  JIT: 28
  JIT codegen: 28
  LLC: 7
  LLC compile: 7
  LLC-BETA: 8
  LLC_BETA compile: 8

--- Changes Detail ---
New Test Passes:
Externals/SPEC/CFP2000/177_mesa/177_mesa [CBE]
Externals/SPEC/CFP2000/179_art/179_art [CBE]
Externals/SPEC/CFP2000/183_equake/183_equake [CBE]
Externals/SPEC/CFP2006/470_lbm/470_lbm [CBE]
Externals/SPEC/CINT2000/175_vpr/175_vpr [CBE]
Externals/SPEC/CINT2000/186_crafty/186_crafty [CBE]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [CBE]
Externals/SPEC/CINT2000/254_gap/254_gap [CBE]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [CBE]
Externals/SPEC/CINT2000/300_twolf/300_twolf [CBE]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [CBE]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [CBE]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [CBE]
Externals/SPEC/CINT2006/462_libquantum/462_libquantum [CBE]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [CBE]
Externals/SPEC/CINT2006/473_astar/473_astar [CBE]
MultiSource/Applications/JM/lencod/lencod [CBE]
MultiSource/Applications/SIBsim4/SIBsim4 [CBE]
MultiSource/Applications/SPASS/SPASS [CBE]
MultiSource/Applications/d/make_dparser [CBE]
MultiSource/Applications/kimwitu++/kc [CBE]
MultiSource/Applications/lemon/lemon [CBE]
MultiSource/Applications/sgefa/sgefa [CBE]
MultiSource/Applications/siod/siod [CBE]
MultiSource/Applications/treecc/treecc [CBE]
MultiSource/Applications/viterbi/viterbi [CBE]
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 [CBE]
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk [CBE]
MultiSource/Benchmarks/BitBench/drop3/drop3 [CBE]
MultiSource/Benchmarks/BitBench/five11/five11 [CBE]
MultiSource/Benchmarks/BitBench/uudecode/uudecode [CBE]
MultiSource/Benchmarks/BitBench/uuencode/uuencode [CBE]
MultiSource/Benchmarks/FreeBench/analyzer/analyzer [CBE]
MultiSource/Benchmarks/FreeBench/neural/neural [CBE]
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 [CBE]
MultiSource/Benchmarks/FreeBench/pifft/pifft [CBE]
MultiSource/Benchmarks/MallocBench/cfrac/cfrac [CBE]
MultiSource/Benchmarks/MallocBench/espresso/espresso [CBE]
MultiSource/Benchmarks/McCat/01-qbsort/qbsort [CBE]
MultiSource/Benchmarks/McCat/03-testtrie/testtrie [CBE]
MultiSource/Benchmarks/McCat/04-bisect/bisect [CBE]
MultiSource/Benchmarks/McCat/05-eks/eks [CBE]
MultiSource/Benchmarks/McCat/08-main/main [CBE]
MultiSource/Benchmarks/McCat/09-vor/vor [CBE]
MultiSource/Benchmarks/McCat/12-IOtest/iotest [CBE]
MultiSource/Benchmarks/McCat/17-bintr/bintr [CBE]
MultiSource/Benchmarks/McCat/18-imp/imp [CBE]
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan [CBE]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [CBE]
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra [CBE]
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia [CBE]
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell [CBE]
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft [CBE]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [CBE]
MultiSource/Benchmarks/Olden/bisort/bisort [CBE]
MultiSource/Benchmarks/Olden/em3d/em3d [CBE]
MultiSource/Benchmarks/Olden/mst/mst [CBE]
MultiSource/Benchmarks/Olden/perimeter/perimeter [CBE]
MultiSource/Benchmarks/Olden/power/power [CBE]
MultiSource/Benchmarks/Olden/treeadd/treeadd [CBE]
MultiSource/Benchmarks/Olden/tsp/tsp [CBE]
MultiSource/Benchmarks/Olden/voronoi/voronoi [CBE]
MultiSource/Benchmarks/Prolangs-C++/city/city [CBE]
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc [CBE]
MultiSource/Benchmarks/Prolangs-C/agrep/agrep [CBE]
MultiSource/Benchmarks/Prolangs-C/assembler/assembler [CBE]
MultiSource/Benchmarks/Prolangs-C/bison/mybison [CBE]
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl [CBE]
MultiSource/Benchmarks/Prolangs-C/loader/loader [CBE]
MultiSource/Benchmarks/Prolangs-C/simulator/simulator [CBE]
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail [CBE]
MultiSource/Benchmarks/Ptrdist/anagram/anagram [CBE]
MultiSource/Benchmarks/Ptrdist/bc/bc [CBE]
MultiSource/Benchmarks/Ptrdist/ft/ft [CBE]
MultiSource/Benchmarks/Ptrdist/ks/ks [CBE]
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 [CBE]
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc [CBE]
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url [CBE]
MultiSource/Benchmarks/VersaBench/8b10b/8b10b [CBE]
MultiSource/Benchmarks/VersaBench/beamformer/beamformer [CBE]
MultiSource/Benchmarks/VersaBench/dbms/dbms [CBE]
MultiSource/Benchmarks/llubenchmark/llu [CBE]
MultiSource/Benchmarks/mafft/pairlocalalign [CBE]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [CBE]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [CBE]
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode [CBE]
MultiSource/Benchmarks/sim/sim [CBE]
SingleSource/Benchmarks/BenchmarkGame/fasta [CBE]
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits [CBE]
SingleSource/Benchmarks/BenchmarkGame/puzzle [CBE]
SingleSource/Benchmarks/CoyoteBench/huffbench [CBE]
SingleSource/Benchmarks/CoyoteBench/lpbench [CBE]
SingleSource/Benchmarks/Dhrystone/dry [CBE]
SingleSource/Benchmarks/Dhrystone/fldry [CBE]
SingleSource/Benchmarks/McGill/chomp [CBE]
SingleSource/Benchmarks/McGill/misr [CBE]
SingleSource/Benchmarks/Misc/ffbench [CBE]
SingleSource/Benchmarks/Misc/himenobmtxpa [CBE]
SingleSource/Benchmarks/Misc/oourafft [CBE]
SingleSource/Benchmarks/Misc/richards_benchmark [CBE]
SingleSource/Benchmarks/Shootout-C++/heapsort [CBE]
SingleSource/Benchmarks/Shootout-C++/matrix [CBE]
SingleSource/Benchmarks/Shootout/hash [CBE]
SingleSource/Benchmarks/Shootout/heapsort [CBE]
SingleSource/Benchmarks/Shootout/lists [CBE]
SingleSource/Benchmarks/Shootout/matrix [CBE]
SingleSource/Benchmarks/Shootout/methcall [CBE]
SingleSource/Benchmarks/Shootout/objinst [CBE]
SingleSource/Benchmarks/Stanford/Treesort [CBE]
SingleSource/Regression/C/sumarray [CBE]
SingleSource/Regression/C/sumarraymalloc [CBE]
SingleSource/UnitTests/SignlessTypes/cast [CBE]

New Test Failures:
Externals/SPEC/CINT2000/252_eon/252_eon [JIT, JIT codegen]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Regression/C++/EH/exception_spec_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -8.98% (1831744.0000 => 1667216.0000)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 41.16% (849648.0000 => 1199360.0000)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -8.98% (3145392.0000 => 2862912.0000)
 MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -13.18% (3520.0000 => 3056.0000)
 MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -15.95% (5216.0000 => 4384.0000)
 MultiSource/Benchmarks/Olden/em3d/em3d: 6.05% (6352.0000 => 6736.0000)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -77.59% (134752.0000 => 30192.0000)
 MultiSource/Benchmarks/Olden/power/power: -7.81% (11888.0000 => 10960.0000)
 SingleSource/Benchmarks/BenchmarkGame/recursive: -6.39% (5008.0000 => 4688.0000)
 SingleSource/Benchmarks/Shootout-C++/reversefile: 7.65% (8992.0000 => 9680.0000)
 SingleSource/Benchmarks/Shootout-C++/wc: -5.29% (3024.0000 => 2864.0000)
 SingleSource/Benchmarks/Shootout/ackermann: -6.52% (1472.0000 => 1376.0000)
 SingleSource/Benchmarks/Shootout/fib2: 5.45% (1760.0000 => 1856.0000)
 SingleSource/Benchmarks/Stanford/Treesort: -6.91% (6256.0000 => 5824.0000)
JIT codegen:
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -22.84% (5.5992 => 4.3203)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 112.55% (4.4530 => 9.4648)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -20.78% (8.4133 => 6.6651)
CBE:
 MultiSource/Benchmarks/PAQ8p/paq8p: 8.81% (97.1900 => 105.7500)
LLC-BETA:
 Externals/SPEC/CFP2000/183_equake/183_equake: -5.01% (8.9800 => 8.5300)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 6.52% (2.3000 => 2.4500)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.29% (16.6400 => 17.5200)
 MultiSource/Benchmarks/BitBench/drop3/drop3: -9.30% (0.4300 => 0.3900)
 MultiSource/Benchmarks/Olden/health/health: -7.41% (0.5400 => 0.5000)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.59% (0.3400 => 0.2700)
 MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.13% (0.3900 => 0.4100)
 MultiSource/Benchmarks/Ptrdist/ft/ft: -5.77% (1.0400 => 0.9800)
 MultiSource/Benchmarks/sim/sim: -6.22% (4.9800 => 4.6700)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 10.00% (0.8000 => 0.8800)
 SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -5.69% (1.2300 => 1.1600)
 SingleSource/Benchmarks/Dhrystone/fldry: -49.68% (1.5700 => 0.7900)
LLC compile:
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -14.15% (8.9291 => 7.6652)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 117.07% (4.5122 => 9.7947)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -11.96% (15.3149 => 13.4833)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -85.07% (1.3472 => 0.2012)
GCCAS:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 6.31% (1.0138 => 1.0778)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 11.54% (54.4492 => 60.7352)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 9.20% (3.6769 => 4.0151)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 7.00% (0.9454 => 1.0116)
 Externals/SPEC/CINT2000/197_parser/197_parser: 7.64% (1.6258 => 1.7500)
 Externals/SPEC/CINT2000/252_eon/252_eon: 10.25% (3.9044 => 4.3047)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -7.17% (5.8771 => 5.4557)
 Externals/SPEC/CINT2000/254_gap/254_gap: 8.13% (4.5632 => 4.9344)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 6.12% (0.7122 => 0.7558)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -6.53% (7.2198 => 6.7485)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 7.31% (5.7346 => 6.1536)
 Externals/SPEC/CINT2006/473_astar/473_astar: 6.69% (0.3349 => 0.3573)
 MultiSource/Applications/JM/ldecod/ldecod: 5.62% (2.7851 => 2.9417)
 MultiSource/Applications/SPASS/SPASS: 15.60% (6.7353 => 7.7857)
 MultiSource/Applications/d/make_dparser: 5.17% (1.1919 => 1.2535)
 MultiSource/Applications/hbd/hbd: 14.39% (0.2543 => 0.2909)
 MultiSource/Applications/kimwitu++/kc: 13.48% (5.1636 => 5.8598)
 MultiSource/Applications/lambda-0_1_3/lambda: 13.54% (0.2475 => 0.2810)
 MultiSource/Applications/lemon/lemon: 5.27% (0.4347 => 0.4576)
 MultiSource/Applications/lua/lua: 8.08% (1.8859 => 2.0383)
 MultiSource/Applications/minisat/minisat: 10.34% (0.2408 => 0.2657)
 MultiSource/Applications/oggenc/oggenc: 5.47% (2.3775 => 2.5075)
 MultiSource/Applications/sqlite3/sqlite3: 7.84% (5.8915 => 6.3533)
 MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.44% (0.2133 => 0.2017)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.43% (0.3871 => 0.4352)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.84% (0.2244 => 0.2375)
 MultiSource/Benchmarks/MallocBench/gs/gs: 6.08% (1.3032 => 1.3824)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.01% (0.2612 => 0.2769)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.40% (5.9421 => 6.3226)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.35% (0.3260 => 0.3467)
 MultiSource/Benchmarks/PAQ8p/paq8p: 20.21% (1.4545 => 1.7485)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.57% (1.8169 => 1.9545)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 7.63% (0.4549 => 0.4896)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.03% (0.4045 => 0.4370)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.57% (0.3284 => 0.3467)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.43% (0.3669 => 0.3905)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.30% (28.3344 => 30.4015)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.29% (1.5151 => 1.6710)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.14% (0.6146 => 0.6462)
 SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.01% (0.2553 => 0.2681)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.47% (0.2663 => 0.2995)
JIT:
 Externals/SPEC/CFP2000/183_equake/183_equake: 5.39% (8.7200 => 9.1900)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -12.43% (12.9500 => 11.3400)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 74.04% (7.0100 => 12.2000)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -14.42% (16.7100 => 14.3000)
 MultiSource/Benchmarks/McCat/09-vor/vor: 7.69% (0.2600 => 0.2800)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -71.68% (1.7300 => 0.4900)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.45% (0.3100 => 0.3300)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.41% (0.2700 => 0.2900)
 MultiSource/Benchmarks/Ptrdist/ks/ks: -11.48% (2.0900 => 1.8500)
 MultiSource/Benchmarks/sim/sim: -6.40% (5.1600 => 4.8300)
 SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -5.60% (1.2500 => 1.1800)
 SingleSource/Benchmarks/Dhrystone/fldry: -21.43% (1.1200 => 0.8800)
LLC:
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 6.58% (2.2800 => 2.4300)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 5.19% (6.5500 => 6.8900)
 MultiSource/Benchmarks/BitBench/drop3/drop3: -9.30% (0.4300 => 0.3900)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.86% (0.3500 => 0.2700)
 MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.13% (0.3900 => 0.4100)
 MultiSource/Benchmarks/sim/sim: -6.43% (4.9800 => 4.6600)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 6.25% (0.8000 => 0.8500)
 SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -5.69% (1.2300 => 1.1600)
 SingleSource/Benchmarks/Dhrystone/fldry: -23.30% (1.0300 => 0.7900)
LLC-BETA compile:
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -14.35% (9.0069 => 7.7146)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 116.60% (4.5536 => 9.8629)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -13.39% (15.7352 => 13.6279)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -85.12% (1.3547 => 0.2016)

More information about the llvm-testresults mailing list