[llvm-testresults] Geryon-X86-64 nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Sat Sep 19 02:00:54 PDT 2009 

http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//1868
Name:  clattner2.apple.com
Nickname: Geryon-X86-64:2
Buildstatus: OK

Run: 1868, Start Time: 2009-09-18 23:00:50
Comparing To: 1853, Start Time: 2009-09-17 23:00:50

--- Changes Summary ---
New Test Passes: 112
New Test Failures: 13
Added Tests: 0
Removed Tests: 0
Significant Changes: 91

--- Tests Summary ---
Total Tests: 3834
Total Test Failures: 140

Total Test Failures By Type:
  Bitcode: 1
  CBE: 53
  GCCAS: 1
  JIT: 27
  JIT codegen: 28
  LLC: 7
  LLC compile: 7
  LLC-BETA: 8
  LLC_BETA compile: 8

--- Changes Detail ---
New Test Passes:
Externals/SPEC/CFP2000/177_mesa/177_mesa [CBE]
Externals/SPEC/CFP2000/179_art/179_art [CBE]
Externals/SPEC/CFP2000/183_equake/183_equake [CBE]
Externals/SPEC/CFP2006/470_lbm/470_lbm [CBE]
Externals/SPEC/CINT2000/175_vpr/175_vpr [CBE]
Externals/SPEC/CINT2000/186_crafty/186_crafty [CBE]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [CBE]
Externals/SPEC/CINT2000/254_gap/254_gap [CBE]
Externals/SPEC/CINT2000/256_bzip2/256_bzip2 [CBE]
Externals/SPEC/CINT2000/300_twolf/300_twolf [CBE]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [CBE]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [CBE]
Externals/SPEC/CINT2006/458_sjeng/458_sjeng [CBE]
Externals/SPEC/CINT2006/462_libquantum/462_libquantum [CBE]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [CBE]
Externals/SPEC/CINT2006/473_astar/473_astar [CBE]
MultiSource/Applications/JM/lencod/lencod [CBE]
MultiSource/Applications/SIBsim4/SIBsim4 [CBE]
MultiSource/Applications/SPASS/SPASS [CBE]
MultiSource/Applications/d/make_dparser [CBE]
MultiSource/Applications/kimwitu++/kc [CBE]
MultiSource/Applications/lemon/lemon [CBE]
MultiSource/Applications/sgefa/sgefa [CBE]
MultiSource/Applications/siod/siod [CBE]
MultiSource/Applications/treecc/treecc [CBE]
MultiSource/Applications/viterbi/viterbi [CBE]
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 [CBE]
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk [CBE]
MultiSource/Benchmarks/BitBench/drop3/drop3 [CBE]
MultiSource/Benchmarks/BitBench/five11/five11 [CBE]
MultiSource/Benchmarks/BitBench/uudecode/uudecode [CBE]
MultiSource/Benchmarks/BitBench/uuencode/uuencode [CBE]
MultiSource/Benchmarks/FreeBench/analyzer/analyzer [CBE]
MultiSource/Benchmarks/FreeBench/neural/neural [CBE]
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 [CBE]
MultiSource/Benchmarks/FreeBench/pifft/pifft [CBE]
MultiSource/Benchmarks/MallocBench/cfrac/cfrac [CBE]
MultiSource/Benchmarks/MallocBench/espresso/espresso [CBE]
MultiSource/Benchmarks/McCat/01-qbsort/qbsort [CBE]
MultiSource/Benchmarks/McCat/03-testtrie/testtrie [CBE]
MultiSource/Benchmarks/McCat/04-bisect/bisect [CBE]
MultiSource/Benchmarks/McCat/05-eks/eks [CBE]
MultiSource/Benchmarks/McCat/08-main/main [CBE]
MultiSource/Benchmarks/McCat/09-vor/vor [CBE]
MultiSource/Benchmarks/McCat/12-IOtest/iotest [CBE]
MultiSource/Benchmarks/McCat/17-bintr/bintr [CBE]
MultiSource/Benchmarks/McCat/18-imp/imp [CBE]
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan [CBE]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [CBE]
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra [CBE]
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia [CBE]
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell [CBE]
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft [CBE]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [CBE]
MultiSource/Benchmarks/Olden/bisort/bisort [CBE]
MultiSource/Benchmarks/Olden/em3d/em3d [CBE]
MultiSource/Benchmarks/Olden/mst/mst [CBE]
MultiSource/Benchmarks/Olden/perimeter/perimeter [CBE]
MultiSource/Benchmarks/Olden/power/power [CBE]
MultiSource/Benchmarks/Olden/treeadd/treeadd [CBE]
MultiSource/Benchmarks/Olden/tsp/tsp [CBE]
MultiSource/Benchmarks/Olden/voronoi/voronoi [CBE]
MultiSource/Benchmarks/Prolangs-C++/city/city [CBE]
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc [CBE]
MultiSource/Benchmarks/Prolangs-C/agrep/agrep [CBE]
MultiSource/Benchmarks/Prolangs-C/assembler/assembler [CBE]
MultiSource/Benchmarks/Prolangs-C/bison/mybison [CBE]
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl [CBE]
MultiSource/Benchmarks/Prolangs-C/loader/loader [CBE]
MultiSource/Benchmarks/Prolangs-C/simulator/simulator [CBE]
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail [CBE]
MultiSource/Benchmarks/Ptrdist/anagram/anagram [CBE]
MultiSource/Benchmarks/Ptrdist/bc/bc [CBE]
MultiSource/Benchmarks/Ptrdist/ft/ft [CBE]
MultiSource/Benchmarks/Ptrdist/ks/ks [CBE]
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 [CBE]
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc [CBE]
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url [CBE]
MultiSource/Benchmarks/VersaBench/8b10b/8b10b [CBE]
MultiSource/Benchmarks/VersaBench/beamformer/beamformer [CBE]
MultiSource/Benchmarks/VersaBench/dbms/dbms [CBE]
MultiSource/Benchmarks/llubenchmark/llu [CBE]
MultiSource/Benchmarks/mafft/pairlocalalign [CBE]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [CBE]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [CBE]
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode [CBE]
MultiSource/Benchmarks/sim/sim [CBE]
SingleSource/Benchmarks/BenchmarkGame/fasta [CBE]
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits [CBE]
SingleSource/Benchmarks/BenchmarkGame/puzzle [CBE]
SingleSource/Benchmarks/CoyoteBench/huffbench [CBE]
SingleSource/Benchmarks/CoyoteBench/lpbench [CBE]
SingleSource/Benchmarks/Dhrystone/dry [CBE]
SingleSource/Benchmarks/Dhrystone/fldry [CBE]
SingleSource/Benchmarks/McGill/chomp [CBE]
SingleSource/Benchmarks/McGill/misr [CBE]
SingleSource/Benchmarks/Misc/ffbench [CBE]
SingleSource/Benchmarks/Misc/himenobmtxpa [CBE]
SingleSource/Benchmarks/Misc/oourafft [CBE]
SingleSource/Benchmarks/Misc/richards_benchmark [CBE]
SingleSource/Benchmarks/Shootout-C++/heapsort [CBE]
SingleSource/Benchmarks/Shootout-C++/matrix [CBE]
SingleSource/Benchmarks/Shootout/hash [CBE]
SingleSource/Benchmarks/Shootout/heapsort [CBE]
SingleSource/Benchmarks/Shootout/lists [CBE]
SingleSource/Benchmarks/Shootout/matrix [CBE]
SingleSource/Benchmarks/Shootout/methcall [CBE]
SingleSource/Benchmarks/Shootout/objinst [CBE]
SingleSource/Benchmarks/Stanford/Treesort [CBE]
SingleSource/Regression/C/sumarray [CBE]
SingleSource/Regression/C/sumarraymalloc [CBE]
SingleSource/UnitTests/SignlessTypes/cast [CBE]

New Test Failures:
Externals/SPEC/CINT2000/252_eon/252_eon [JIT codegen]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Regression/C++/EH/exception_spec_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -8.98% (1831744.0000 => 1667216.0000)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 41.16% (849648.0000 => 1199360.0000)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -8.98% (3145392.0000 => 2862912.0000)
 MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -13.18% (3520.0000 => 3056.0000)
 MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -15.95% (5216.0000 => 4384.0000)
 MultiSource/Benchmarks/Olden/em3d/em3d: 6.05% (6352.0000 => 6736.0000)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -77.59% (134752.0000 => 30192.0000)
 MultiSource/Benchmarks/Olden/power/power: -7.81% (11888.0000 => 10960.0000)
 SingleSource/Benchmarks/BenchmarkGame/recursive: -6.39% (5008.0000 => 4688.0000)
 SingleSource/Benchmarks/Shootout-C++/reversefile: 7.65% (8992.0000 => 9680.0000)
 SingleSource/Benchmarks/Shootout-C++/wc: -5.29% (3024.0000 => 2864.0000)
 SingleSource/Benchmarks/Shootout/ackermann: -6.52% (1472.0000 => 1376.0000)
 SingleSource/Benchmarks/Shootout/fib2: 5.45% (1760.0000 => 1856.0000)
 SingleSource/Benchmarks/Stanford/Treesort: -6.91% (6256.0000 => 5824.0000)
JIT codegen:
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -23.46% (5.6355 => 4.3134)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 111.34% (4.4816 => 9.4712)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -21.25% (8.4541 => 6.6573)
 MultiSource/Benchmarks/NPB-serial/is/is: -10.29% (0.4013 => 0.3600)
 MultiSource/Benchmarks/PAQ8p/paq8p: -6.23% (1.0502 => 0.9848)
CBE:
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.65% (21.2400 => 19.1900)
 MultiSource/Benchmarks/Prolangs-C++/primes/primes: -8.33% (0.3600 => 0.3300)
 SingleSource/Benchmarks/BenchmarkGame/recursive: 11.63% (0.8600 => 0.9600)
 SingleSource/Benchmarks/Shootout-C++/ary3: -5.04% (3.7700 => 3.5800)
LLC-BETA:
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.87% (19.9600 => 17.5900)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -10.43% (5.8500 => 5.2400)
 MultiSource/Benchmarks/BitBench/drop3/drop3: -5.00% (0.4000 => 0.3800)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.59% (0.3400 => 0.2700)
 MultiSource/Benchmarks/Ptrdist/ft/ft: -5.77% (1.0400 => 0.9800)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.69% (1.3100 => 1.1700)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.80% (2.9600 => 3.2500)
 SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -5.69% (1.2300 => 1.1600)
 SingleSource/Benchmarks/Dhrystone/fldry: -31.90% (1.1600 => 0.7900)
LLC compile:
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -14.68% (8.9588 => 7.6437)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 116.62% (4.5170 => 9.7846)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -11.42% (15.3275 => 13.5767)
GCCAS:
 Externals/SPEC/CFP2000/188_ammp/188_ammp: 6.45% (1.0162 => 1.0817)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 10.75% (54.8311 => 60.7262)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 8.57% (3.6940 => 4.0105)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: 7.33% (0.9431 => 1.0122)
 Externals/SPEC/CINT2000/252_eon/252_eon: 9.24% (3.9301 => 4.2934)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -7.73% (5.9076 => 5.4509)
 Externals/SPEC/CINT2000/254_gap/254_gap: 7.41% (4.5823 => 4.9220)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -7.64% (7.2981 => 6.7407)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 7.11% (5.7429 => 6.1513)
 Externals/SPEC/CINT2006/473_astar/473_astar: 6.47% (0.3372 => 0.3590)
 MultiSource/Applications/SPASS/SPASS: 15.51% (6.7596 => 7.8082)
 MultiSource/Applications/hbd/hbd: 12.10% (0.2553 => 0.2862)
 MultiSource/Applications/kimwitu++/kc: 13.53% (5.1687 => 5.8681)
 MultiSource/Applications/lambda-0_1_3/lambda: 11.81% (0.2506 => 0.2802)
 MultiSource/Applications/lua/lua: 6.53% (1.8956 => 2.0194)
 MultiSource/Applications/minisat/minisat: 8.47% (0.2443 => 0.2650)
 MultiSource/Applications/oggenc/oggenc: 5.09% (2.3875 => 2.5090)
 MultiSource/Applications/sqlite3/sqlite3: 7.19% (5.9176 => 6.3432)
 MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.28% (0.2148 => 0.2013)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.88% (0.3898 => 0.4361)
 MultiSource/Benchmarks/MallocBench/gs/gs: 5.24% (1.3074 => 1.3759)
 MultiSource/Benchmarks/PAQ8p/paq8p: 14.76% (1.5234 => 1.7483)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (1.8255 => 1.9322)
 MultiSource/Benchmarks/Ptrdist/bc/bc: 6.58% (0.4573 => 0.4874)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.48% (0.4068 => 0.4413)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.80% (0.3672 => 0.3885)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.07% (28.4399 => 30.4508)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.18% (1.5214 => 1.6610)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.32% (0.2693 => 0.2971)
JIT:
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -13.40% (12.7600 => 11.0500)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 75.18% (6.9300 => 12.1400)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -13.36% (16.3200 => 14.1400)
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.84% (21.3700 => 17.1300)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -13.46% (6.0900 => 5.2700)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -72.99% (1.7400 => 0.4700)
 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -5.22% (1.1500 => 1.0900)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.33% (1.5000 => 1.3900)
 MultiSource/Benchmarks/mafft/pairlocalalign: 12.75% (32.0900 => 36.1800)
 SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -5.60% (1.2500 => 1.1800)
 SingleSource/Benchmarks/Dhrystone/fldry: -22.22% (1.0800 => 0.8400)
 SingleSource/Benchmarks/Misc/richards_benchmark: 6.86% (1.0200 => 1.0900)
LLC:
 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -28.27% (24.3400 => 17.4600)
 MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -18.00% (6.3900 => 5.2400)
 MultiSource/Benchmarks/BitBench/drop3/drop3: -5.00% (0.4000 => 0.3800)
 MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.14% (0.4200 => 0.3900)
 MultiSource/Benchmarks/Olden/health/health: -6.12% (0.4900 => 0.4600)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.59% (0.3400 => 0.2700)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.14% (1.2600 => 1.1700)
 SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.80% (2.9600 => 3.2500)
 SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -5.69% (1.2300 => 1.1600)
 SingleSource/Benchmarks/Dhrystone/fldry: -26.17% (1.0700 => 0.7900)
LLC-BETA compile:
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -14.55% (9.0517 => 7.7349)
 Externals/SPEC/CINT2000/255_vortex/255_vortex: 115.77% (4.5605 => 9.8400)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -12.20% (15.5601 => 13.6619)
 MultiSource/Applications/siod/siod: 5.12% (1.9644 => 2.0649)
 MultiSource/Benchmarks/Olden/perimeter/perimeter: -85.01% (1.3400 => 0.2008)

More information about the llvm-testresults mailing list