[llvm-testresults] Grawp-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Wed Dec 9 06:29:41 PST 2009


http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest/3630/
Name:  grawp.apple.com
Nickname: Grawp-PIC:4

Run: 3630, Start Time: 2009-12-09 03:58:55, End Time: 2009-12-09 06:25:41
Comparing To: 3609, Start Time: 2009-12-08 03:51:14, End Time: 2009-12-08 06:19:47

--- Changes Summary ---
New Test Passes: 5
New Test Failures: 4
Added Tests: 9
Removed Tests: 0
Significant Changes: 94

--- Tests Summary ---
Total Tests: 3861
Total Test Failures: 1768

Total Test Failures By Type:
  CBE: 52
  JIT: 429
  JIT codegen: 429
  LLC-BETA: 429
  LLC_BETA compile: 429

--- Changes Detail ---
New Test Passes:
Externals/SPEC/CINT2000/255_vortex/255_vortex [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [LLC, LLC compile]

New Test Failures:
SingleSource/UnitTests/2009-12-07-StructReturn [JIT, JIT codegen, LLC-BETA, LLC_BETA compile]

Added Tests:
SingleSource/UnitTests/2009-12-07-StructReturn [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]

Removed Tests:

Significant Changes in Test Results:
LLC:
 SingleSource/Benchmarks/CoyoteBench/huffbench: 8.12% (15.2700 => 16.5100)
GCCAS:
 Externals/SPEC/CFP2000/183_equake/183_equake: -5.92% (0.2533 => 0.2383)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: -9.95% (3.1358 => 2.8238)
 Externals/SPEC/CFP2006/433_milc/433_milc: -16.99% (1.6775 => 1.3925)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: -17.55% (41.3013 => 34.0543)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: -5.33% (46.5319 => 44.0497)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -5.58% (7.2968 => 6.8896)
 MultiSource/Applications/ClamAV/clamscan: -14.41% (7.8256 => 6.6977)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.52% (5.0497 => 4.7204)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.41% (1.8938 => 1.7346)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -16.16% (3.0540 => 2.5605)
LLC compile:
 Externals/Nurbs/nurbs: -11.41% (1.0277 => 0.9104)
 Externals/Povray/povray: -12.08% (12.0909 => 10.6305)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -16.39% (6.7290 => 5.6264)
 Externals/SPEC/CFP2000/188_ammp/188_ammp: -13.71% (2.0807 => 1.7955)
 Externals/SPEC/CFP2006/433_milc/433_milc: -8.76% (1.2035 => 1.0981)
 Externals/SPEC/CFP2006/444_namd/444_namd: -11.82% (2.9591 => 2.6092)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: -14.68% (7.5419 => 6.4344)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: -14.15% (4.8711 => 4.1816)
 Externals/SPEC/CINT2000/164_gzip/164_gzip: -12.31% (0.5453 => 0.4782)
 Externals/SPEC/CINT2000/175_vpr/175_vpr: -10.45% (2.1789 => 1.9512)
 Externals/SPEC/CINT2000/176_gcc/176_gcc: -15.21% (26.1799 => 22.1980)
 Externals/SPEC/CINT2000/186_crafty/186_crafty: -11.92% (3.1140 => 2.7428)
 Externals/SPEC/CINT2000/197_parser/197_parser: -14.76% (2.1066 => 1.7957)
 Externals/SPEC/CINT2000/252_eon/252_eon: -6.09% (4.1302 => 3.8787)
 Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -15.11% (11.5715 => 9.8231)
 Externals/SPEC/CINT2000/254_gap/254_gap: -15.12% (9.5996 => 8.1481)
 Externals/SPEC/CINT2000/256_bzip2/256_bzip2: -10.20% (0.4619 => 0.4148)
 Externals/SPEC/CINT2000/300_twolf/300_twolf: -11.03% (3.3342 => 2.9666)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -15.38% (21.0271 => 17.7927)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -8.96% (1.2787 => 1.1641)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -14.11% (13.8952 => 11.9342)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -11.97% (2.7357 => 2.4083)
 Externals/SPEC/CINT2006/458_sjeng/458_sjeng: -8.10% (2.6904 => 2.4724)
 Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -8.88% (0.5043 => 0.4595)
 Externals/SPEC/CINT2006/464_h264ref/464_h264ref: -10.15% (7.1220 => 6.3988)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -15.10% (14.0430 => 11.9220)
 Externals/SPEC/CINT2006/473_astar/473_astar: -11.89% (0.4172 => 0.3676)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -16.11% (55.4106 => 46.4850)
 MultiSource/Applications/ClamAV/clamscan: -13.65% (10.6596 => 9.2046)
 MultiSource/Applications/JM/ldecod/ldecod: -10.72% (4.2672 => 3.8097)
 MultiSource/Applications/JM/lencod/lencod: -10.23% (8.9999 => 8.0789)
 MultiSource/Applications/SIBsim4/SIBsim4: -10.74% (0.7568 => 0.6755)
 MultiSource/Applications/SPASS/SPASS: -13.08% (9.4083 => 8.1773)
 MultiSource/Applications/d/make_dparser: -14.71% (1.6190 => 1.3808)
 MultiSource/Applications/hbd/hbd: -11.80% (0.5874 => 0.5181)
 MultiSource/Applications/hexxagon/hexxagon: -11.80% (0.3559 => 0.3139)
 MultiSource/Applications/kimwitu++/kc: -10.62% (12.9051 => 11.5348)
 MultiSource/Applications/lambda-0_1_3/lambda: -17.18% (0.5750 => 0.4762)
 MultiSource/Applications/lemon/lemon: -13.76% (0.8266 => 0.7129)
 MultiSource/Applications/lua/lua: -14.36% (4.0411 => 3.4610)
 MultiSource/Applications/minisat/minisat: -13.25% (0.3282 => 0.2847)
 MultiSource/Applications/oggenc/oggenc: -11.38% (1.8974 => 1.6814)
 MultiSource/Applications/siod/siod: -16.90% (3.1891 => 2.6501)
 MultiSource/Applications/spiff/spiff: -13.17% (0.4944 => 0.4293)
 MultiSource/Applications/sqlite3/sqlite3: -14.60% (8.6249 => 7.3654)
 MultiSource/Applications/treecc/treecc: -14.88% (2.1033 => 1.7903)
 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -10.88% (3.9777 => 3.5451)
 MultiSource/Benchmarks/FreeBench/pifft/pifft: -9.28% (0.5119 => 0.4644)
 MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -13.54% (0.4365 => 0.3774)
 MultiSource/Benchmarks/MallocBench/espresso/espresso: -11.38% (3.0612 => 2.7129)
 MultiSource/Benchmarks/MallocBench/gs/gs: -16.36% (2.6595 => 2.2244)
 MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.14% (0.3668 => 0.3406)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -14.16% (1.3266 => 1.1388)
 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.38% (1.7823 => 1.6151)
 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -11.77% (9.8171 => 8.6617)
 MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.93% (1.1930 => 1.0388)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.55% (0.3768 => 0.3408)
 MultiSource/Benchmarks/PAQ8p/paq8p: -11.54% (1.3783 => 1.2192)
 MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.96% (4.1704 => 3.7132)
 MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -13.80% (0.7362 => 0.6346)
 MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.21% (0.4970 => 0.4363)
 MultiSource/Benchmarks/Prolangs-C/bison/mybison: -11.35% (1.0325 => 0.9153)
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -7.80% (0.5157 => 0.4755)
 MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -17.09% (0.3528 => 0.2925)
 MultiSource/Benchmarks/Prolangs-C/football/football: -13.55% (0.7269 => 0.6284)
 MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -13.83% (0.3305 => 0.2848)
 MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -12.89% (0.5222 => 0.4549)
 MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -12.07% (0.3622 => 0.3185)
 MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -12.56% (0.7777 => 0.6800)
 MultiSource/Benchmarks/Ptrdist/bc/bc: -10.63% (1.1638 => 1.0401)
 MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.94% (0.4405 => 0.3879)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: -12.39% (0.2970 => 0.2602)
 MultiSource/Benchmarks/mafft/pairlocalalign: -9.06% (2.4322 => 2.2119)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.75% (0.3780 => 0.3298)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -13.33% (1.1600 => 1.0054)
 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -11.24% (0.7488 => 0.6646)
 MultiSource/Benchmarks/sim/sim: -12.50% (0.2521 => 0.2206)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -9.76% (6.6999 => 6.0459)
 SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.98% (1.9832 => 1.8051)
 SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -9.06% (1.7404 => 1.5828)
 SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.19% (1.2106 => 1.0993)
 SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -14.29% (0.2750 => 0.2357)
 SingleSource/Benchmarks/Misc-C++/stepanov_container: -15.02% (0.2584 => 0.2196)



More information about the llvm-testresults mailing list