[llvm-testresults] Grawp nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Thu Feb 4 03:58:48 PST 2010 

http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5170/
Name:  grawp.apple.com
Nickname: Grawp:4

Run: 5170, Start Time: 2010-02-04 00:41:56, End Time: 2010-02-04 03:58:17
Comparing To: 5134, Start Time: 2010-02-03 00:39:46, End Time: 2010-02-03 03:22:10

--- Changes Summary ---
New Test Passes: 617
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 73

--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 126

Total Test Failures By Type:
  CBE: 44
  JIT: 25
  JIT codegen: 57

--- Changes Detail ---
New Test Passes:
Externals/Nurbs/nurbs [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/Povray/povray [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2000/177_mesa/177_mesa [JIT, CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2006/444_namd/444_namd [JIT, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2006/447_dealII/447_dealII [JIT, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2006/450_soplex/450_soplex [JIT, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/176_gcc/176_gcc [JIT, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/252_eon/252_eon [JIT, CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [JIT, CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [JIT, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [JIT, CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [JIT, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [JIT, CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [JIT, CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [JIT, CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT, CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/ClamAV/clamscan [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/JM/ldecod/ldecod [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/JM/lencod/lencod [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/SIBsim4/SIBsim4 [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/SPASS/SPASS [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/d/make_dparser [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/hexxagon/hexxagon [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/kimwitu++/kc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/lambda-0_1_3/lambda [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/lemon/lemon [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/lua/lua [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/minisat/minisat [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/oggenc/oggenc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/siod/siod [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/sqlite3/sqlite3 [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/treecc/treecc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Bullet/bullet [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Olden/mst/mst [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/PAQ8p/paq8p [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/city/city [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/employ/employ [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/family/family [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/garage/garage [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/life/life [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/objects/objects [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/office/office [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/primes/primes [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/simul/simul [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/trees/trees [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/CoyoteBench/fftbench [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/bigfib [JIT, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/oopack_v1p8 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/ray [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/sphereflake [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/stepanov_container [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ackermann [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary3 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/fibo [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hash [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hash2 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/heapsort [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hello [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/lists [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/lists1 [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/matrix [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/methcall [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/nestedloop [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/objinst [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/random [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/reversefile [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/sieve [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/spellcheck [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/strcat [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/sumcol [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/wc [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/exception_spec_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/global_ctor [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/pointer_method [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/2003-05-14-AtExit [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/2003-10-29-ScalarReplBug [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, LLC_BETA compile]

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 Externals/Nurbs/nurbs: 18.90% (88704.0000 => 105472.0000)
 Externals/Povray/povray: 32.04% (1116944.0000 => 1474832.0000)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 28.15% (751536.0000 => 963056.0000)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 125.89% (576480.0000 => 1302224.0000)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 6.15% (630768.0000 => 669552.0000)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 21.88% (2134288.0000 => 2601216.0000)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 17.30% (7435104.0000 => 8721088.0000)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 21.30% (2875472.0000 => 3487808.0000)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 24.34% (251088.0000 => 312208.0000)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 1552.70% (87552.0000 => 1446976.0000)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 8.41% (7451056.0000 => 8077616.0000)
 MultiSource/Applications/kimwitu++/kc: 6.45% (1502272.0000 => 1599136.0000)
 MultiSource/Applications/lambda-0_1_3/lambda: 8.68% (65088.0000 => 70736.0000)
 MultiSource/Applications/lua/lua: 487.39% (80320.0000 => 471792.0000)
 MultiSource/Applications/oggenc/oggenc: 30.57% (612096.0000 => 799184.0000)
 MultiSource/Applications/sqlite3/sqlite3: 11.68% (835536.0000 => 933136.0000)
 MultiSource/Applications/treecc/treecc: 76.48% (134032.0000 => 236544.0000)
 MultiSource/Benchmarks/Bullet/bullet: 26.66% (953360.0000 => 1207552.0000)
 MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.53% (3184.0000 => 3360.0000)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 233.45% (56016.0000 => 186784.0000)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 169.03% (27536.0000 => 74080.0000)
 MultiSource/Benchmarks/PAQ8p/paq8p: 10.41% (171712.0000 => 189584.0000)
 MultiSource/Benchmarks/Prolangs-C++/employ/employ: 20.59% (9792.0000 => 11808.0000)
 MultiSource/Benchmarks/Prolangs-C++/family/family: 7.58% (3168.0000 => 3408.0000)
 MultiSource/Benchmarks/Prolangs-C++/garage/garage: 35.51% (5136.0000 => 6960.0000)
 MultiSource/Benchmarks/Prolangs-C++/objects/objects: 15.26% (8704.0000 => 10032.0000)
 MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.63% (7024.0000 => 8192.0000)
 MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.21% (1536.0000 => 1616.0000)
 MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.12% (8784.0000 => 10288.0000)
 MultiSource/Benchmarks/Prolangs-C++/simul/simul: 59.51% (2608.0000 => 4160.0000)
 MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.83% (9280.0000 => 11120.0000)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 169.15% (27536.0000 => 74112.0000)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 158.71% (60560.0000 => 156672.0000)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 21.57% (1524304.0000 => 1853152.0000)
 SingleSource/Benchmarks/Misc-C++/ray: 42.24% (7008.0000 => 9968.0000)
 SingleSource/Benchmarks/Shootout-C++/fibo: 5.00% (1920.0000 => 2016.0000)
 SingleSource/Benchmarks/Shootout-C++/heapsort: 5.41% (1776.0000 => 1872.0000)
 SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (1568.0000 => 1664.0000)
 SingleSource/Benchmarks/Shootout-C++/methcall: 24.59% (2928.0000 => 3648.0000)
 SingleSource/Benchmarks/Shootout-C++/objinst: 22.73% (3168.0000 => 3888.0000)
 SingleSource/Regression/C++/EH/exception_spec_test: 31.09% (1904.0000 => 2496.0000)
 SingleSource/Regression/C++/global_ctor: 38.46% (1040.0000 => 1440.0000)
 SingleSource/UnitTests/2003-05-14-AtExit: 12.50% (640.0000 => 720.0000)
CBE:
 MultiSource/Benchmarks/Ptrdist/ft/ft: 6.06% (0.9900 => 1.0500)
LLC-BETA:
 Externals/SPEC/CINT2000/197_parser/197_parser: 5.26% (2.6600 => 2.8000)
 SingleSource/Benchmarks/Misc/fbench: 9.50% (2.2100 => 2.4200)
GCCAS:
 Externals/Nurbs/nurbs: 18.30% (0.4590 => 0.5430)
 Externals/Povray/povray: 20.41% (5.5346 => 6.6643)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 24.14% (3.5648 => 4.4252)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 10.63% (30.1808 => 33.3901)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 6.83% (10.2547 => 10.9555)
 Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -5.25% (1.0898 => 1.0326)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 32.46% (5.6747 => 7.5167)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 5.08% (2.9339 => 3.0829)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 15.70% (4.2745 => 4.9456)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 7.09% (33.9276 => 36.3331)
 MultiSource/Applications/kimwitu++/kc: 9.14% (5.0536 => 5.5153)
 MultiSource/Applications/lambda-0_1_3/lambda: 7.81% (0.2319 => 0.2500)
 MultiSource/Applications/lua/lua: 52.35% (1.1931 => 1.8177)
 MultiSource/Applications/oggenc/oggenc: 9.16% (1.9599 => 2.1394)
 MultiSource/Applications/sqlite3/sqlite3: 7.90% (4.1617 => 4.4906)
 MultiSource/Applications/treecc/treecc: 62.69% (0.5564 => 0.9052)
 MultiSource/Benchmarks/Bullet/bullet: 6.44% (10.3701 => 11.0383)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 134.14% (0.7563 => 1.7708)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 140.90% (0.7504 => 1.8077)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 22.22% (7.3549 => 8.9892)
JIT:
 MultiSource/Applications/sgefa/sgefa: 7.59% (0.7900 => 0.8500)
 MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (1.7300 => 1.8200)
 MultiSource/Benchmarks/mafft/pairlocalalign: 22.05% (29.5200 => 36.0300)
 SingleSource/Benchmarks/Misc/fbench: 5.83% (2.2300 => 2.3600)
LLC:
 MultiSource/Applications/sgefa/sgefa: 8.57% (0.7000 => 0.7600)
 MultiSource/Benchmarks/FreeBench/distray/distray: 8.70% (0.2300 => 0.2500)
 SingleSource/Benchmarks/Misc/fbench: 9.50% (2.2100 => 2.4200)

More information about the llvm-testresults mailing list