[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Thu Feb 4 09:41:56 PST 2010 

http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5185/
Name:  grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4

Run: 5185, Start Time: 2010-02-04 06:40:56, End Time: 2010-02-04 09:41:33
Comparing To: 5150, Start Time: 2010-02-03 05:41:32, End Time: 2010-02-03 08:16:47

--- Changes Summary ---
New Test Passes: 473
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 52

--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 935

Total Test Failures By Type:
  CBE: 63
  JIT: 433
  JIT codegen: 433
  LLC: 1
  LLC compile: 1
  LLC-BETA: 2
  LLC_BETA compile: 2

--- Changes Detail ---
New Test Passes:
Externals/Nurbs/nurbs [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/Povray/povray [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2000/177_mesa/177_mesa [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2006/444_namd/444_namd [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2006/447_dealII/447_dealII [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2006/450_soplex/450_soplex [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/164_gzip/164_gzip [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/175_vpr/175_vpr [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/176_gcc/176_gcc [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/252_eon/252_eon [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/255_vortex/255_vortex [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [LLC, LLC compile]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [CBE]
MultiSource/Applications/ClamAV/clamscan [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/JM/ldecod/ldecod [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/JM/lencod/lencod [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/SIBsim4/SIBsim4 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/SPASS/SPASS [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/d/make_dparser [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/hexxagon/hexxagon [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/kimwitu++/kc [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/lambda-0_1_3/lambda [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/lemon/lemon [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/lua/lua [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/minisat/minisat [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/oggenc/oggenc [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/siod/siod [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/sqlite3/sqlite3 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/treecc/treecc [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Bullet/bullet [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Olden/mst/mst [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/PAQ8p/paq8p [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/NP/np [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/city/city [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/employ/employ [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/family/family [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/garage/garage [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/life/life [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/objects/objects [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/office/office [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/primes/primes [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/simul/simul [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/trees/trees [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/bison/mybison [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mafft/pairlocalalign [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/CoyoteBench/fftbench [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/bigfib [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/oopack_v1p8 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/ray [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/sphereflake [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/stepanov_container [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ackermann [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary2 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary3 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/fibo [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hash [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hash2 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/heapsort [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hello [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/lists [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/lists1 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/matrix [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/methcall [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/nestedloop [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/objinst [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/random [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/reversefile [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/sieve [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/spellcheck [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/strcat [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/sumcol [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/wc [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/2003-06-08-VirtualFunctions [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/exception_spec_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/global_ctor [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/pointer_method [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/2003-05-14-AtExit [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/2003-10-29-ScalarReplBug [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
LLC:
 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.21% (0.9600 => 1.0100)
GCCAS:
 Externals/Povray/povray: 18.97% (0.2578 => 0.3067)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 6.30% (1.4564 => 1.5482)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 22.76% (0.5219 => 0.6407)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 12.30% (0.2854 => 0.3205)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 5.73% (2.1447 => 2.2676)
 MultiSource/Applications/kimwitu++/kc: 9.70% (0.3816 => 0.4186)
 MultiSource/Applications/sqlite3/sqlite3: 6.40% (0.2235 => 0.2378)
 MultiSource/Benchmarks/Bullet/bullet: 22.75% (0.4799 => 0.5891)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.65% (0.3316 => 0.3868)
LLC compile:
 MultiSource/Benchmarks/OptimizerEval/optimizer-eval: 6.11% (0.2162 => 0.2294)
Bitcode:
 Externals/Nurbs/nurbs: 14.71% (99408.0000 => 114032.0000)
 Externals/Povray/povray: 20.34% (1121072.0000 => 1349104.0000)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 22.88% (804144.0000 => 988096.0000)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 9.42% (6705536.0000 => 7337360.0000)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 6.33% (6711744.0000 => 7136512.0000)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 14.21% (3071728.0000 => 3508192.0000)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 5.61% (539040.0000 => 569280.0000)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 11.14% (1100816.0000 => 1223424.0000)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 6.00% (9889440.0000 => 10483264.0000)
 MultiSource/Applications/kimwitu++/kc: 5.77% (1803248.0000 => 1907248.0000)
 MultiSource/Applications/lambda-0_1_3/lambda: 6.47% (73216.0000 => 77952.0000)
 MultiSource/Applications/lua/lua: 29.55% (245520.0000 => 318080.0000)
 MultiSource/Applications/sqlite3/sqlite3: 10.07% (937488.0000 => 1031872.0000)
 MultiSource/Applications/treecc/treecc: 92.71% (120336.0000 => 231904.0000)
 MultiSource/Benchmarks/Bullet/bullet: 7.33% (3006016.0000 => 3226400.0000)
 MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.88% (3216.0000 => 4016.0000)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 158.68% (121536.0000 => 314384.0000)
 MultiSource/Benchmarks/PAQ8p/paq8p: 6.71% (194624.0000 => 207680.0000)
 MultiSource/Benchmarks/Prolangs-C++/NP/np: 6.90% (1392.0000 => 1488.0000)
 MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.63% (17712.0000 => 20480.0000)
 MultiSource/Benchmarks/Prolangs-C++/family/family: 6.76% (3552.0000 => 3792.0000)
 MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.52% (6512.0000 => 8304.0000)
 MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.44% (9440.0000 => 10992.0000)
 MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.26% (11232.0000 => 12384.0000)
 MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.02% (1824.0000 => 1952.0000)
 MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.31% (10240.0000 => 11808.0000)
 MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.00% (6720.0000 => 8064.0000)
 MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.91% (15312.0000 => 17136.0000)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 164.38% (123264.0000 => 325888.0000)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 19.80% (2080352.0000 => 2492176.0000)
 SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (14336.0000 => 15104.0000)
 SingleSource/Benchmarks/Misc-C++/ray: 33.27% (8944.0000 => 11920.0000)
 SingleSource/Benchmarks/Shootout-C++/fibo: 5.04% (1904.0000 => 2000.0000)
 SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (1568.0000 => 1664.0000)
 SingleSource/Benchmarks/Shootout-C++/methcall: 24.04% (2928.0000 => 3632.0000)
 SingleSource/Benchmarks/Shootout-C++/objinst: 22.34% (3152.0000 => 3856.0000)
 SingleSource/Benchmarks/Shootout-C++/random: 5.00% (1920.0000 => 2016.0000)
 SingleSource/Regression/C++/EH/exception_spec_test: 31.09% (1904.0000 => 2496.0000)
 SingleSource/Regression/C++/global_ctor: 30.00% (1120.0000 => 1456.0000)
 SingleSource/Regression/C++/pointer_method: 29.09% (880.0000 => 1136.0000)
 SingleSource/UnitTests/2003-05-14-AtExit: 12.50% (640.0000 => 720.0000)

More information about the llvm-testresults mailing list