[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Wed Feb 3 08:17:07 PST 2010 

http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5150/
Name:  grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4

Run: 5150, Start Time: 2010-02-03 05:41:32, End Time: 2010-02-03 08:16:47
Comparing To: 5124, Start Time: 2010-02-02 07:01:23, End Time: 2010-02-02 10:05:46

--- Changes Summary ---
New Test Passes: 0
New Test Failures: 473
Added Tests: 0
Removed Tests: 0
Significant Changes: 56

--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 1408

Total Test Failures By Type:
  CBE: 134
  JIT: 433
  JIT codegen: 433
  LLC: 102
  LLC compile: 102
  LLC-BETA: 102
  LLC_BETA compile: 102

--- Changes Detail ---
New Test Passes:

New Test Failures:
Externals/Nurbs/nurbs [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/Povray/povray [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2000/177_mesa/177_mesa [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2006/444_namd/444_namd [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2006/447_dealII/447_dealII [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CFP2006/450_soplex/450_soplex [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/164_gzip/164_gzip [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/175_vpr/175_vpr [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/176_gcc/176_gcc [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/252_eon/252_eon [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2000/255_vortex/255_vortex [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [LLC, LLC compile]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [CBE]
MultiSource/Applications/ClamAV/clamscan [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/JM/ldecod/ldecod [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/JM/lencod/lencod [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/SIBsim4/SIBsim4 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/SPASS/SPASS [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/d/make_dparser [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/hexxagon/hexxagon [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/kimwitu++/kc [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/lambda-0_1_3/lambda [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/lemon/lemon [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/lua/lua [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/minisat/minisat [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/oggenc/oggenc [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/siod/siod [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/sqlite3/sqlite3 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Applications/treecc/treecc [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Bullet/bullet [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Olden/mst/mst [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/PAQ8p/paq8p [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/NP/np [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/city/city [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/employ/employ [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/family/family [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/garage/garage [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/life/life [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/objects/objects [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/office/office [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/primes/primes [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/simul/simul [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C++/trees/trees [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/Prolangs-C/bison/mybison [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mafft/pairlocalalign [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/CoyoteBench/fftbench [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/bigfib [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/oopack_v1p8 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/ray [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/sphereflake [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Misc-C++/stepanov_container [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ackermann [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary2 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/ary3 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/fibo [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hash [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hash2 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/heapsort [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/hello [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/lists [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/lists1 [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/matrix [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/methcall [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/nestedloop [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/objinst [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/random [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/reversefile [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/sieve [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/spellcheck [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/strcat [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/sumcol [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/wc [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/2003-06-08-VirtualFunctions [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/exception_spec_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/global_ctor [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/pointer_method [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/2003-05-14-AtExit [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/UnitTests/2003-10-29-ScalarReplBug [CBE, LLC, LLC-BETA, LLC compile, LLC_BETA compile]

Added Tests:

Removed Tests:

Significant Changes in Test Results:
Bitcode:
 Externals/Nurbs/nurbs: -12.82% (114032.0000 => 99408.0000)
 Externals/Povray/povray: -17.26% (1354864.0000 => 1121072.0000)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: -18.71% (989280.0000 => 804144.0000)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: -8.61% (7337232.0000 => 6705536.0000)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: -6.26% (7160128.0000 => 6711744.0000)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -12.46% (3509008.0000 => 3071728.0000)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -5.23% (568816.0000 => 539040.0000)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -10.02% (1223424.0000 => 1100816.0000)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -5.66% (10483264.0000 => 9889440.0000)
 MultiSource/Applications/kimwitu++/kc: -5.45% (1907248.0000 => 1803248.0000)
 MultiSource/Applications/lambda-0_1_3/lambda: -6.08% (77952.0000 => 73216.0000)
 MultiSource/Applications/lua/lua: -22.72% (317712.0000 => 245520.0000)
 MultiSource/Applications/sqlite3/sqlite3: -9.19% (1032416.0000 => 937488.0000)
 MultiSource/Applications/treecc/treecc: -48.09% (231808.0000 => 120336.0000)
 MultiSource/Benchmarks/Bullet/bullet: -6.83% (3226400.0000 => 3006016.0000)
 MultiSource/Benchmarks/McCat/12-IOtest/iotest: -19.92% (4016.0000 => 3216.0000)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -61.35% (314448.0000 => 121536.0000)
 MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.59% (4848.0000 => 4480.0000)
 MultiSource/Benchmarks/PAQ8p/paq8p: -6.29% (207680.0000 => 194624.0000)
 MultiSource/Benchmarks/Prolangs-C++/NP/np: -6.45% (1488.0000 => 1392.0000)
 MultiSource/Benchmarks/Prolangs-C++/employ/employ: -13.52% (20480.0000 => 17712.0000)
 MultiSource/Benchmarks/Prolangs-C++/family/family: -6.33% (3792.0000 => 3552.0000)
 MultiSource/Benchmarks/Prolangs-C++/garage/garage: -21.58% (8304.0000 => 6512.0000)
 MultiSource/Benchmarks/Prolangs-C++/objects/objects: -14.12% (10992.0000 => 9440.0000)
 MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -9.30% (12384.0000 => 11232.0000)
 MultiSource/Benchmarks/Prolangs-C++/primes/primes: -6.56% (1952.0000 => 1824.0000)
 MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -13.28% (11808.0000 => 10240.0000)
 MultiSource/Benchmarks/Prolangs-C++/simul/simul: -16.67% (8064.0000 => 6720.0000)
 MultiSource/Benchmarks/Prolangs-C++/trees/trees: -10.64% (17136.0000 => 15312.0000)
 MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.30% (7616.0000 => 7136.0000)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -62.18% (325952.0000 => 123264.0000)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -16.59% (2494064.0000 => 2080352.0000)
 SingleSource/Benchmarks/CoyoteBench/fftbench: -5.08% (15104.0000 => 14336.0000)
 SingleSource/Benchmarks/Misc-C++/ray: -24.97% (11920.0000 => 8944.0000)
 SingleSource/Benchmarks/Shootout-C++/hello: -5.77% (1664.0000 => 1568.0000)
 SingleSource/Benchmarks/Shootout-C++/methcall: -19.38% (3632.0000 => 2928.0000)
 SingleSource/Benchmarks/Shootout-C++/objinst: -18.26% (3856.0000 => 3152.0000)
 SingleSource/Regression/C++/EH/exception_spec_test: -23.72% (2496.0000 => 1904.0000)
 SingleSource/Regression/C++/global_ctor: -23.08% (1456.0000 => 1120.0000)
 SingleSource/Regression/C++/pointer_method: -22.54% (1136.0000 => 880.0000)
 SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 5.88% (816.0000 => 864.0000)
 SingleSource/UnitTests/2003-05-14-AtExit: -11.11% (720.0000 => 640.0000)
LLC-BETA:
 SingleSource/Benchmarks/CoyoteBench/huffbench: -5.23% (16.2400 => 15.3900)
 SingleSource/Benchmarks/Dhrystone/fldry: -5.00% (3.6000 => 3.4200)
LLC compile:
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.55% (0.3916 => 0.4290)
GCCAS:
 Externals/Povray/povray: -17.95% (0.3142 => 0.2578)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: -8.11% (1.5849 => 1.4564)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -19.01% (0.6444 => 0.5219)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -12.48% (0.3261 => 0.2854)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -6.92% (2.3041 => 2.1447)
 MultiSource/Applications/kimwitu++/kc: -10.40% (0.4259 => 0.3816)
 MultiSource/Applications/sqlite3/sqlite3: -8.70% (0.2448 => 0.2235)
 MultiSource/Benchmarks/Bullet/bullet: -20.47% (0.6034 => 0.4799)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -16.64% (0.3978 => 0.3316)
LLC:
 SingleSource/Benchmarks/CoyoteBench/huffbench: -5.23% (16.2500 => 15.4000)
LLC-BETA compile:
 MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.41% (0.3923 => 0.4292)

More information about the llvm-testresults mailing list