[llvm-testresults] Grawp-PIC nightly tester results

daniel_dunbar at apple.com daniel_dunbar at apple.com
Thu Feb 4 06:40:16 PST 2010


http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5180/
Name:  grawp.apple.com
Nickname: Grawp-PIC:4

Run: 5180, Start Time: 2010-02-04 03:59:30, End Time: 2010-02-04 06:39:57
Comparing To: 5141, Start Time: 2010-02-03 03:23:21, End Time: 2010-02-03 05:40:30

--- Changes Summary ---
New Test Passes: 263
New Test Failures: 0
Added Tests: 0
Removed Tests: 0
Significant Changes: 64

--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 1776

Total Test Failures By Type:
  CBE: 44
  JIT: 433
  JIT codegen: 433
  LLC-BETA: 433
  LLC_BETA compile: 433

--- Changes Detail ---
New Test Passes:
Externals/Nurbs/nurbs [CBE, LLC, LLC compile]
Externals/Povray/povray [CBE, LLC, LLC compile]
Externals/SPEC/CFP2000/177_mesa/177_mesa [CBE, LLC, LLC compile]
Externals/SPEC/CFP2006/444_namd/444_namd [LLC, LLC compile]
Externals/SPEC/CFP2006/447_dealII/447_dealII [LLC, LLC compile]
Externals/SPEC/CFP2006/450_soplex/450_soplex [LLC, LLC compile]
Externals/SPEC/CINT2000/176_gcc/176_gcc [LLC, LLC compile]
Externals/SPEC/CINT2000/252_eon/252_eon [CBE, LLC, LLC compile]
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [LLC, LLC compile]
Externals/SPEC/CINT2006/401_bzip2/401_bzip2 [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/403_gcc/403_gcc [LLC, LLC compile]
Externals/SPEC/CINT2006/445_gobmk/445_gobmk [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/456_hmmer/456_hmmer [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [CBE, LLC, LLC compile]
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC compile]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [CBE, LLC, LLC compile]
MultiSource/Applications/ClamAV/clamscan [CBE, LLC, LLC compile]
MultiSource/Applications/JM/ldecod/ldecod [CBE, LLC, LLC compile]
MultiSource/Applications/JM/lencod/lencod [LLC, LLC compile]
MultiSource/Applications/SIBsim4/SIBsim4 [LLC, LLC compile]
MultiSource/Applications/SPASS/SPASS [CBE, LLC, LLC compile]
MultiSource/Applications/d/make_dparser [LLC, LLC compile]
MultiSource/Applications/hexxagon/hexxagon [CBE, LLC, LLC compile]
MultiSource/Applications/kimwitu++/kc [CBE, LLC, LLC compile]
MultiSource/Applications/lambda-0_1_3/lambda [CBE, LLC, LLC compile]
MultiSource/Applications/lemon/lemon [CBE, LLC, LLC compile]
MultiSource/Applications/lua/lua [LLC, LLC compile]
MultiSource/Applications/minisat/minisat [LLC, LLC compile]
MultiSource/Applications/oggenc/oggenc [CBE, LLC, LLC compile]
MultiSource/Applications/siod/siod [CBE, LLC, LLC compile]
MultiSource/Applications/sqlite3/sqlite3 [LLC, LLC compile]
MultiSource/Applications/treecc/treecc [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Bullet/bullet [LLC, LLC compile]
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 [CBE, LLC, LLC compile]
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount [CBE, LLC, LLC compile]
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg [CBE, LLC, LLC compile]
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame [CBE, LLC, LLC compile]
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset [LLC, LLC compile]
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell [CBE, LLC, LLC compile]
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Olden/mst/mst [CBE, LLC, LLC compile]
MultiSource/Benchmarks/PAQ8p/paq8p [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/city/city [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/employ/employ [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/family/family [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/garage/garage [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/life/life [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/objects/objects [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/office/office [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/primes/primes [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/simul/simul [CBE, LLC, LLC compile]
MultiSource/Benchmarks/Prolangs-C++/trees/trees [CBE, LLC, LLC compile]
MultiSource/Benchmarks/mediabench/gsm/toast/toast [CBE, LLC, LLC compile]
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg [CBE, LLC, LLC compile]
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 [LLC, LLC compile]
SingleSource/Benchmarks/CoyoteBench/fftbench [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Misc-C++/bigfib [LLC, LLC compile]
SingleSource/Benchmarks/Misc-C++/oopack_v1p8 [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Misc-C++/ray [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Misc-C++/sphereflake [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Misc-C++/stepanov_container [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/ackermann [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/ary [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/ary2 [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/ary3 [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/fibo [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/hash [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/hash2 [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/heapsort [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/hello [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/lists [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/lists1 [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/matrix [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/methcall [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/nestedloop [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/objinst [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/random [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/reversefile [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/sieve [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/spellcheck [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/strcat [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/sumcol [CBE, LLC, LLC compile]
SingleSource/Benchmarks/Shootout-C++/wc [CBE, LLC, LLC compile]
SingleSource/Regression/C++/EH/exception_spec_test [LLC, LLC compile]
SingleSource/Regression/C++/global_ctor [CBE, LLC, LLC compile]
SingleSource/Regression/C++/pointer_method [CBE, LLC, LLC compile]
SingleSource/UnitTests/2003-05-14-AtExit [CBE, LLC, LLC compile]
SingleSource/UnitTests/2003-10-29-ScalarReplBug [CBE, LLC, LLC compile]

New Test Failures:

Added Tests:

Removed Tests:

Significant Changes in Test Results:
LLC:
 MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 11.11% (0.2700 => 0.3000)
 SingleSource/Benchmarks/Misc/fbench: -8.10% (2.4700 => 2.2700)
GCCAS:
 Externals/Nurbs/nurbs: 15.22% (0.4587 => 0.5285)
 Externals/Povray/povray: 21.09% (5.5324 => 6.6994)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 23.93% (3.5615 => 4.4139)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 11.26% (30.0741 => 33.4602)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 32.15% (5.6775 => 7.5027)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 5.34% (2.9222 => 3.0783)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 15.27% (4.2805 => 4.9341)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 6.73% (34.0449 => 36.3373)
 MultiSource/Applications/kimwitu++/kc: 9.00% (5.0474 => 5.5016)
 MultiSource/Applications/lambda-0_1_3/lambda: 11.01% (0.2307 => 0.2561)
 MultiSource/Applications/lua/lua: 52.57% (1.1933 => 1.8206)
 MultiSource/Applications/oggenc/oggenc: 8.44% (1.9648 => 2.1306)
 MultiSource/Applications/sqlite3/sqlite3: 8.18% (4.1544 => 4.4942)
 MultiSource/Applications/treecc/treecc: 63.71% (0.5542 => 0.9073)
 MultiSource/Benchmarks/Bullet/bullet: 6.67% (10.3290 => 11.0176)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 137.06% (0.7472 => 1.7713)
 MultiSource/Benchmarks/PAQ8p/paq8p: 5.24% (0.9533 => 1.0033)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 141.75% (0.7493 => 1.8114)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 22.30% (7.3358 => 8.9715)
Bitcode:
 Externals/Nurbs/nurbs: 18.90% (88704.0000 => 105472.0000)
 Externals/Povray/povray: 32.04% (1116928.0000 => 1474832.0000)
 Externals/SPEC/CFP2000/177_mesa/177_mesa: 28.15% (751536.0000 => 963056.0000)
 Externals/SPEC/CFP2006/447_dealII/447_dealII: 125.89% (576480.0000 => 1302224.0000)
 Externals/SPEC/CFP2006/450_soplex/450_soplex: 6.15% (630768.0000 => 669552.0000)
 Externals/SPEC/CINT2006/400_perlbench/400_perlbench: 21.88% (2134288.0000 => 2601216.0000)
 Externals/SPEC/CINT2006/403_gcc/403_gcc: 17.30% (7435104.0000 => 8721088.0000)
 Externals/SPEC/CINT2006/445_gobmk/445_gobmk: 21.30% (2875472.0000 => 3487808.0000)
 Externals/SPEC/CINT2006/456_hmmer/456_hmmer: 24.34% (251088.0000 => 312208.0000)
 Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 1552.70% (87552.0000 => 1446976.0000)
 Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: 8.41% (7451056.0000 => 8077616.0000)
 MultiSource/Applications/kimwitu++/kc: 6.45% (1502272.0000 => 1599136.0000)
 MultiSource/Applications/lambda-0_1_3/lambda: 8.68% (65088.0000 => 70736.0000)
 MultiSource/Applications/lua/lua: 487.39% (80320.0000 => 471792.0000)
 MultiSource/Applications/oggenc/oggenc: 30.57% (612096.0000 => 799184.0000)
 MultiSource/Applications/sqlite3/sqlite3: 11.68% (835536.0000 => 933136.0000)
 MultiSource/Applications/treecc/treecc: 76.48% (134032.0000 => 236544.0000)
 MultiSource/Benchmarks/Bullet/bullet: 26.66% (953360.0000 => 1207552.0000)
 MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.53% (3184.0000 => 3360.0000)
 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 233.45% (56016.0000 => 186784.0000)
 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 169.03% (27536.0000 => 74080.0000)
 MultiSource/Benchmarks/PAQ8p/paq8p: 10.41% (171712.0000 => 189584.0000)
 MultiSource/Benchmarks/Prolangs-C++/employ/employ: 20.59% (9792.0000 => 11808.0000)
 MultiSource/Benchmarks/Prolangs-C++/family/family: 7.58% (3168.0000 => 3408.0000)
 MultiSource/Benchmarks/Prolangs-C++/garage/garage: 35.51% (5136.0000 => 6960.0000)
 MultiSource/Benchmarks/Prolangs-C++/objects/objects: 15.26% (8704.0000 => 10032.0000)
 MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.63% (7024.0000 => 8192.0000)
 MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.21% (1536.0000 => 1616.0000)
 MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.12% (8784.0000 => 10288.0000)
 MultiSource/Benchmarks/Prolangs-C++/simul/simul: 59.51% (2608.0000 => 4160.0000)
 MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.83% (9280.0000 => 11120.0000)
 MultiSource/Benchmarks/mediabench/gsm/toast/toast: 169.15% (27536.0000 => 74112.0000)
 MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 158.71% (60560.0000 => 156672.0000)
 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 21.57% (1524304.0000 => 1853152.0000)
 SingleSource/Benchmarks/Misc-C++/ray: 42.24% (7008.0000 => 9968.0000)
 SingleSource/Benchmarks/Shootout-C++/fibo: 5.00% (1920.0000 => 2016.0000)
 SingleSource/Benchmarks/Shootout-C++/heapsort: 5.41% (1776.0000 => 1872.0000)
 SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (1568.0000 => 1664.0000)
 SingleSource/Benchmarks/Shootout-C++/methcall: 24.59% (2928.0000 => 3648.0000)
 SingleSource/Benchmarks/Shootout-C++/objinst: 22.73% (3168.0000 => 3888.0000)
 SingleSource/Regression/C++/EH/exception_spec_test: 31.09% (1904.0000 => 2496.0000)
 SingleSource/Regression/C++/global_ctor: 38.46% (1040.0000 => 1440.0000)
 SingleSource/UnitTests/2003-05-14-AtExit: 12.50% (640.0000 => 720.0000)



More information about the llvm-testresults mailing list