[llvm-testresults] Grawp nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Fri Feb 5 03:52:38 PST 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/5197/
Name: grawp.apple.com
Nickname: Grawp:4
Run: 5197, Start Time: 2010-02-05 00:39:27, End Time: 2010-02-05 03:52:17
Comparing To: 5170, Start Time: 2010-02-04 00:41:56, End Time: 2010-02-04 03:58:17
--- Changes Summary ---
New Test Passes: 0
New Test Failures: 1
Added Tests: 0
Removed Tests: 0
Significant Changes: 130
--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 127
Total Test Failures By Type:
CBE: 45
JIT: 25
JIT codegen: 57
--- Changes Detail ---
New Test Passes:
New Test Failures:
MultiSource/Applications/ClamAV/clamscan [CBE]
Added Tests:
Removed Tests:
Significant Changes in Test Results:
Bitcode:
Externals/Nurbs/nurbs: 35.15% (105472.0000 => 142544.0000)
Externals/SPEC/CFP2006/447_dealII/447_dealII: 5.20% (1302224.0000 => 1369968.0000)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -5.11% (62928.0000 => 59712.0000)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 19.05% (337216.0000 => 401472.0000)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 5.12% (1316896.0000 => 1384288.0000)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 45.39% (35712.0000 => 51920.0000)
MultiSource/Applications/hexxagon/hexxagon: 18.25% (34464.0000 => 40752.0000)
MultiSource/Applications/lua/lua: 10.25% (471792.0000 => 520128.0000)
MultiSource/Applications/spiff/spiff: 6.82% (49472.0000 => 52848.0000)
MultiSource/Applications/sqlite3/sqlite3: 7.57% (933136.0000 => 1003744.0000)
MultiSource/Applications/treecc/treecc: 13.96% (236544.0000 => 269568.0000)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -11.31% (12304.0000 => 10912.0000)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.05% (84512.0000 => 88784.0000)
MultiSource/Benchmarks/MallocBench/gs/gs: 5.12% (365536.0000 => 384240.0000)
MultiSource/Benchmarks/McCat/05-eks/eks: 6.00% (7200.0000 => 7632.0000)
MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (19792.0000 => 20800.0000)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.67% (3824.0000 => 4576.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.68% (123968.0000 => 133488.0000)
MultiSource/Benchmarks/Olden/bisort/bisort: -9.70% (3792.0000 => 3424.0000)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.08% (491168.0000 => 535744.0000)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.60% (44960.0000 => 49728.0000)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.86% (41472.0000 => 48048.0000)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (156672.0000 => 164656.0000)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.29% (1853152.0000 => 2080960.0000)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (33104.0000 => 35264.0000)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 34.51% (1808.0000 => 2432.0000)
SingleSource/Benchmarks/Shootout-C++/hash2: 9.11% (10192.0000 => 11120.0000)
SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.93% (13280.0000 => 14864.0000)
SingleSource/Benchmarks/Stanford/Queens: 19.61% (1632.0000 => 1952.0000)
JIT codegen:
Externals/Nurbs/nurbs: 42.49% (0.5597 => 0.7975)
Externals/Povray/povray: 8.23% (3.4228 => 3.7046)
MultiSource/Applications/SIBsim4/SIBsim4: 10.38% (0.5403 => 0.5964)
MultiSource/Applications/lua/lua: 9.02% (1.7955 => 1.9574)
MultiSource/Applications/siod/siod: 6.81% (0.7550 => 0.8064)
MultiSource/Applications/spiff/spiff: 15.55% (0.2585 => 0.2987)
MultiSource/Applications/sqlite3/sqlite3: 6.78% (4.2641 => 4.5532)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.91% (0.3589 => 0.3801)
MultiSource/Benchmarks/MallocBench/gs/gs: 6.82% (0.8680 => 0.9272)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.72% (0.4870 => 0.5246)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -31.76% (0.4946 => 0.3375)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.55% (0.2036 => 0.2373)
MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (0.6440 => 0.6822)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.39% (0.3165 => 0.3494)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.61% (0.2291 => 0.2557)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.76% (0.5347 => 0.5762)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.57% (4.7820 => 5.4786)
CBE:
Externals/SPEC/CINT2000/175_vpr/175_vpr: -5.08% (4.9200 => 4.6700)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -6.94% (2.4500 => 2.2800)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -11.73% (5.3700 => 4.7400)
MultiSource/Applications/hexxagon/hexxagon: 12.62% (9.1100 => 10.2600)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.53% (0.9500 => 0.8500)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.17% (1.7400 => 1.8300)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -36.05% (0.8600 => 0.5500)
LLC-BETA:
Externals/Povray/povray: 5.35% (4.4900 => 4.7300)
MultiSource/Benchmarks/PAQ8p/paq8p: -7.56% (104.7900 => 96.8700)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.76% (1.0200 => 0.9000)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.43% (1.4800 => 1.5900)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.33% (1.5000 => 1.4200)
SingleSource/Benchmarks/McGill/chomp: 16.13% (0.9300 => 1.0800)
LLC compile:
Externals/Nurbs/nurbs: 36.55% (0.6752 => 0.9220)
Externals/Povray/povray: 5.09% (8.2555 => 8.6753)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -5.53% (0.3890 => 0.3675)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 12.65% (2.4530 => 2.7634)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 47.44% (0.3103 => 0.4575)
MultiSource/Applications/SIBsim4/SIBsim4: 10.81% (0.5978 => 0.6624)
MultiSource/Applications/hexxagon/hexxagon: 18.79% (0.2257 => 0.2681)
MultiSource/Applications/lua/lua: 9.80% (2.9723 => 3.2635)
MultiSource/Applications/spiff/spiff: 11.36% (0.3584 => 0.3991)
MultiSource/Applications/sqlite3/sqlite3: 7.95% (6.3607 => 6.8661)
MultiSource/Applications/treecc/treecc: 16.81% (1.4418 => 1.6842)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.01% (0.3696 => 0.3918)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.71% (0.8958 => 0.9649)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.00% (3.3065 => 3.5379)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.97% (0.3158 => 0.3473)
MultiSource/Benchmarks/Ptrdist/bc/bc: 6.37% (0.7311 => 0.7777)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.3444 => 0.3800)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.65% (0.9486 => 1.0022)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.82% (5.6689 => 6.4521)
GCCAS:
Externals/Nurbs/nurbs: 18.91% (0.5430 => 0.6457)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 14.46% (1.6248 => 1.8597)
Externals/SPEC/CINT2000/252_eon/252_eon: -7.71% (4.7811 => 4.4126)
MultiSource/Applications/SIBsim4/SIBsim4: 5.04% (0.6286 => 0.6603)
MultiSource/Applications/treecc/treecc: 11.73% (0.9052 => 1.0114)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.64% (0.2645 => 0.2953)
MultiSource/Benchmarks/MallocBench/gs/gs: 7.82% (1.5044 => 1.6220)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 23.85% (0.2478 => 0.3069)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.71% (8.9892 => 9.6823)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 23.15% (0.2899 => 0.3570)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.93% (0.3039 => 0.3280)
JIT:
Externals/Povray/povray: 6.24% (8.3300 => 8.8500)
Externals/SPEC/CINT2000/252_eon/252_eon: -14.29% (2.4500 => 2.1000)
MultiSource/Applications/hexxagon/hexxagon: -8.68% (10.9400 => 9.9900)
MultiSource/Benchmarks/FreeBench/mason/mason: -24.14% (0.2900 => 0.2200)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.56% (0.5400 => 0.5700)
MultiSource/Benchmarks/MallocBench/gs/gs: 5.45% (1.1000 => 1.1600)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.17% (0.5800 => 0.6100)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -30.19% (0.5300 => 0.3700)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.18% (0.2200 => 0.2600)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.34% (1.4200 => 1.3300)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.19% (0.9700 => 1.0300)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.25% (6.3100 => 7.0200)
SingleSource/Benchmarks/McGill/chomp: -7.83% (1.1500 => 1.0600)
LLC:
Externals/Povray/povray: 5.48% (4.3800 => 4.6200)
MultiSource/Benchmarks/FreeBench/distray/distray: -8.00% (0.2500 => 0.2300)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.41% (1.4800 => 1.4000)
SingleSource/Benchmarks/McGill/chomp: 16.13% (0.9300 => 1.0800)
LLC-BETA compile:
Externals/Nurbs/nurbs: 39.43% (0.6604 => 0.9208)
Externals/Povray/povray: 5.19% (8.2565 => 8.6847)
Externals/SPEC/CFP2006/447_dealII/447_dealII: 5.05% (6.4545 => 6.7803)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -5.84% (0.3902 => 0.3674)
Externals/SPEC/CINT2000/186_crafty/186_crafty: 12.96% (2.4360 => 2.7516)
Externals/SPEC/CINT2000/252_eon/252_eon: -5.18% (3.0205 => 2.8640)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: 5.23% (8.8014 => 9.2617)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: 49.63% (0.3087 => 0.4619)
MultiSource/Applications/SIBsim4/SIBsim4: 10.81% (0.6005 => 0.6654)
MultiSource/Applications/hexxagon/hexxagon: 18.33% (0.2264 => 0.2679)
MultiSource/Applications/lua/lua: 10.11% (2.9721 => 3.2725)
MultiSource/Applications/spiff/spiff: 8.41% (0.3581 => 0.3882)
MultiSource/Applications/sqlite3/sqlite3: 7.29% (6.3932 => 6.8593)
MultiSource/Applications/treecc/treecc: 16.88% (1.4453 => 1.6892)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (0.3721 => 0.3919)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.29% (0.8931 => 0.9671)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.86% (3.2996 => 3.5589)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.04% (0.3139 => 0.3454)
MultiSource/Benchmarks/Ptrdist/bc/bc: 6.80% (0.7314 => 0.7811)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.88% (0.3463 => 0.3805)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.13% (0.2572 => 0.2704)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.65% (0.9517 => 1.0055)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.50% (5.6690 => 6.4344)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.68% (0.2006 => 0.2120)
More information about the llvm-testresults
mailing list