[llvm-testresults] Grawp-PIC nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Wed Jan 27 06:32:52 PST 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/4966/
Name: grawp.apple.com
Nickname: Grawp-PIC:4
Run: 4966, Start Time: 2010-01-27 04:00:26, End Time: 2010-01-27 06:32:28
Comparing To: 4947, Start Time: 2010-01-26 04:08:10, End Time: 2010-01-26 06:45:09
--- Changes Summary ---
New Test Passes: 0
New Test Failures: 6
Added Tests: 0
Removed Tests: 0
Significant Changes: 177
--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 1781
Total Test Failures By Type:
CBE: 45
JIT: 433
JIT codegen: 433
LLC: 2
LLC compile: 2
LLC-BETA: 433
LLC_BETA compile: 433
--- Changes Detail ---
New Test Passes:
New Test Failures:
Externals/SPEC/CINT2006/464_h264ref/464_h264ref [CBE, LLC, LLC compile]
MultiSource/Applications/JM/lencod/lencod [CBE, LLC, LLC compile]
Added Tests:
Removed Tests:
Significant Changes in Test Results:
LLC:
Externals/SPEC/CINT2000/175_vpr/175_vpr: 5.79% (4.6600 => 4.9300)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -7.36% (3.2600 => 3.0200)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.96% (1.0800 => 1.2200)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -8.41% (1.0700 => 0.9800)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.90% (1.5600 => 1.7300)
SingleSource/Benchmarks/McGill/chomp: -12.96% (1.0800 => 0.9400)
GCCAS:
Externals/Nurbs/nurbs: -19.37% (0.6423 => 0.5179)
Externals/Povray/povray: -10.18% (7.1867 => 6.4549)
Externals/SPEC/CFP2006/433_milc/433_milc: -19.08% (1.3648 => 1.1044)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -6.54% (33.6426 => 31.4411)
Externals/SPEC/CFP2006/450_soplex/450_soplex: -5.75% (3.4986 => 3.2976)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -7.74% (0.5197 => 0.4795)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -10.07% (1.5350 => 1.3805)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -7.02% (1.7219 => 1.6011)
Externals/SPEC/CINT2000/197_parser/197_parser: -6.58% (1.3327 => 1.2450)
Externals/SPEC/CINT2000/252_eon/252_eon: 7.81% (4.2937 => 4.6289)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -11.79% (3.6993 => 3.2631)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 11.34% (0.3431 => 0.3820)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -5.14% (1.0613 => 1.0067)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -7.62% (42.0757 => 38.8696)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -10.40% (8.0017 => 7.1699)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -17.95% (3.6259 => 2.9751)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -22.71% (0.3518 => 0.2719)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -8.46% (5.3279 => 4.8771)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -9.35% (39.3557 => 35.6760)
MultiSource/Applications/ClamAV/clamscan: -8.71% (6.4318 => 5.8717)
MultiSource/Applications/SIBsim4/SIBsim4: -5.62% (0.6475 => 0.6111)
MultiSource/Applications/lemon/lemon: -10.73% (0.5100 => 0.4553)
MultiSource/Applications/lua/lua: -14.44% (2.0801 => 1.7797)
MultiSource/Applications/minisat/minisat: -6.31% (0.3378 => 0.3165)
MultiSource/Applications/siod/siod: -5.12% (0.8966 => 0.8507)
MultiSource/Applications/sqlite3/sqlite3: -13.64% (5.1025 => 4.4063)
MultiSource/Applications/treecc/treecc: -9.64% (0.9885 => 0.8932)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -17.11% (0.4243 => 0.3517)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -11.37% (0.2928 => 0.2595)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.49% (2.0629 => 1.9496)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.39% (0.7726 => 0.7078)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.25% (0.6708 => 0.6356)
MultiSource/Benchmarks/PAQ8p/paq8p: -6.13% (1.0461 => 0.9820)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.55% (0.5163 => 0.4825)
MultiSource/Benchmarks/Ptrdist/bc/bc: -8.17% (0.5103 => 0.4686)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -22.09% (0.3101 => 0.2416)
MultiSource/Benchmarks/mafft/pairlocalalign: -9.89% (5.6425 => 5.0845)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.74% (9.4540 => 8.6277)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -12.34% (1.4121 => 1.2379)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -10.22% (1.3399 => 1.2030)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.53% (0.8710 => 0.7967)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -29.14% (0.4022 => 0.2850)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -31.70% (0.4407 => 0.3010)
Bitcode:
Externals/Nurbs/nurbs: -29.69% (150096.0000 => 105536.0000)
Externals/Povray/povray: -7.35% (1594224.0000 => 1477072.0000)
Externals/SPEC/CFP2006/433_milc/433_milc: -14.98% (185104.0000 => 157376.0000)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -6.69% (1401168.0000 => 1307472.0000)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -17.41% (72400.0000 => 59792.0000)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -7.19% (262944.0000 => 244048.0000)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -5.20% (3347008.0000 => 3172880.0000)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -11.59% (380880.0000 => 336736.0000)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -10.05% (1473232.0000 => 1325200.0000)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -39.30% (1254048.0000 => 761200.0000)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 9.56% (63584.0000 => 69664.0000)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -9.32% (9530864.0000 => 8642720.0000)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -35.10% (55024.0000 => 35712.0000)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -11.52% (1635392.0000 => 1446960.0000)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -14.68% (9467248.0000 => 8077904.0000)
MultiSource/Applications/ClamAV/clamscan: -9.94% (1368416.0000 => 1232368.0000)
MultiSource/Applications/SIBsim4/SIBsim4: -5.10% (87488.0000 => 83024.0000)
MultiSource/Applications/hexxagon/hexxagon: -19.30% (42704.0000 => 34464.0000)
MultiSource/Applications/lambda-0_1_3/lambda: 6.37% (66576.0000 => 70816.0000)
MultiSource/Applications/lemon/lemon: -10.31% (106304.0000 => 95344.0000)
MultiSource/Applications/lua/lua: -15.53% (563392.0000 => 475872.0000)
MultiSource/Applications/siod/siod: -6.81% (347376.0000 => 323712.0000)
MultiSource/Applications/spiff/spiff: -8.87% (56656.0000 => 51632.0000)
MultiSource/Applications/sqlite3/sqlite3: -18.91% (1162784.0000 => 942880.0000)
MultiSource/Applications/treecc/treecc: -16.72% (283664.0000 => 236240.0000)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -12.82% (20960.0000 => 18272.0000)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.93% (10768.0000 => 12160.0000)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -15.87% (64624.0000 => 54368.0000)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.67% (89504.0000 => 84432.0000)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.66% (428464.0000 => 404208.0000)
MultiSource/Benchmarks/MallocBench/gs/gs: -5.46% (386368.0000 => 365264.0000)
MultiSource/Benchmarks/McCat/05-eks/eks: -5.66% (7632.0000 => 7200.0000)
MultiSource/Benchmarks/McCat/08-main/main: -6.76% (16336.0000 => 15232.0000)
MultiSource/Benchmarks/McCat/09-vor/vor: -6.15% (21088.0000 => 19792.0000)
MultiSource/Benchmarks/McCat/17-bintr/bintr: -5.53% (4048.0000 => 3824.0000)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.71% (197632.0000 => 186352.0000)
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -20.26% (3712.0000 => 2960.0000)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -12.07% (4640.0000 => 4080.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -10.06% (137696.0000 => 123840.0000)
MultiSource/Benchmarks/Olden/bisort/bisort: 10.75% (3424.0000 => 3792.0000)
MultiSource/Benchmarks/Olden/em3d/em3d: -5.41% (6512.0000 => 6160.0000)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.74% (1936.0000 => 1728.0000)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.66% (543600.0000 => 491072.0000)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -20.10% (56048.0000 => 44784.0000)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.43% (112256.0000 => 105040.0000)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -13.82% (48032.0000 => 41392.0000)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -33.95% (37040.0000 => 24464.0000)
MultiSource/Benchmarks/Ptrdist/bc/bc: -6.15% (117328.0000 => 110112.0000)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -16.35% (49808.0000 => 41664.0000)
MultiSource/Benchmarks/SciMark2-C/scimark2: -6.04% (15632.0000 => 14688.0000)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.93% (7264.0000 => 6688.0000)
MultiSource/Benchmarks/mafft/pairlocalalign: -7.26% (320544.0000 => 297280.0000)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -9.67% (173424.0000 => 156656.0000)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -9.44% (95424.0000 => 86416.0000)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -16.56% (328768.0000 => 274336.0000)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -36.55% (180864.0000 => 114752.0000)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -28.24% (134464.0000 => 96496.0000)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -23.26% (43136.0000 => 33104.0000)
SingleSource/Benchmarks/BenchmarkGame/fasta: -11.93% (2816.0000 => 2480.0000)
SingleSource/Benchmarks/BenchmarkGame/n-body: -14.72% (3696.0000 => 3152.0000)
SingleSource/Benchmarks/BenchmarkGame/recursive: -12.80% (2624.0000 => 2288.0000)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -25.66% (2432.0000 => 1808.0000)
SingleSource/Benchmarks/Misc-C++/bigfib: -6.71% (22896.0000 => 21360.0000)
SingleSource/Benchmarks/Shootout-C++/fibo: -11.27% (2272.0000 => 2016.0000)
SingleSource/Benchmarks/Shootout-C++/hash2: -8.86% (11200.0000 => 10208.0000)
SingleSource/Benchmarks/Shootout-C++/lists1: -5.08% (6608.0000 => 6272.0000)
SingleSource/Benchmarks/Shootout-C++/spellcheck: -10.66% (14864.0000 => 13280.0000)
SingleSource/Benchmarks/Shootout/ackermann: 16.25% (1280.0000 => 1488.0000)
SingleSource/Benchmarks/Shootout/fib2: -18.42% (1216.0000 => 992.0000)
SingleSource/Benchmarks/Stanford/Perm: 25.93% (1728.0000 => 2176.0000)
SingleSource/Benchmarks/Stanford/Queens: -16.39% (1952.0000 => 1632.0000)
SingleSource/Regression/C/bigstack: -43.77% (4496.0000 => 2528.0000)
LLC compile:
Externals/Nurbs/nurbs: -26.01% (0.9595 => 0.7099)
Externals/Povray/povray: -14.40% (11.0868 => 9.4898)
Externals/SPEC/CFP2006/433_milc/433_milc: -12.77% (1.1406 => 0.9949)
Externals/SPEC/CFP2006/447_dealII/447_dealII: -5.61% (6.8412 => 6.4577)
Externals/SPEC/CINT2000/164_gzip/164_gzip: -24.40% (0.5131 => 0.3879)
Externals/SPEC/CINT2000/175_vpr/175_vpr: -12.86% (2.0443 => 1.7814)
Externals/SPEC/CINT2000/176_gcc/176_gcc: -6.19% (23.4544 => 22.0022)
Externals/SPEC/CINT2000/186_crafty/186_crafty: -7.94% (2.9070 => 2.6762)
Externals/SPEC/CINT2000/252_eon/252_eon: 5.63% (4.0786 => 4.3084)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -11.40% (10.4355 => 9.2462)
Externals/SPEC/CINT2000/255_vortex/255_vortex: -60.94% (14.0380 => 5.4829)
Externals/SPEC/CINT2000/256_bzip2/256_bzip2: 8.40% (0.4322 => 0.4685)
Externals/SPEC/CINT2006/403_gcc/403_gcc: -8.99% (59.0919 => 53.7811)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -11.11% (12.7662 => 11.3481)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -6.04% (2.5266 => 2.3741)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -34.90% (0.4839 => 0.3150)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -7.33% (12.7137 => 11.7824)
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk: -15.92% (48.9408 => 41.1494)
MultiSource/Applications/ClamAV/clamscan: -12.96% (9.6279 => 8.3802)
MultiSource/Applications/SIBsim4/SIBsim4: -8.32% (0.6733 => 0.6173)
MultiSource/Applications/hexxagon/hexxagon: -18.44% (0.3264 => 0.2662)
MultiSource/Applications/kimwitu++/kc: -7.38% (12.1257 => 11.2310)
MultiSource/Applications/lemon/lemon: -9.74% (0.7543 => 0.6808)
MultiSource/Applications/lua/lua: -16.00% (3.6766 => 3.0884)
MultiSource/Applications/siod/siod: -9.09% (2.8108 => 2.5553)
MultiSource/Applications/spiff/spiff: -9.22% (0.4445 => 0.4035)
MultiSource/Applications/sqlite3/sqlite3: -17.08% (7.9289 => 6.5748)
MultiSource/Applications/treecc/treecc: -18.68% (1.8841 => 1.5322)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -15.41% (0.4886 => 0.4133)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.69% (0.3987 => 0.3760)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.84% (2.8630 => 2.6958)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.53% (1.2044 => 1.1257)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.74% (9.1034 => 8.2167)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -9.48% (1.0893 => 0.9860)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.63% (3.8905 => 3.5158)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -23.92% (0.4587 => 0.3490)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.84% (0.9425 => 0.8686)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -19.29% (0.4194 => 0.3385)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -29.55% (0.3107 => 0.2189)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -16.57% (0.7091 => 0.5916)
MultiSource/Benchmarks/Ptrdist/bc/bc: -24.64% (1.0754 => 0.8104)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.85% (0.4018 => 0.3542)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -10.66% (1.0654 => 0.9518)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -12.04% (0.7027 => 0.6181)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -29.00% (2.2101 => 1.5692)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -40.20% (1.6784 => 1.0037)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -31.01% (1.1514 => 0.7944)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -18.23% (0.2485 => 0.2032)
CBE:
Externals/SPEC/CINT2000/175_vpr/175_vpr: 5.78% (5.1900 => 5.4900)
MultiSource/Applications/hexxagon/hexxagon: -17.30% (11.9100 => 9.8500)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 6.98% (0.4300 => 0.4600)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.59% (0.9700 => 1.1600)
MultiSource/Benchmarks/SciMark2-C/scimark2: 6.48% (25.7700 => 27.4400)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -7.14% (1.1200 => 1.0400)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.61% (1.8400 => 1.9800)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 56.36% (0.5500 => 0.8600)
More information about the llvm-testresults
mailing list