[llvm-testresults] Grawp-NO-LTO-PIC nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Wed Jan 27 09:33:31 PST 2010
http://smooshlab.apple.com/perf/db_nt_internal/nightlytest/4970/
Name: grawp.apple.com
Nickname: Grawp-NO-LTO-PIC:4
Run: 4970, Start Time: 2010-01-27 06:33:33, End Time: 2010-01-27 09:32:15
Comparing To: 4951, Start Time: 2010-01-26 06:46:11, End Time: 2010-01-26 09:46:54
--- Changes Summary ---
New Test Passes: 0
New Test Failures: 8
Added Tests: 0
Removed Tests: 0
Significant Changes: 126
--- Tests Summary ---
Total Tests: 3897
Total Test Failures: 943
Total Test Failures By Type:
CBE: 63
JIT: 433
JIT codegen: 433
LLC: 1
LLC compile: 1
LLC-BETA: 6
LLC_BETA compile: 6
--- Changes Detail ---
New Test Passes:
New Test Failures:
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk [LLC-BETA, LLC_BETA compile]
Externals/SPEC/CINT2006/400_perlbench/400_perlbench [LLC-BETA, LLC_BETA compile]
MultiSource/Applications/treecc/treecc [LLC-BETA, LLC_BETA compile]
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode [LLC-BETA, LLC_BETA compile]
Added Tests:
Removed Tests:
Significant Changes in Test Results:
Bitcode:
Externals/SPEC/CFP2006/450_soplex/450_soplex: -7.26% (860112.0000 => 797632.0000)
Externals/SPEC/CINT2000/197_parser/197_parser: -11.56% (311456.0000 => 275456.0000)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -11.36% (156752.0000 => 138944.0000)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -6.95% (611280.0000 => 568816.0000)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -6.19% (53776.0000 => 50448.0000)
MultiSource/Applications/kimwitu++/kc: -6.93% (2044528.0000 => 1902800.0000)
MultiSource/Applications/lambda-0_1_3/lambda: -5.00% (82192.0000 => 78080.0000)
MultiSource/Applications/lua/lua: -10.69% (355776.0000 => 317728.0000)
MultiSource/Applications/sqlite3/sqlite3: -26.06% (1395632.0000 => 1031952.0000)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: -5.80% (3312.0000 => 3120.0000)
MultiSource/Benchmarks/FreeBench/distray/distray: -5.99% (7744.0000 => 7280.0000)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -12.43% (22656.0000 => 19840.0000)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -18.17% (92528.0000 => 75712.0000)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -12.41% (4256.0000 => 3728.0000)
MultiSource/Benchmarks/McCat/08-main/main: -11.02% (28592.0000 => 25440.0000)
MultiSource/Benchmarks/McCat/17-bintr/bintr: -10.28% (6384.0000 => 5728.0000)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -8.35% (6320.0000 => 5792.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.33% (129008.0000 => 120848.0000)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -8.98% (3920.0000 => 3568.0000)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.63% (85776.0000 => 79232.0000)
MultiSource/Benchmarks/NPB-serial/is/is: -25.00% (8640.0000 => 6480.0000)
MultiSource/Benchmarks/Olden/bh/bh: -9.61% (25984.0000 => 23488.0000)
MultiSource/Benchmarks/Olden/bisort/bisort: -23.86% (5968.0000 => 4544.0000)
MultiSource/Benchmarks/Olden/em3d/em3d: -7.10% (10144.0000 => 9424.0000)
MultiSource/Benchmarks/Olden/health/health: -7.63% (7968.0000 => 7360.0000)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -14.43% (6432.0000 => 5504.0000)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -7.38% (1952.0000 => 1808.0000)
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -20.91% (6352.0000 => 5024.0000)
MultiSource/Benchmarks/Prolangs-C++/life/life: -6.18% (6736.0000 => 6320.0000)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.40% (12752.0000 => 11808.0000)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.07% (90640.0000 => 85136.0000)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -8.20% (47632.0000 => 43728.0000)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -36.76% (41520.0000 => 26256.0000)
MultiSource/Benchmarks/Prolangs-C/football/football: -19.63% (92016.0000 => 73952.0000)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -13.14% (8768.0000 => 7616.0000)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -11.27% (3264.0000 => 2896.0000)
MultiSource/Benchmarks/mafft/pairlocalalign: -5.20% (684560.0000 => 648976.0000)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.72% (17072.0000 => 15584.0000)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.63% (85760.0000 => 79216.0000)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -8.12% (93424.0000 => 85840.0000)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -18.80% (3071472.0000 => 2494080.0000)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.86% (342720.0000 => 319216.0000)
SingleSource/Benchmarks/BenchmarkGame/n-body: -23.08% (4784.0000 => 3680.0000)
SingleSource/Benchmarks/BenchmarkGame/recursive: -20.10% (3184.0000 => 2544.0000)
SingleSource/Benchmarks/CoyoteBench/lpbench: -12.05% (7168.0000 => 6304.0000)
SingleSource/Benchmarks/McGill/chomp: -8.70% (14160.0000 => 12928.0000)
SingleSource/Benchmarks/Misc-C++/bigfib: -5.68% (25936.0000 => 24464.0000)
SingleSource/Benchmarks/Shootout-C++/ackermann: -13.95% (2752.0000 => 2368.0000)
SingleSource/Benchmarks/Shootout-C++/except: -7.23% (3984.0000 => 3696.0000)
SingleSource/Benchmarks/Shootout-C++/fibo: -10.07% (2224.0000 => 2000.0000)
SingleSource/Benchmarks/Shootout-C++/reversefile: 9.87% (9728.0000 => 10688.0000)
SingleSource/Benchmarks/Shootout/ackermann: -16.00% (1200.0000 => 1008.0000)
SingleSource/Benchmarks/Shootout/fib2: -17.57% (1184.0000 => 976.0000)
SingleSource/Benchmarks/Shootout/hash: -6.64% (3856.0000 => 3600.0000)
SingleSource/Benchmarks/Stanford/Queens: -28.44% (3488.0000 => 2496.0000)
SingleSource/Benchmarks/Stanford/Quicksort: -26.47% (3808.0000 => 2800.0000)
SingleSource/Regression/C++/EH/exception_spec_test: -11.36% (2816.0000 => 2496.0000)
SingleSource/Regression/C++/EH/throw_rethrow_test: -8.96% (2144.0000 => 1952.0000)
SingleSource/Regression/C/bigstack: -43.62% (4512.0000 => 2544.0000)
CBE:
Externals/SPEC/CFP2000/177_mesa/177_mesa: 19.56% (3.1700 => 3.7900)
MultiSource/Benchmarks/FreeBench/distray/distray: 7.14% (0.2800 => 0.3000)
MultiSource/Benchmarks/Olden/bh/bh: 7.07% (3.9600 => 4.2400)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 6.98% (0.4300 => 0.4600)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.38% (1.9200 => 2.1000)
SingleSource/Benchmarks/BenchmarkGame/recursive: 8.75% (1.6000 => 1.7400)
SingleSource/Benchmarks/Shootout-C++/ackermann: -8.12% (1.9700 => 1.8100)
SingleSource/Benchmarks/Shootout/fib2: 10.94% (0.6400 => 0.7100)
LLC-BETA:
Externals/SPEC/CFP2000/177_mesa/177_mesa: 25.09% (2.9100 => 3.6400)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -6.67% (0.3000 => 0.2800)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 9.76% (0.4100 => 0.4500)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.77% (1.9200 => 2.0500)
SingleSource/Benchmarks/BenchmarkGame/recursive: 23.85% (1.3000 => 1.6100)
SingleSource/Benchmarks/Shootout-C++/except: 16.67% (0.3000 => 0.3500)
SingleSource/Benchmarks/Shootout-C++/fibo: -11.11% (0.7200 => 0.6400)
SingleSource/UnitTests/Vector/SSE/sse_stepfft: -6.06% (0.6600 => 0.6200)
LLC compile:
Externals/SPEC/CFP2006/450_soplex/450_soplex: -6.25% (5.4990 => 5.1551)
Externals/SPEC/CINT2000/197_parser/197_parser: -11.42% (2.2645 => 2.0058)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -11.89% (0.9791 => 0.8627)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -6.54% (4.3409 => 4.0571)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -8.05% (0.4871 => 0.4479)
MultiSource/Applications/d/make_dparser: -6.14% (1.6713 => 1.5686)
MultiSource/Applications/kimwitu++/kc: -6.91% (11.3219 => 10.5396)
MultiSource/Applications/lua/lua: -9.86% (2.5442 => 2.2933)
MultiSource/Applications/oggenc/oggenc: -5.50% (2.8276 => 2.6720)
MultiSource/Applications/sqlite3/sqlite3: -21.57% (9.1699 => 7.1923)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -15.21% (0.6918 => 0.5866)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -10.42% (1.0491 => 0.9398)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.27% (0.4348 => 0.3945)
MultiSource/Benchmarks/OptimizerEval/optimizer-eval: -7.28% (0.2308 => 0.2140)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.23% (0.7716 => 0.7235)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -7.33% (0.3547 => 0.3287)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -35.87% (0.4053 => 0.2599)
MultiSource/Benchmarks/Prolangs-C/football/football: -20.31% (0.7977 => 0.6357)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.96% (0.4318 => 0.3931)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -11.11% (0.7020 => 0.6240)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -11.83% (8.4978 => 7.4924)
GCCAS:
MultiSource/Applications/kimwitu++/kc: -5.20% (0.4407 => 0.4178)
MultiSource/Applications/sqlite3/sqlite3: -25.25% (0.3252 => 0.2431)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -15.16% (0.4670 => 0.3962)
LLC:
Externals/SPEC/CFP2000/177_mesa/177_mesa: 16.23% (3.0200 => 3.5100)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -6.67% (0.3000 => 0.2800)
MultiSource/Benchmarks/Olden/bh/bh: -9.01% (4.4400 => 4.0400)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.14% (0.4200 => 0.4500)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.56% (1.9800 => 2.0900)
SingleSource/Benchmarks/BenchmarkGame/recursive: 23.85% (1.3000 => 1.6100)
SingleSource/Benchmarks/Shootout-C++/except: 20.69% (0.2900 => 0.3500)
SingleSource/Benchmarks/Shootout-C++/fibo: -11.11% (0.7200 => 0.6400)
LLC-BETA compile:
Externals/SPEC/CFP2006/450_soplex/450_soplex: -6.33% (5.5037 => 5.1553)
Externals/SPEC/CINT2000/197_parser/197_parser: -11.94% (2.2805 => 2.0083)
Externals/SPEC/CINT2006/401_bzip2/401_bzip2: -11.58% (0.9808 => 0.8672)
Externals/SPEC/CINT2006/456_hmmer/456_hmmer: -9.32% (4.4548 => 4.0397)
Externals/SPEC/CINT2006/462_libquantum/462_libquantum: -7.73% (0.4837 => 0.4463)
MultiSource/Applications/d/make_dparser: -5.63% (1.6773 => 1.5829)
MultiSource/Applications/kimwitu++/kc: -6.18% (11.2532 => 10.5583)
MultiSource/Applications/lua/lua: -10.30% (2.5534 => 2.2905)
MultiSource/Applications/oggenc/oggenc: -5.59% (2.8244 => 2.6666)
MultiSource/Applications/sqlite3/sqlite3: -21.60% (9.1972 => 7.2110)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -15.15% (0.6916 => 0.5868)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -10.85% (1.0516 => 0.9375)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.71% (0.4322 => 0.4032)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.14% (0.7705 => 0.7232)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -7.24% (0.3549 => 0.3292)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -35.81% (0.4038 => 0.2592)
MultiSource/Benchmarks/Prolangs-C/football/football: -20.20% (0.7979 => 0.6367)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.68% (0.4323 => 0.3991)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -11.95% (8.5006 => 7.4848)
More information about the llvm-testresults
mailing list