[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Apr 15 02:16:31 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10655?compare_to=10651&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10655, Order: 179511, Start Time: 2013-04-15 07:31:17, End Time: 2013-04-15 09:17:44
      To: 10651, Order: 179504, Start Time: 2013-04-15 05:24:51, End Time: 2013-04-15 07:09:33
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (13 on baseline)
Performance Regressions: 33 (102 on baseline)
Performance Improvements: 0 (59 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 19 (19 on baseline)
Unchanged Tests: 1056 (909 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 52.75% (0.0800 => 0.1222, std.dev.: 0.0072)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 50.84% (0.0950 => 0.1433, std.dev.: 0.0084)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 10.75% (0.2224 => 0.2463, std.dev.: 0.0082)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.33% (0.9101 => 1.0041, std.dev.: 0.0271)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.90% (4.9037 => 5.3894, std.dev.: 0.0610)
  MultiSource/Applications/sqlite3/sqlite3: 8.39% (16.4598 => 17.8406, std.dev.: 0.1170)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.24% (9.6064 => 10.3983, std.dev.: 0.1988)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.37% (1.8626 => 1.9998, std.dev.: 0.0249)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.03% (1.8890 => 2.0218, std.dev.: 0.0408)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.34% (14.8988 => 15.8441, std.dev.: 0.1009)
  MultiSource/Applications/ClamAV/clamscan: 6.23% (16.5503 => 17.5818, std.dev.: 0.0410)
  MultiSource/Applications/SPASS/SPASS: 5.19% (16.6753 => 17.5406, std.dev.: 0.1227)
  MultiSource/Applications/oggenc/oggenc: 4.82% (5.4576 => 5.7206, std.dev.: 0.0530)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 70.21% (5.9126 => 10.0639, std.dev.: 0.4386)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 43.31% (0.8732 => 1.2514, std.dev.: 0.0407)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.39% (4.5597 => 6.0365, std.dev.: 0.0942)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.89% (1.4802 => 1.8931, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 23.63% (3.1502 => 3.8947, std.dev.: 0.2182)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 11.04% (3.1689 => 3.5187, std.dev.: 0.1025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.75% (59.9961 => 64.0441, std.dev.: 0.5113)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 6.08% (4.0576 => 4.3043, std.dev.: 0.0126)
  MultiSource/Benchmarks/llubenchmark/llu: 5.77% (2.0330 => 2.1504, std.dev.: 0.0308)
  SingleSource/Benchmarks/McGill/chomp: 5.15% (1.0124 => 1.0645, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.03% (9.0189 => 9.4723, std.dev.: 0.0311)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.10% (2.4586 => 2.5349, std.dev.: 0.0117)
  MultiSource/Applications/lua/lua: 2.69% (29.0348 => 29.8146, std.dev.: 0.2953)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.68% (3.3116 => 3.4003, std.dev.: 0.0117)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 2.10% (85.7265 => 87.5263, std.dev.: 0.0836)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.01% (3.5370 => 3.6080, std.dev.: 0.0256)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.99% (1.5740 => 1.6054, std.dev.: 0.0116)
  MultiSource/Benchmarks/Olden/bh/bh: 1.83% (2.4074 => 2.4515, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.79% (5.7965 => 5.9004, std.dev.: 0.0051)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 1.30% (1.4871 => 1.5065, std.dev.: 0.0014)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 2.47% (1.1411 => 1.1693, std.dev.: 0.0270)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.99% (0.0217 => 0.0230, std.dev.: 0.0047)
  MultiSource/Applications/ClamAV/clamscan: 6.01% (0.1465 => 0.1553, std.dev.: 0.0190)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.04% (0.1135 => 0.1249, std.dev.: 0.0169)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.51% (0.0592 => 0.0595, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.17% (0.0257 => 0.0260, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0630 => 0.0631, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (0.0269 => 0.0273, std.dev.: 0.0002)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0008 => 0.0008, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionTest: -62.50% (0.0008 => 0.0003, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0008 => 0.0008)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 232.00% (0.0025 => 0.0083, std.dev.: 0.0039)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.02% (24.3659 => 24.6138, std.dev.: 0.0828)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003)
  MultiSource/Applications/lemon/lemon: -19.98% (1.1794 => 0.9438, std.dev.: 0.1576)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.04% (0.4125 => 0.4333, std.dev.: 0.0476)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.99% (0.0663 => 0.0610, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.81% (1.1660 => 1.1754, std.dev.: 0.0442)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.42% (1.6803 => 1.2531, std.dev.: 0.0033)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.79% (29.7937 => 28.9610, std.dev.: 1.9444)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -55.56% (0.0009 => 0.0004, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.24% (0.0029 => 0.0024, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/Altivec/casts: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 46.82% (0.0976 => 0.1433, std.dev.: 0.0084)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.34% (0.0877 => 0.1222, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.26% (1.1428 => 1.4772, std.dev.: 0.0964)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.83% (1.0418 => 1.3422, std.dev.: 0.0302)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.71% (1.0687 => 1.3755, std.dev.: 0.0597)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.55% (1.0864 => 1.3966, std.dev.: 0.0270)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.38% (1.0617 => 1.3630, std.dev.: 0.1095)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 28.16% (1.0951 => 1.4035, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.96% (1.0958 => 1.4022, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 27.59% (1.0507 => 1.3406, std.dev.: 0.0573)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 27.34% (1.0526 => 1.3404, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 27.29% (1.0528 => 1.3401, std.dev.: 0.0383)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.28% (1.1626 => 1.4797, std.dev.: 0.0413)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.16% (1.1023 => 1.4017, std.dev.: 0.0444)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 26.96% (1.1744 => 1.4910, std.dev.: 0.0356)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.29% (1.2270 => 1.5496, std.dev.: 0.1038)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.87% (1.0890 => 1.3707, std.dev.: 0.0383)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.28% (1.1699 => 1.4657, std.dev.: 0.1018)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 23.08% (1.1727 => 1.4434, std.dev.: 0.0434)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.76% (1.2537 => 1.5391, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.65% (1.2419 => 1.5232, std.dev.: 0.0819)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.02% (1.2835 => 1.5661, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.97% (1.2853 => 1.5677, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.94% (1.2929 => 1.5766, std.dev.: 0.1045)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.91% (1.3046 => 1.5905, std.dev.: 0.0404)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.91% (1.2723 => 1.5511, std.dev.: 0.0513)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 21.74% (1.3313 => 1.6207, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.73% (1.2566 => 1.5297, std.dev.: 0.0703)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 21.38% (1.3692 => 1.6619, std.dev.: 0.0493)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 21.35% (1.3491 => 1.6372, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.13% (1.2704 => 1.5388, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.01% (1.2925 => 1.5641, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 20.87% (1.4622 => 1.7673, std.dev.: 0.0259)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.42% (1.3357 => 1.6084, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.02% (1.3638 => 1.6369, std.dev.: 0.0449)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.49% (1.4005 => 1.6735, std.dev.: 0.0128)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 16.62% (0.2112 => 0.2463, std.dev.: 0.0082)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.55% (0.8843 => 1.0041, std.dev.: 0.0271)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.61% (4.8288 => 5.3894, std.dev.: 0.0610)
  MultiSource/Applications/SIBsim4/SIBsim4: 10.76% (1.4195 => 1.5722, std.dev.: 0.0358)
  MultiSource/Applications/sqlite3/sqlite3: 10.20% (16.1895 => 17.8406, std.dev.: 0.1170)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.80% (9.4701 => 10.3983, std.dev.: 0.1988)
  MultiSource/Applications/ClamAV/clamscan: 8.65% (16.1821 => 17.5818, std.dev.: 0.0410)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.30% (1.8668 => 2.0218, std.dev.: 0.0408)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.96% (1.8524 => 1.9998, std.dev.: 0.0249)
  MultiSource/Applications/SPASS/SPASS: 7.41% (16.3304 => 17.5406, std.dev.: 0.1227)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.31% (14.7643 => 15.8441, std.dev.: 0.1009)
  MultiSource/Applications/oggenc/oggenc: 4.91% (5.4527 => 5.7206, std.dev.: 0.0530)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.78% (2.4999 => 2.5443, std.dev.: 0.0085)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 54.62% (0.3010 => 0.4654, std.dev.: 0.0181)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 40.69% (0.8895 => 1.2514, std.dev.: 0.0407)
  SingleSource/Benchmarks/Misc/fp-convert: 40.21% (5.6800 => 7.9639, std.dev.: 0.0184)
  SingleSource/Benchmarks/Stanford/Bubblesort: 37.59% (0.0290 => 0.0399, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/methcall: 35.06% (8.6184 => 11.6398, std.dev.: 0.0107)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 34.28% (4.4954 => 6.0365, std.dev.: 0.0942)
  SingleSource/Benchmarks/Shootout/hash: 24.96% (4.1780 => 5.2210, std.dev.: 0.1863)
  MultiSource/Applications/lambda-0_1_3/lambda: 22.96% (6.9897 => 8.5942, std.dev.: 0.0341)
  SingleSource/Benchmarks/Shootout/ary3: 21.41% (8.2895 => 10.0639, std.dev.: 0.4386)
  SingleSource/Benchmarks/Shootout-C++/matrix: 21.03% (2.8804 => 3.4861, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 19.90% (3.2482 => 3.8947, std.dev.: 0.2182)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.55% (3.7569 => 4.4915, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.76% (4.8478 => 5.6605, std.dev.: 0.0356)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.08% (4.5865 => 5.2324, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.06% (8.7510 => 9.9811, std.dev.: 0.0107)
  MultiSource/Benchmarks/Olden/tsp/tsp: 13.48% (1.4232 => 1.6150, std.dev.: 0.0275)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.02% (0.1655 => 0.1854, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout/sieve: 11.62% (6.8087 => 7.6000, std.dev.: 0.0091)
  SingleSource/Benchmarks/Shootout-C++/hash: 11.62% (0.6540 => 0.7300, std.dev.: 0.0161)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.38% (2.5283 => 2.8160, std.dev.: 0.0097)
  SingleSource/Benchmarks/Shootout/matrix: 11.01% (1.5499 => 1.7206, std.dev.: 0.0064)
  SingleSource/Benchmarks/Shootout-C++/ary3: 8.60% (2.0100 => 2.1828, std.dev.: 0.0507)
  SingleSource/Benchmarks/Misc/flops: 8.21% (9.3754 => 10.1450, std.dev.: 0.0279)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.52% (59.5643 => 64.0441, std.dev.: 0.5113)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 7.08% (2.3673 => 2.5349, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.07% (2.5458 => 2.7259, std.dev.: 0.0022)
  MultiSource/Benchmarks/llubenchmark/llu: 6.58% (2.0177 => 2.1504, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.36% (4.7982 => 5.1035, std.dev.: 0.0339)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (3.3943 => 3.6045, std.dev.: 0.0032)
  MultiSource/Applications/lua/lua: 5.83% (28.1709 => 29.8146, std.dev.: 0.2953)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.59% (5.0818 => 5.3659, std.dev.: 0.0722)
  MultiSource/Applications/siod/siod: 5.46% (3.4143 => 3.6008, std.dev.: 0.0237)
  SingleSource/Benchmarks/Dhrystone/fldry: 5.15% (0.6480 => 0.6814, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.11% (9.0122 => 9.4723, std.dev.: 0.0311)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.73% (5.1346 => 5.3775, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.61% (4.1146 => 4.3043, std.dev.: 0.0126)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.61% (1.8732 => 1.9595, std.dev.: 0.0266)
  SingleSource/Benchmarks/Misc/whetstone: 4.29% (3.4590 => 3.6073, std.dev.: 0.0240)
  MultiSource/Applications/sqlite3/sqlite3: 3.76% (4.2776 => 4.4386, std.dev.: 0.0556)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.35% (5.1006 => 5.2713, std.dev.: 0.0130)
  MultiSource/Benchmarks/Olden/bh/bh: 3.23% (2.3749 => 2.4515, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.01% (6.1397 => 6.3248, std.dev.: 0.0100)
  SingleSource/Benchmarks/McGill/chomp: 2.96% (1.0339 => 1.0645, std.dev.: 0.0021)
  MultiSource/Applications/aha/aha: 2.71% (3.4994 => 3.5944, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/richards_benchmark: 2.71% (1.3414 => 1.3777, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.70% (1.4499 => 1.4891, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.55% (4.7361 => 4.8568, std.dev.: 0.0300)
  MultiSource/Benchmarks/Olden/power/power: 2.29% (1.2248 => 1.2529, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.21% (9.6958 => 9.9096, std.dev.: 0.0379)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.03% (4.1182 => 4.2020, std.dev.: 0.0005)
  MultiSource/Applications/spiff/spiff: 1.83% (2.7749 => 2.8258, std.dev.: 0.0085)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.82% (2.0956 => 2.1337, std.dev.: 0.0109)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.09% (2.3310 => 2.3563, std.dev.: 0.0021)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -51.60% (0.0810 => 0.0392, std.dev.: 0.0025)
  MultiSource/Benchmarks/FreeBench/neural/neural: -20.69% (0.2542 => 0.2016, std.dev.: 0.0029)
  MultiSource/Benchmarks/FreeBench/mason/mason: -15.67% (0.0817 => 0.0689, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -14.00% (0.0893 => 0.0768, std.dev.: 0.0014)
  SingleSource/Benchmarks/McGill/chomp: -8.02% (0.1957 => 0.1800, std.dev.: 0.0012)
  MultiSource/Applications/lemon/lemon: -5.18% (1.2932 => 1.2262, std.dev.: 0.0228)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -67.28% (1.0845 => 0.3548, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.34% (0.3861 => 0.1377, std.dev.: 0.0092)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.12% (3.4380 => 1.4741, std.dev.: 0.0042)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -57.08% (3.8940 => 1.6713, std.dev.: 0.0054)
  MultiSource/Benchmarks/FreeBench/mason/mason: -44.95% (0.5213 => 0.2870, std.dev.: 0.0178)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -42.83% (0.3091 => 0.1767, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.47% (6.8267 => 4.5418, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -28.32% (0.4520 => 0.3240, std.dev.: 0.0132)
  MultiSource/Applications/viterbi/viterbi: -26.60% (3.4506 => 2.5327, std.dev.: 0.0161)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -25.86% (0.4111 => 0.3048, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -21.97% (0.1871 => 0.1460, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc/perlin: -20.50% (4.5691 => 3.6323, std.dev.: 0.0049)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -20.35% (0.1789 => 0.1425, std.dev.: 0.0066)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.34% (0.3279 => 0.2645, std.dev.: 0.0003)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.21% (0.0950 => 0.0777, std.dev.: 0.0031)
  MultiSource/Benchmarks/mafft/pairlocalalign: -17.78% (57.5400 => 47.3120, std.dev.: 0.9410)
  SingleSource/Benchmarks/McGill/misr: -17.57% (0.4729 => 0.3898, std.dev.: 0.0276)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -17.09% (1.9660 => 1.6301, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.81% (6.0446 => 5.0283, std.dev.: 0.0860)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.56% (6.4626 => 5.3926, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -14.28% (6.7010 => 5.7438, std.dev.: 0.0080)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.13% (3.5506 => 3.0488, std.dev.: 0.0855)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.66% (6.0602 => 5.2927, std.dev.: 0.0366)
  SingleSource/Benchmarks/Misc/mandel: -11.76% (1.0882 => 0.9602, std.dev.: 0.0237)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -11.63% (0.1040 => 0.0919, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.43% (5.0054 => 4.4835, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.18% (5.8948 => 5.2947, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -9.01% (5.0816 => 4.6237, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.65% (3.3978 => 3.1377, std.dev.: 0.0028)
  SingleSource/Benchmarks/McGill/queens: -7.57% (1.7928 => 1.6570, std.dev.: 0.0129)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.49% (13.2022 => 12.2139, std.dev.: 0.0462)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.45% (9.5512 => 8.8394, std.dev.: 0.0139)
  SingleSource/Benchmarks/Shootout/strcat: -7.38% (0.1572 => 0.1456, std.dev.: 0.0028)
  MultiSource/Applications/oggenc/oggenc: -6.85% (0.1826 => 0.1701, std.dev.: 0.0006)
  MultiSource/Applications/sgefa/sgefa: -5.93% (1.2184 => 1.1462, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.81% (3.9434 => 3.7141, std.dev.: 0.0028)
  SingleSource/Benchmarks/Dhrystone/dry: -4.77% (0.5278 => 0.5026, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.76% (3.0513 => 2.9062, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -4.72% (4.2970 => 4.0940, std.dev.: 0.0710)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.66% (5.7666 => 5.4980, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.54% (3.3618 => 3.2091, std.dev.: 0.0118)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -4.53% (1.5779 => 1.5065, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.36% (9.0356 => 8.6420, std.dev.: 0.0633)
  MultiSource/Benchmarks/Olden/em3d/em3d: -4.25% (4.5899 => 4.3947, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.24% (5.6245 => 5.3862, std.dev.: 0.0294)
  SingleSource/Benchmarks/Misc/fbench: -4.22% (4.9661 => 4.7565, std.dev.: 0.0053)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.11% (4.3713 => 4.2352, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.08% (3.3922 => 3.2877, std.dev.: 0.0151)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.44% (5.6426 => 5.5050, std.dev.: 0.0453)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.25% (35.0623 => 34.2728, std.dev.: 0.0153)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -2.00% (89.3093 => 87.5263, std.dev.: 0.0836)
  SingleSource/Benchmarks/Misc/flops-3: -1.48% (2.0809 => 2.0501, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.41% (3.8286 => 3.7747, std.dev.: 0.0114)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 3.59% (1.1288 => 1.1693, std.dev.: 0.0270)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.26% (0.0248 => 0.0230, std.dev.: 0.0047)
  MultiSource/Applications/ClamAV/clamscan: 5.15% (0.1477 => 0.1553, std.dev.: 0.0190)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.58% (0.1309 => 0.1249, std.dev.: 0.0169)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.94% (0.0613 => 0.0595, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.80% (0.0276 => 0.0260, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.23% (0.0594 => 0.0631, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.38% (0.0361 => 0.0273, std.dev.: 0.0002)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -9.78% (0.0092 => 0.0083, std.dev.: 0.0039)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -8.57% (26.9213 => 24.6138, std.dev.: 0.0828)

Report Time: 0.99s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130415/c252812e/attachment.html>


More information about the llvm-testresults mailing list