[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Apr 11 06:52:54 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10489?compare_to=10485&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10489, Order: 179272, Start Time: 2013-04-11 12:05:19, End Time: 2013-04-11 13:54:03
      To: 10485, Order: 179270, Start Time: 2013-04-11 09:25:47, End Time: 2013-04-11 11:05:46
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (13 on baseline)
Performance Regressions: 34 (89 on baseline)
Performance Improvements: 9 (51 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 19 (19 on baseline)
Unchanged Tests: 1046 (930 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 62.02% (0.0990 => 0.1604, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 58.93% (0.0896 => 0.1424, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 36.43% (0.0862 => 0.1176, std.dev.: 0.0119)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.10% (0.9059 => 1.1242, std.dev.: 0.0411)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.50% (7.2576 => 8.0198, std.dev.: 0.2122)
  MultiSource/Benchmarks/Olden/mst/mst: 9.77% (0.1321 => 0.1450, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.26% (14.9300 => 16.3131, std.dev.: 0.1842)
  MultiSource/Applications/minisat/minisat: 9.19% (0.7712 => 0.8421, std.dev.: 0.0119)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.83% (4.0862 => 4.4061, std.dev.: 0.0185)
  MultiSource/Applications/ClamAV/clamscan: 7.81% (16.6159 => 17.9134, std.dev.: 0.1782)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.52% (1.8855 => 2.0272, std.dev.: 0.0048)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.21% (45.2947 => 48.5609, std.dev.: 1.2543)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.67% (25.9472 => 27.4181, std.dev.: 0.3892)
  MultiSource/Benchmarks/Bullet/bullet: 5.55% (34.8453 => 36.7807, std.dev.: 0.1580)
  MultiSource/Applications/kimwitu++/kc: 4.93% (19.0038 => 19.9409, std.dev.: 0.3530)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: 30.46% (0.5427 => 0.7080, std.dev.: 0.0154)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.95% (1.4773 => 1.8902, std.dev.: 0.0189)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.84% (14.7787 => 17.5637, std.dev.: 0.3740)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.83% (0.0612 => 0.0715, std.dev.: 0.0007)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.96% (9.2249 => 10.6049, std.dev.: 0.0896)
  SingleSource/Benchmarks/Misc/flops-7: 14.11% (1.7218 => 1.9648, std.dev.: 0.0698)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.55% (0.3256 => 0.3567, std.dev.: 0.0094)
  SingleSource/Benchmarks/Misc/salsa20: 9.08% (9.7357 => 10.6199, std.dev.: 0.2256)
  SingleSource/Benchmarks/Misc/flops: 7.31% (8.6800 => 9.3146, std.dev.: 0.0224)
  MultiSource/Benchmarks/llubenchmark/llu: 7.17% (2.0205 => 2.1653, std.dev.: 0.0140)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.03% (61.3598 => 65.6752, std.dev.: 1.0983)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.77% (40.6959 => 43.0450, std.dev.: 0.7294)
  MultiSource/Applications/lua/lua: 4.62% (28.9492 => 30.2872, std.dev.: 0.4223)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.55% (4.3869 => 4.5426, std.dev.: 0.0132)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.27% (0.4834 => 0.4992, std.dev.: 0.0041)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.78% (0.7849 => 0.8067, std.dev.: 0.0029)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.51% (3.4365 => 3.5229, std.dev.: 0.0185)
  SingleSource/Benchmarks/Shootout-C++/lists1: 2.01% (0.5965 => 0.6085, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.43% (4.4803 => 4.5442, std.dev.: 0.0095)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: -15.91% (2.0365 => 1.7124, std.dev.: 0.0115)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.66% (2.7916 => 2.5219, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.83% (7.9650 => 7.3411, std.dev.: 0.2106)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.93% (2.4685 => 2.3715, std.dev.: 0.0239)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.38% (4.4718 => 4.3208, std.dev.: 0.0046)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.11% (1.7213 => 1.6678, std.dev.: 0.0051)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -2.35% (2.1917 => 2.1401, std.dev.: 0.0061)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.84% (2.0171 => 1.9800, std.dev.: 0.0034)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.17% (49.7670 => 49.1849, std.dev.: 0.0157)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 3.57% (1.1430 => 1.1838, std.dev.: 0.0917)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.44% (0.0227 => 0.0228, std.dev.: 0.0017)
  MultiSource/Applications/ClamAV/clamscan: 3.41% (0.1494 => 0.1545, std.dev.: 0.0077)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.23% (0.1089 => 0.1244, std.dev.: 0.0234)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 800.00% (0.0001 => 0.0009, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.19% (0.0589 => 0.0529, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.26% (0.0258 => 0.0247, std.dev.: 0.0034)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 181.82% (0.0011 => 0.0031, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.14% (0.0546 => 0.0585, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.37% (0.0272 => 0.0273, std.dev.: 0.0056)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002)
  SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -25.51% (0.0098 => 0.0073, std.dev.: 0.0040)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.35% (24.7208 => 24.6334, std.dev.: 0.0463)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002)
  MultiSource/Applications/lemon/lemon: -16.75% (1.1794 => 0.9818, std.dev.: 0.1334)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.52% (0.4125 => 0.4394, std.dev.: 0.0077)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -15.69% (0.0663 => 0.0559, std.dev.: 0.0159)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.59% (1.1660 => 1.1845, std.dev.: 0.0232)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -7.70% (1.6803 => 1.5510, std.dev.: 0.0124)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.58% (29.7937 => 29.3217, std.dev.: 2.2373)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0038)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: 33.33% (0.0006 => 0.0008, std.dev.: 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 64.34% (0.0976 => 0.1604, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 57.35% (0.0905 => 0.1424, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 37.38% (0.0856 => 0.1176, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 31.57% (1.0687 => 1.4061, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 31.57% (1.0507 => 1.3824, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.21% (1.0958 => 1.4378, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.80% (1.0418 => 1.3627, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.46% (1.0617 => 1.3851, std.dev.: 0.0455)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 29.49% (1.1023 => 1.4274, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.46% (1.1428 => 1.4795, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 29.38% (1.1209 => 1.4502, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.12% (1.0528 => 1.3594, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.00% (1.0864 => 1.4015, std.dev.: 0.0600)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 28.87% (1.1626 => 1.4982, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 28.41% (1.1744 => 1.5081, std.dev.: 0.0728)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.05% (1.0526 => 1.3479, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 28.04% (1.0951 => 1.4022, std.dev.: 0.0454)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 27.96% (1.1699 => 1.4970, std.dev.: 0.0490)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.55% (1.2270 => 1.5650, std.dev.: 0.0216)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.13% (0.8843 => 1.1242, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.92% (1.0890 => 1.3822, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 26.06% (1.3046 => 1.6446, std.dev.: 0.0238)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 25.30% (1.1727 => 1.4694, std.dev.: 0.0462)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 24.55% (1.2537 => 1.5615, std.dev.: 0.0580)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 24.29% (1.2419 => 1.5435, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 24.09% (1.2566 => 1.5593, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 24.03% (1.2929 => 1.6036, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 23.86% (1.3313 => 1.6489, std.dev.: 0.0866)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 23.85% (1.2925 => 1.6008, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 23.83% (1.2835 => 1.5894, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 23.71% (1.2853 => 1.5900, std.dev.: 0.0758)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 23.65% (1.3357 => 1.6516, std.dev.: 0.0386)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 23.52% (1.2723 => 1.5715, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.19% (1.3491 => 1.6620, std.dev.: 0.0364)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 23.09% (1.3692 => 1.6854, std.dev.: 0.0495)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 22.75% (1.2704 => 1.5594, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 22.73% (1.3638 => 1.6738, std.dev.: 0.0444)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.15% (1.4622 => 1.7861, std.dev.: 0.0529)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.08% (1.4005 => 1.6957, std.dev.: 0.0527)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.06% (23.8286 => 27.4181, std.dev.: 0.3892)
  MultiSource/Benchmarks/McCat/05-eks/eks: 13.96% (0.4798 => 0.5468, std.dev.: 0.0206)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.96% (7.0997 => 8.0198, std.dev.: 0.2122)
  MultiSource/Applications/minisat/minisat: 11.48% (0.7554 => 0.8421, std.dev.: 0.0119)
  MultiSource/Applications/ClamAV/clamscan: 10.70% (16.1821 => 17.9134, std.dev.: 0.1782)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.49% (14.7643 => 16.3131, std.dev.: 0.1842)
  MultiSource/Benchmarks/Olden/mst/mst: 9.77% (0.1321 => 0.1450, std.dev.: 0.0043)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.44% (1.8524 => 2.0272, std.dev.: 0.0048)
  MultiSource/Benchmarks/Bullet/bullet: 8.40% (33.9296 => 36.7807, std.dev.: 0.1580)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.29% (4.0688 => 4.4061, std.dev.: 0.0185)
  MultiSource/Applications/kimwitu++/kc: 8.10% (18.4474 => 19.9409, std.dev.: 0.3530)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.52% (1.8668 => 1.9886, std.dev.: 0.0392)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 3.73% (0.3355 => 0.3480, std.dev.: 0.0031)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 40.40% (5.6800 => 7.9749, std.dev.: 0.0864)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 38.70% (12.6632 => 17.5637, std.dev.: 0.3740)
  SingleSource/Benchmarks/Shootout/sieve: 28.30% (6.8087 => 8.7358, std.dev.: 0.0194)
  SingleSource/Benchmarks/Shootout/hash: 26.46% (4.1780 => 5.2835, std.dev.: 0.1121)
  MultiSource/Applications/lambda-0_1_3/lambda: 16.83% (6.9897 => 8.1661, std.dev.: 0.1236)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.49% (9.1037 => 10.6049, std.dev.: 0.0896)
  SingleSource/Benchmarks/Misc/salsa20: 16.05% (9.1513 => 10.6199, std.dev.: 0.2256)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.01% (3.7569 => 4.3208, std.dev.: 0.0046)
  SingleSource/Benchmarks/Shootout-C++/hash: 14.24% (0.6540 => 0.7471, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.11% (8.7510 => 9.9857, std.dev.: 0.0162)
  MultiSource/Benchmarks/Olden/tsp/tsp: 13.81% (1.4232 => 1.6198, std.dev.: 0.0649)
  SingleSource/Benchmarks/Shootout/matrix: 10.48% (1.5499 => 1.7124, std.dev.: 0.0115)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 10.26% (59.5643 => 65.6752, std.dev.: 1.0983)
  MultiSource/Applications/hexxagon/hexxagon: 9.81% (14.4795 => 15.8999, std.dev.: 0.0510)
  SingleSource/Benchmarks/Shootout-C++/ary3: 7.90% (2.0100 => 2.1687, std.dev.: 0.0551)
  MultiSource/Applications/lua/lua: 7.51% (28.1709 => 30.2872, std.dev.: 0.4223)
  MultiSource/Benchmarks/llubenchmark/llu: 7.32% (2.0177 => 2.1653, std.dev.: 0.0140)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.48% (3.3943 => 3.6141, std.dev.: 0.0024)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.70% (1.8732 => 1.9800, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/richards_benchmark: 5.58% (1.3414 => 1.4163, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.93% (5.1346 => 5.3878, std.dev.: 0.0400)
  MultiSource/Applications/spiff/spiff: 4.74% (2.7749 => 2.9064, std.dev.: 0.0144)
  SingleSource/Benchmarks/Shootout/lists: 4.66% (7.2055 => 7.5413, std.dev.: 0.1018)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.10% (5.0818 => 5.2901, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.84% (5.1006 => 5.2967, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.36% (4.7982 => 4.9592, std.dev.: 0.0470)
  SingleSource/Benchmarks/Misc/whetstone: 3.25% (3.4590 => 3.5713, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.10% (6.1397 => 6.3302, std.dev.: 0.0058)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.08% (3.7953 => 3.9123, std.dev.: 0.0049)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.99% (3.4205 => 3.5229, std.dev.: 0.0185)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.66% (4.4250 => 4.5426, std.dev.: 0.0132)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.66% (1.0088 => 1.0356, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.35% (9.6958 => 9.9241, std.dev.: 0.0311)
  MultiSource/Benchmarks/Olden/power/power: 2.31% (1.2248 => 1.2531, std.dev.: 0.0089)
  MultiSource/Applications/aha/aha: 2.31% (3.4994 => 3.5802, std.dev.: 0.0165)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.12% (2.0956 => 2.1401, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.03% (4.1182 => 4.2017, std.dev.: 0.0007)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -51.98% (0.0810 => 0.0389, std.dev.: 0.0107)
  SingleSource/Benchmarks/McGill/chomp: -10.37% (0.1957 => 0.1754, std.dev.: 0.0050)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.57% (0.3861 => 0.1368, std.dev.: 0.0088)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -57.10% (3.8940 => 1.6705, std.dev.: 0.0031)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.05% (3.4380 => 1.4766, std.dev.: 0.0252)
  MultiSource/Benchmarks/FreeBench/mason/mason: -43.99% (0.5213 => 0.2920, std.dev.: 0.0005)
  MultiSource/Benchmarks/FreeBench/neural/neural: -34.72% (1.0845 => 0.7080, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.43% (6.8267 => 4.5442, std.dev.: 0.0095)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -33.19% (0.1871 => 0.1250, std.dev.: 0.0204)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -24.27% (0.2316 => 0.1754, std.dev.: 0.0012)
  MultiSource/Applications/viterbi/viterbi: -23.25% (3.4506 => 2.6485, std.dev.: 0.0393)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.54% (5.8948 => 4.6248, std.dev.: 0.0640)
  SingleSource/Benchmarks/Misc/perlin: -19.49% (4.5691 => 3.6787, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -19.20% (3.5506 => 2.8690, std.dev.: 0.1167)
  MultiSource/Benchmarks/McCat/18-imp/imp: -18.36% (0.1465 => 0.1196, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -17.60% (6.0446 => 4.9805, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.55% (6.4626 => 5.3930, std.dev.: 0.0012)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -16.54% (1.9660 => 1.6409, std.dev.: 0.0997)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -15.03% (6.7010 => 5.6939, std.dev.: 0.0403)
  SingleSource/Benchmarks/McGill/misr: -14.78% (0.4729 => 0.4030, std.dev.: 0.0008)
  MultiSource/Benchmarks/mafft/pairlocalalign: -14.52% (57.5400 => 49.1849, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.78% (6.0602 => 5.2855, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.99% (9.0122 => 7.9320, std.dev.: 0.0500)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.36% (5.0054 => 4.4867, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -9.01% (5.0816 => 4.6236, std.dev.: 0.0595)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -8.57% (0.3091 => 0.2826, std.dev.: 0.0083)
  MultiSource/Applications/oggenc/oggenc: -8.49% (0.1826 => 0.1671, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -7.90% (2.5458 => 2.3446, std.dev.: 0.0162)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.83% (89.3093 => 82.3125, std.dev.: 0.1458)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.67% (9.5512 => 8.8182, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.63% (3.3978 => 3.1386, std.dev.: 0.0331)
  SingleSource/Benchmarks/McGill/queens: -7.61% (1.7928 => 1.6564, std.dev.: 0.0014)
  SingleSource/Benchmarks/Stanford/Puzzle: -7.58% (0.1650 => 0.1525, std.dev.: 0.0026)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -7.47% (0.4111 => 0.3804, std.dev.: 0.0077)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.43% (13.2022 => 12.2218, std.dev.: 0.0781)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.73% (3.9434 => 3.7173, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.84% (3.0513 => 2.9036, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.71% (3.3618 => 3.2036, std.dev.: 0.0343)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.64% (5.7666 => 5.4988, std.dev.: 0.0425)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.64% (2.4484 => 2.3347, std.dev.: 0.0298)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.60% (5.6245 => 5.3660, std.dev.: 0.0056)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -4.47% (1.5779 => 1.5073, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.31% (4.4289 => 4.2378, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.21% (9.0356 => 8.6551, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/fbench: -4.14% (4.9661 => 4.7604, std.dev.: 0.0195)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.72% (0.3093 => 0.2978, std.dev.: 0.0006)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.67% (0.5182 => 0.4992, std.dev.: 0.0041)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.95% (3.8286 => 3.7156, std.dev.: 0.0070)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.06% (35.0623 => 34.3411, std.dev.: 0.1273)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.22% (3.6942 => 3.6490, std.dev.: 0.0035)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.19% (1.3158 => 1.3002, std.dev.: 0.0052)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 4.87% (1.1288 => 1.1838, std.dev.: 0.0917)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.06% (0.0248 => 0.0228, std.dev.: 0.0017)
  MultiSource/Applications/ClamAV/clamscan: 4.60% (0.1477 => 0.1545, std.dev.: 0.0077)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.97% (0.1309 => 0.1244, std.dev.: 0.0234)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.70% (0.0613 => 0.0529, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.51% (0.0276 => 0.0247, std.dev.: 0.0034)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.52% (0.0594 => 0.0585, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.38% (0.0361 => 0.0273, std.dev.: 0.0056)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -20.65% (0.0092 => 0.0073, std.dev.: 0.0040)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -8.50% (26.9213 => 24.6334, std.dev.: 0.0463)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130411/053f4de4/attachment.html>


More information about the llvm-testresults mailing list