[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Apr 3 11:55:20 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10168?compare_to=10164&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10168, Order: 178666, Start Time: 2013-04-03 17:04:20, End Time: 2013-04-03 18:56:19
      To: 10164, Order: 178656, Start Time: 2013-04-03 14:54:10, End Time: 2013-04-03 16:43:00
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (12 on baseline)
Performance Regressions: 49 (114 on baseline)
Performance Improvements: 2 (44 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 20 (20 on baseline)
Unchanged Tests: 1037 (912 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-18-LoopBug: 74.47% (0.0141 => 0.0246, std.dev.: 0.0011)
  SingleSource/Regression/C/sumarraymalloc: 64.75% (0.0400 => 0.0659, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 34.83% (0.6801 => 0.9170, std.dev.: 0.0822)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.67% (1.3342 => 1.5833, std.dev.: 0.0533)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.89% (0.0989 => 0.1156, std.dev.: 0.0049)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 10.55% (0.2209 => 0.2442, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5823 => 1.7406, std.dev.: 0.0168)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.43% (4.6431 => 5.0810, std.dev.: 0.0446)
  MultiSource/Applications/kimwitu++/kc: 9.03% (18.9153 => 20.6228, std.dev.: 0.1206)
  MultiSource/Applications/JM/ldecod/ldecod: 8.12% (7.6465 => 8.2674, std.dev.: 0.0720)
  MultiSource/Benchmarks/McCat/09-vor/vor: 7.49% (0.3525 => 0.3789, std.dev.: 0.0051)
  MultiSource/Applications/sqlite3/sqlite3: 7.17% (16.9473 => 18.1620, std.dev.: 0.1464)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.72% (1.4792 => 1.5786, std.dev.: 0.0045)
  MultiSource/Applications/oggenc/oggenc: 6.60% (5.5451 => 5.9109, std.dev.: 0.0078)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.48% (0.1543 => 0.1643, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.44% (1.5276 => 1.6260, std.dev.: 0.0374)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.08% (10.7932 => 11.4497, std.dev.: 0.0804)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3805 => 0.4022, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 5.70% (0.2124 => 0.2245, std.dev.: 0.0018)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.27% (2.5946 => 2.7314, std.dev.: 0.0444)
  SingleSource/Benchmarks/Shootout-C++/matrix: 5.08% (0.2324 => 0.2442, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.95% (1.5337 => 1.6096, std.dev.: 0.0061)
  MultiSource/Applications/JM/lencod/lencod: 4.92% (17.5181 => 18.3795, std.dev.: 0.2046)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3717 => 0.3898, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.46% (1.4964 => 1.5631, std.dev.: 0.0191)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.84% (1.5185 => 1.5768, std.dev.: 0.0226)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.86% (0.7793 => 0.8016, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 82.34% (0.1359 => 0.2478, std.dev.: 0.0152)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 44.34% (0.8673 => 1.2519, std.dev.: 0.0293)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 39.01% (3.1238 => 4.3423, std.dev.: 0.2554)
  SingleSource/Benchmarks/Shootout/heapsort: 38.74% (3.1307 => 4.3436, std.dev.: 0.2292)
  MultiSource/Benchmarks/Olden/bisort/bisort: 38.70% (0.6786 => 0.9412, std.dev.: 0.0197)
  SingleSource/Benchmarks/Shootout-C++/fibo: 15.60% (4.1136 => 4.7554, std.dev.: 0.0425)
  SingleSource/Benchmarks/Shootout-C++/methcall: 7.74% (8.4869 => 9.1435, std.dev.: 0.0406)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.06% (9.0443 => 9.6828, std.dev.: 0.1528)
  SingleSource/Benchmarks/Misc/flops-7: 6.97% (1.9314 => 2.0661, std.dev.: 0.0332)
  SingleSource/Benchmarks/Shootout-C++/ary3: 6.66% (2.1023 => 2.2424, std.dev.: 0.0254)
  MultiSource/Benchmarks/Bullet/bullet: 6.43% (6.9275 => 7.3728, std.dev.: 0.1115)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.05% (0.3042 => 0.3226, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.85% (4.0393 => 4.2352, std.dev.: 0.0373)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.95% (2.3694 => 2.4630, std.dev.: 0.0355)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.92% (41.9926 => 43.2185, std.dev.: 0.1484)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.82% (4.5359 => 4.6637, std.dev.: 0.0234)
  MultiSource/Applications/lua/lua: 2.67% (28.8127 => 29.5816, std.dev.: 0.2901)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 2.65% (1.6352 => 1.6786, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/bh/bh: 2.30% (2.3524 => 2.4065, std.dev.: 0.0109)
  SingleSource/Benchmarks/Shootout/methcall: 2.15% (8.5039 => 8.6867, std.dev.: 0.0163)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.05% (4.0194 => 4.1017, std.dev.: 0.0291)
  SingleSource/Benchmarks/Shootout/lists: 1.26% (7.4216 => 7.5154, std.dev.: 0.0135)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Puzzle: -11.88% (0.1692 => 0.1491, std.dev.: 0.0054)
  SingleSource/Benchmarks/McGill/misr: -4.49% (0.4813 => 0.4597, std.dev.: 0.0017)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.98% (1.1632 => 1.1746, std.dev.: 0.2047)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.66% (0.0212 => 0.0224, std.dev.: 0.0046)
  MultiSource/Applications/ClamAV/clamscan: -0.75% (0.1469 => 0.1458, std.dev.: 0.0216)
  MultiSource/Applications/lemon/lemon: 6.52% (1.1270 => 1.2005, std.dev.: 0.3821)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.33% (0.1154 => 0.1104, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.71% (0.0566 => 0.0587, std.dev.: 0.0157)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.45% (0.0257 => 0.0243, std.dev.: 0.0035)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.33% (0.0030 => 0.0031, std.dev.: 0.0010)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0013)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.44% (0.0593 => 0.0649, std.dev.: 0.0091)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.76% (0.0243 => 0.0274, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: -37.50% (0.0008 => 0.0005, std.dev.: 0.0002)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -21.71% (0.0129 => 0.0101, std.dev.: 0.0055)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.68% (24.8525 => 24.6842, std.dev.: 0.2065)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0007)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.25% (0.4125 => 0.4383, std.dev.: 0.0976)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.16% (0.0663 => 0.0589, std.dev.: 0.0106)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.16% (1.1660 => 1.1912, std.dev.: 0.0385)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -21.76% (1.6803 => 1.3146, std.dev.: 0.0889)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.42% (29.7937 => 30.2158, std.dev.: 1.8847)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 800.00% (0.0001 => 0.0009, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 40.79% (0.0331 => 0.0466, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 35.35% (0.6775 => 0.9170, std.dev.: 0.0822)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.39% (1.0617 => 1.3843, std.dev.: 0.1027)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 28.24% (1.0951 => 1.4044, std.dev.: 0.0591)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 27.63% (1.3638 => 1.7406, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 26.95% (1.0418 => 1.3226, std.dev.: 0.0580)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.92% (1.1209 => 1.4227, std.dev.: 0.0499)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 25.62% (1.2566 => 1.5786, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.47% (1.0528 => 1.3210, std.dev.: 0.0226)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.00% (1.1626 => 1.4533, std.dev.: 0.0753)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.75% (1.0507 => 1.3107, std.dev.: 0.0684)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.09% (1.0958 => 1.3598, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 23.76% (1.0890 => 1.3478, std.dev.: 0.0238)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.68% (1.1428 => 1.4134, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 23.38% (1.3046 => 1.6096, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.19% (1.1023 => 1.3579, std.dev.: 0.0529)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 23.12% (1.0526 => 1.2960, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 23.12% (1.2929 => 1.5918, std.dev.: 0.0658)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.86% (1.2723 => 1.5631, std.dev.: 0.0191)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.78% (1.2270 => 1.5065, std.dev.: 0.0550)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 22.65% (1.3451 => 1.6497, std.dev.: 0.0991)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.07% (0.0947 => 0.1156, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 22.00% (1.2925 => 1.5768, std.dev.: 0.0226)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 21.73% (1.3357 => 1.6260, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.71% (1.2835 => 1.5622, std.dev.: 0.0529)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.58% (1.2537 => 1.5117, std.dev.: 0.0279)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.31% (1.1699 => 1.4075, std.dev.: 0.0121)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.58% (1.3240 => 1.5833, std.dev.: 0.0533)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 19.48% (1.4622 => 1.7470, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.82% (1.2419 => 1.4756, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 17.30% (1.2704 => 1.4902, std.dev.: 0.0564)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.30% (23.8286 => 27.7135, std.dev.: 0.7797)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 15.62% (0.2112 => 0.2442, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 15.27% (1.4005 => 1.6143, std.dev.: 0.0772)
  MultiSource/Applications/JM/ldecod/ldecod: 14.09% (7.2467 => 8.2674, std.dev.: 0.0720)
  MultiSource/Benchmarks/McCat/09-vor/vor: 12.84% (0.3358 => 0.3789, std.dev.: 0.0051)
  MultiSource/Applications/sqlite3/sqlite3: 12.18% (16.1895 => 18.1620, std.dev.: 0.1464)
  MultiSource/Applications/kimwitu++/kc: 11.79% (18.4474 => 20.6228, std.dev.: 0.1206)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.61% (0.7182 => 0.8016, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.59% (4.5532 => 5.0810, std.dev.: 0.0446)
  MultiSource/Benchmarks/McCat/08-main/main: 11.49% (0.2846 => 0.3173, std.dev.: 0.0118)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.6853 => 0.7560, std.dev.: 0.0271)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.18% (7.0997 => 7.8221, std.dev.: 0.2602)
  MultiSource/Applications/JM/lencod/lencod: 9.92% (16.7203 => 18.3795, std.dev.: 0.2046)
  MultiSource/Benchmarks/PAQ8p/paq8p: 9.26% (2.4999 => 2.7314, std.dev.: 0.0444)
  MultiSource/Applications/oggenc/oggenc: 8.40% (5.4527 => 5.9109, std.dev.: 0.0078)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 8.34% (0.3598 => 0.3898, std.dev.: 0.0012)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.88% (10.6134 => 11.4497, std.dev.: 0.0804)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.18% (0.1533 => 0.1643, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.31% (2.5524 => 2.7135, std.dev.: 0.0547)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3793 => 0.4022, std.dev.: 0.0065)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.3887 => 0.4112, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 5.40% (0.2130 => 0.2245, std.dev.: 0.0018)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.42% (0.4051 => 0.4230, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/matrix: 4.36% (0.2340 => 0.2442, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.44% (0.3900 => 0.4034, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 80.61% (0.1372 => 0.2478, std.dev.: 0.0152)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 55.15% (0.3010 => 0.4670, std.dev.: 0.0399)
  SingleSource/Benchmarks/Shootout-C++/ary2: 40.76% (0.0314 => 0.0442, std.dev.: 0.0025)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 40.74% (0.8895 => 1.2519, std.dev.: 0.0293)
  MultiSource/Benchmarks/MallocBench/gs/gs: 40.30% (0.0608 => 0.0853, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout/heapsort: 38.31% (3.1404 => 4.3436, std.dev.: 0.2292)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.31% (12.6632 => 17.3877, std.dev.: 0.5544)
  MultiSource/Benchmarks/Olden/bisort/bisort: 35.02% (0.6971 => 0.9412, std.dev.: 0.0197)
  MultiSource/Benchmarks/mafft/pairlocalalign: 34.29% (57.5400 => 77.2688, std.dev.: 0.4248)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 33.68% (3.2482 => 4.3423, std.dev.: 0.2554)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.96% (8.7510 => 11.6352, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout/sieve: 27.29% (6.8087 => 8.6665, std.dev.: 0.0450)
  SingleSource/Benchmarks/Shootout-C++/matrix: 21.78% (2.8804 => 3.5078, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.98% (4.4289 => 5.3581, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.21% (9.6958 => 11.6553, std.dev.: 0.0256)
  SingleSource/Benchmarks/Misc/salsa20: 19.92% (9.1513 => 10.9739, std.dev.: 0.3135)
  SingleSource/Benchmarks/Misc/fp-convert: 16.42% (5.6800 => 6.6129, std.dev.: 0.2215)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 14.95% (2.9511 => 3.3923, std.dev.: 0.0363)
  SingleSource/Benchmarks/Shootout/matrix: 13.20% (1.5499 => 1.7545, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.89% (4.7982 => 5.3689, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/ary3: 11.56% (2.0100 => 2.2424, std.dev.: 0.0254)
  MultiSource/Applications/sgefa/sgefa: 11.06% (1.2184 => 1.3532, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.40% (6.4626 => 7.1346, std.dev.: 0.1922)
  MultiSource/Applications/hexxagon/hexxagon: 9.58% (14.4795 => 15.8673, std.dev.: 0.0222)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.60% (43.6112 => 47.3607, std.dev.: 1.2797)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.46% (90.5803 => 98.2435, std.dev.: 1.0892)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.96% (59.5643 => 63.7076, std.dev.: 0.7363)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.73% (6.9897 => 7.4604, std.dev.: 0.0166)
  SingleSource/Benchmarks/McGill/chomp: 6.73% (1.0339 => 1.1035, std.dev.: 0.0211)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.64% (1.8732 => 1.9976, std.dev.: 0.0128)
  SingleSource/Benchmarks/Misc/flops-7: 6.51% (1.9399 => 2.0661, std.dev.: 0.0332)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.36% (9.1037 => 9.6828, std.dev.: 0.1528)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.12% (3.3978 => 3.6058, std.dev.: 0.0231)
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.09% (8.6184 => 9.1435, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.75% (5.1006 => 5.3937, std.dev.: 0.0178)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.60% (2.3323 => 2.4630, std.dev.: 0.0355)
  SingleSource/Benchmarks/Misc/richards_benchmark: 5.28% (1.3414 => 1.4122, std.dev.: 0.0049)
  MultiSource/Applications/lua/lua: 5.01% (28.1709 => 29.5816, std.dev.: 0.2901)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.71% (4.0968 => 4.2897, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.68% (4.5865 => 4.8012, std.dev.: 0.0080)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.57% (0.3085 => 0.3226, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.41% (41.3934 => 43.2185, std.dev.: 0.1484)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.33% (23.4908 => 24.5091, std.dev.: 0.3764)
  SingleSource/Benchmarks/Shootout/lists: 4.30% (7.2055 => 7.5154, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.64% (4.1182 => 4.2683, std.dev.: 0.0521)
  MultiSource/Applications/siod/siod: 3.49% (3.4143 => 3.5336, std.dev.: 0.0382)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.30% (3.7953 => 3.9204, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (5.0054 => 5.1566, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (4.1146 => 4.2352, std.dev.: 0.0373)
  SingleSource/Benchmarks/Shootout/methcall: 2.63% (8.4644 => 8.6867, std.dev.: 0.0163)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.57% (1.5783 => 1.6188, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.55% (4.7906 => 4.9127, std.dev.: 0.0271)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.91% (4.0247 => 4.1017, std.dev.: 0.0291)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.80% (2.7893 => 2.8396, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.46% (2.0956 => 2.1263, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.39% (3.0513 => 3.0936, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.37% (3.6942 => 3.7447, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/bh/bh: 1.33% (2.3749 => 2.4065, std.dev.: 0.0109)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -18.64% (0.0810 => 0.0659, std.dev.: 0.0011)
  SingleSource/Benchmarks/Linpack/linpack-pc: -7.71% (0.2751 => 0.2539, std.dev.: 0.0044)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -63.64% (0.3861 => 0.1404, std.dev.: 0.0072)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.80% (3.4380 => 1.4508, std.dev.: 0.0045)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -55.59% (3.8940 => 1.7292, std.dev.: 0.0190)
  MultiSource/Benchmarks/FreeBench/neural/neural: -49.75% (1.0845 => 0.5450, std.dev.: 0.1018)
  MultiSource/Benchmarks/FreeBench/mason/mason: -44.79% (0.5213 => 0.2878, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.59% (0.1871 => 0.1336, std.dev.: 0.0090)
  MultiSource/Benchmarks/McCat/18-imp/imp: -27.10% (0.1465 => 0.1068, std.dev.: 0.0102)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -22.71% (0.2316 => 0.1790, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -22.25% (7.1548 => 5.5627, std.dev.: 0.2985)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.40% (0.3279 => 0.2610, std.dev.: 0.0026)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -18.05% (0.1789 => 0.1466, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -17.86% (0.0756 => 0.0621, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -16.80% (3.5506 => 2.9540, std.dev.: 0.2229)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -14.62% (1.9660 => 1.6786, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (9.0122 => 7.9640, std.dev.: 0.0088)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -9.83% (0.4111 => 0.3707, std.dev.: 0.0006)
  SingleSource/Benchmarks/Stanford/Puzzle: -9.64% (0.1650 => 0.1491, std.dev.: 0.0054)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -9.42% (9.5512 => 8.6516, std.dev.: 0.1319)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.55% (3.4205 => 3.1281, std.dev.: 0.0867)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -8.35% (0.3091 => 0.2833, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -8.08% (2.5458 => 2.3401, std.dev.: 0.0035)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.91% (13.2022 => 12.1574, std.dev.: 0.0515)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.61% (89.3093 => 82.5087, std.dev.: 0.2716)
  SingleSource/Benchmarks/McGill/queens: -7.52% (1.7928 => 1.6580, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -7.38% (3.7569 => 3.4797, std.dev.: 0.0027)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.20% (3.9434 => 3.6988, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.69% (5.8948 => 5.5595, std.dev.: 0.0077)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -5.59% (0.4368 => 0.4124, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -5.49% (0.2167 => 0.2048, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.78% (0.3093 => 0.2945, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.68% (6.0602 => 5.8369, std.dev.: 0.0585)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.55% (3.3618 => 3.2424, std.dev.: 0.0230)
  SingleSource/Benchmarks/Linpack/linpack-pc: -3.16% (52.8418 => 51.1729, std.dev.: 0.6197)
  SingleSource/Benchmarks/McGill/misr: -2.79% (0.4729 => 0.4597, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.28% (4.3713 => 4.2715, std.dev.: 0.0078)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.17% (3.8286 => 3.7454, std.dev.: 0.0013)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.05% (0.6582 => 0.6447, std.dev.: 0.0019)
  MultiSource/Applications/JM/lencod/lencod: -1.90% (7.1542 => 7.0182, std.dev.: 0.0304)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.83% (1.1828 => 1.1612, std.dev.: 0.0065)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.53% (4.7361 => 4.6637, std.dev.: 0.0234)
  SingleSource/Benchmarks/Misc/flops-3: -1.45% (2.0809 => 2.0508, std.dev.: 0.0043)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (2.5864 => 2.5588, std.dev.: 0.0090)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 4.06% (1.1288 => 1.1746, std.dev.: 0.2047)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.68% (0.0248 => 0.0224, std.dev.: 0.0046)
  MultiSource/Applications/ClamAV/clamscan: -1.29% (0.1477 => 0.1458, std.dev.: 0.0216)
  MultiSource/Applications/lemon/lemon: 1.79% (1.1794 => 1.2005, std.dev.: 0.3821)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -15.66% (0.1309 => 0.1104, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.24% (0.0613 => 0.0587, std.dev.: 0.0157)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.96% (0.0276 => 0.0243, std.dev.: 0.0035)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0010)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0013)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.26% (0.0594 => 0.0649, std.dev.: 0.0091)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.10% (0.0361 => 0.0274, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 9.78% (0.0092 => 0.0101, std.dev.: 0.0055)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -8.31% (26.9213 => 24.6842, std.dev.: 0.2065)

Report Time: 1.26s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130403/ba8a5700/attachment.html>


More information about the llvm-testresults mailing list