[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Mar 25 21:41:03 PDT 2013


http://llvm.org/perf/db_default/v4/nts/9827?compare_to=9822&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9827, Order: 177968, Start Time: 2013-03-26 02:56:26, End Time: 2013-03-26 04:41:54
      To: 9822, Order: 177948, Start Time: 2013-03-26 00:44:34, End Time: 2013-03-26 02:37:05
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (3 on baseline)
Performance Regressions: 4 (60 on baseline)
Performance Improvements: 107 (41 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 30 (29 on baseline)
Unchanged Tests: 967 (968 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/city/city: 40.85% (0.0355 => 0.0500, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 19.33% (3.2235 => 3.8466, std.dev.: 0.0947)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.88% (1.7476 => 1.8678, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout-C++/random: 1.60% (2.4308 => 2.4698, std.dev.: 0.0026)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/member-function-pointers: -47.00% (0.0383 => 0.0203, std.dev.: 0.0008)
  SingleSource/Regression/C++/EH/exception_spec_test: -42.62% (0.0549 => 0.0315, std.dev.: 0.0022)
  SingleSource/UnitTests/2003-05-12-MinIntProblem: -42.48% (0.0266 => 0.0153, std.dev.: 0.0005)
  SingleSource/Regression/C++/EH/simple_rethrow: -41.85% (0.0368 => 0.0214, std.dev.: 0.0015)
  SingleSource/Regression/C++/BuiltinTypeInfo: -41.46% (0.0316 => 0.0185, std.dev.: 0.0014)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -40.95% (0.3619 => 0.2137, std.dev.: 0.0068)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: -40.93% (0.0259 => 0.0153, std.dev.: 0.0041)
  SingleSource/Regression/C++/EH/ConditionalExpr: -39.65% (0.0343 => 0.0207, std.dev.: 0.0011)
  SingleSource/Regression/C/compare: -39.56% (0.0364 => 0.0220, std.dev.: 0.0010)
  SingleSource/Regression/C++/short_circuit_dtor: -39.53% (0.0301 => 0.0182, std.dev.: 0.0011)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -38.64% (0.0264 => 0.0162, std.dev.: 0.0022)
  SingleSource/UnitTests/stmtexpr: -38.59% (0.0311 => 0.0191, std.dev.: 0.0005)
  SingleSource/UnitTests/initp1: -38.40% (0.0763 => 0.0470, std.dev.: 0.0020)
  SingleSource/Regression/C/sumarraymalloc: -38.35% (0.0631 => 0.0389, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -38.27% (0.0614 => 0.0379, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/random: -37.17% (0.0495 => 0.0311, std.dev.: 0.0012)
  SingleSource/UnitTests/SignlessTypes/rem: -36.74% (0.1870 => 0.1183, std.dev.: 0.0192)
  SingleSource/UnitTests/2006-01-23-UnionInit: -35.02% (0.0414 => 0.0269, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -34.71% (0.1478 => 0.0965, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -33.78% (0.1273 => 0.0843, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -33.49% (0.1296 => 0.0862, std.dev.: 0.0003)
  MultiSource/Benchmarks/Olden/em3d/em3d: -21.88% (0.2500 => 0.1953, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: -21.60% (0.1241 => 0.0973, std.dev.: 0.0047)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -20.26% (0.1747 => 0.1393, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -19.62% (0.1198 => 0.0963, std.dev.: 0.0003)
  MultiSource/Applications/Burg/burg: -19.61% (1.7857 => 1.4355, std.dev.: 0.0143)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.15% (1.6541 => 1.3373, std.dev.: 0.0126)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -17.00% (0.1688 => 0.1401, std.dev.: 0.0012)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.58% (1.1090 => 0.9473, std.dev.: 0.0242)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -14.49% (0.3982 => 0.3405, std.dev.: 0.0179)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -13.90% (0.0856 => 0.0737, std.dev.: 0.0002)
  MultiSource/Applications/viterbi/viterbi: -13.27% (0.2004 => 0.1738, std.dev.: 0.0039)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.56% (0.7915 => 0.7000, std.dev.: 0.0095)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -10.29% (1.0194 => 0.9145, std.dev.: 0.0058)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -10.25% (6.0147 => 5.3982, std.dev.: 0.0561)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.65% (0.1171 => 0.1058, std.dev.: 0.0007)
  MultiSource/Applications/JM/lencod/lencod: -9.20% (19.2352 => 17.4659, std.dev.: 0.1776)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -9.05% (0.1923 => 0.1749, std.dev.: 0.0057)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -8.94% (0.3065 => 0.2791, std.dev.: 0.0005)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -8.53% (1.2351 => 1.1297, std.dev.: 0.0048)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -7.96% (0.2826 => 0.2601, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -7.07% (0.2292 => 0.2130, std.dev.: 0.0047)
  MultiSource/Benchmarks/MallocBench/gs/gs: -6.94% (4.9615 => 4.6174, std.dev.: 0.0382)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.86% (0.1837 => 0.1711, std.dev.: 0.0030)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.61% (0.4477 => 0.4181, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.45% (1.1433 => 1.0695, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.41% (1.2152 => 1.1373, std.dev.: 0.0295)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.27% (0.2075 => 0.1945, std.dev.: 0.0038)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -6.17% (1.2068 => 1.1323, std.dev.: 0.0243)
  MultiSource/Applications/oggenc/oggenc: -6.00% (5.8770 => 5.5242, std.dev.: 0.0543)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.95% (0.2706 => 0.2545, std.dev.: 0.0025)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.91% (0.3130 => 0.2945, std.dev.: 0.0011)
  MultiSource/Applications/minisat/minisat: -5.87% (0.8230 => 0.7747, std.dev.: 0.0045)
  MultiSource/Applications/kimwitu++/kc: -5.75% (20.1478 => 18.9903, std.dev.: 0.1511)
  MultiSource/Applications/lemon/lemon: -5.40% (1.2773 => 1.2083, std.dev.: 0.0046)
  MultiSource/Applications/hbd/hbd: -5.30% (1.6569 => 1.5691, std.dev.: 0.0170)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.5174 => 1.4372, std.dev.: 0.0174)
  MultiSource/Applications/ClamAV/clamscan: -5.27% (17.5555 => 16.6305, std.dev.: 0.1538)
  SingleSource/Benchmarks/Shootout-C++/ary3: -5.13% (0.2787 => 0.2644, std.dev.: 0.0054)
  MultiSource/Benchmarks/McCat/09-vor/vor: -4.93% (0.3695 => 0.3513, std.dev.: 0.0015)
  MultiSource/Applications/lua/lua: -4.90% (4.5190 => 4.2975, std.dev.: 0.0250)
  MultiSource/Benchmarks/sim/sim: -4.73% (0.3912 => 0.3727, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.36% (10.1869 => 9.7432, std.dev.: 0.1193)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.76% (0.7814 => 0.7520, std.dev.: 0.0110)
  MultiSource/Benchmarks/McCat/08-main/main: -3.68% (0.3047 => 0.2935, std.dev.: 0.0014)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.61% (0.8479 => 0.8173, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc-C++/bigfib: -3.54% (0.7140 => 0.6887, std.dev.: 0.0061)
  MultiSource/Applications/sqlite3/sqlite3: -3.38% (17.5094 => 16.9170, std.dev.: 0.1047)
  MultiSource/Applications/SPASS/SPASS: -3.29% (17.4845 => 16.9099, std.dev.: 0.1473)
  MultiSource/Applications/JM/ldecod/ldecod: -3.09% (7.8251 => 7.5834, std.dev.: 0.0933)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.80% (1.5503 => 1.5069, std.dev.: 0.0125)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.49% (0.7804 => 0.7610, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.19% (1.1115 => 1.0872, std.dev.: 0.0050)
  MultiSource/Benchmarks/McCat/05-eks/eks: -1.99% (0.5018 => 0.4918, std.dev.: 0.0034)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/minisat/minisat: -23.17% (8.0768 => 6.2056, std.dev.: 0.1058)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.55% (0.1272 => 0.1036, std.dev.: 0.0005)
  MultiSource/Applications/SPASS/SPASS: -17.88% (10.2131 => 8.3872, std.dev.: 0.1917)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.98% (0.0648 => 0.0538, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -13.98% (5.2816 => 4.5434, std.dev.: 0.0522)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -9.96% (1.3573 => 1.2221, std.dev.: 0.0246)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -9.12% (48.6067 => 44.1719, std.dev.: 0.1373)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -7.84% (2.5037 => 2.3073, std.dev.: 0.0426)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.82% (3.4226 => 3.1549, std.dev.: 0.0306)
  MultiSource/Benchmarks/llubenchmark/llu: -7.29% (2.1564 => 1.9992, std.dev.: 0.0175)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.44% (4.2129 => 3.9838, std.dev.: 0.0218)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -4.90% (0.4712 => 0.4481, std.dev.: 0.0072)
  SingleSource/Benchmarks/Misc/flops-7: -4.65% (2.1385 => 2.0390, std.dev.: 0.0302)
  MultiSource/Benchmarks/Olden/tsp/tsp: -4.63% (1.5085 => 1.4387, std.dev.: 0.0126)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.14% (3.6156 => 3.4658, std.dev.: 0.0064)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -3.68% (0.3803 => 0.3663, std.dev.: 0.0021)
  SingleSource/Benchmarks/McGill/misr: -2.90% (0.4041 => 0.3924, std.dev.: 0.0019)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.89% (1.1379 => 1.1050, std.dev.: 0.0064)
  SingleSource/Regression/C/uint64_to_float: -2.82% (1.8033 => 1.7524, std.dev.: 0.0064)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.79% (61.7520 => 60.0275, std.dev.: 0.5190)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.62% (1.2761 => 1.2427, std.dev.: 0.0074)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.60% (0.4042 => 0.3937, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -2.56% (0.5040 => 0.4911, std.dev.: 0.0050)
  MultiSource/Applications/viterbi/viterbi: -2.55% (3.5602 => 3.4695, std.dev.: 0.0017)
  MultiSource/Applications/lua/lua: -2.06% (28.2422 => 27.6590, std.dev.: 0.0495)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.89% (1.6149 => 1.5843, std.dev.: 0.0034)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.88% (3.3272 => 3.2648, std.dev.: 0.0171)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.81% (2.4013 => 2.3579, std.dev.: 0.0063)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.74% (2.5674 => 2.5228, std.dev.: 0.0038)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.67% (5.6960 => 5.6008, std.dev.: 0.0262)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.56% (22.4933 => 22.1434, std.dev.: 0.0863)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.34% (1.0525 => 1.0384, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.25% (5.9388 => 5.8648, std.dev.: 0.0266)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -2.79% (1.1575 => 1.1252, std.dev.: 0.0079)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/sumarray-dbl
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.38% (0.0262 => 0.0261, std.dev.: 0.0001)
  MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: -2.87% (0.1567 => 0.1522, std.dev.: 0.0055)
  MultiSource/Applications/lemon/lemon: -9.58% (1.2367 => 1.1182, std.dev.: 0.0473)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.01% (0.1093 => 0.1104, std.dev.: 0.0063)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -19.16% (0.0783 => 0.0633, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.69% (0.0290 => 0.0259, std.dev.: 0.0021)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.2920 => 1.2888, std.dev.: 0.0312)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0564 => 0.0582, std.dev.: 0.0120)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.43% (0.0261 => 0.0239, std.dev.: 0.0024)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 16.67% (0.0006 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 1.92% (0.0052 => 0.0053, std.dev.: 0.0035)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.61% (31.7492 => 29.6507, std.dev.: 2.2284)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 800.00% (0.0001 => 0.0009, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.15% (0.0052 => 0.0002, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/casts: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/sumarray-dbl: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.02% (27.1186 => 27.1250, std.dev.: 0.0585)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl
  SingleSource/UnitTests/Vector/sumarray-dbl: - (0.0001 => 0.0001, std.dev.: 0.0003)

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.08% (0.4125 => 0.4252, std.dev.: 0.0204)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -18.85% (0.0663 => 0.0538, std.dev.: 0.0035)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -18.00% (1.6803 => 1.3778, std.dev.: 0.0083)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.62% (7.0997 => 7.4984, std.dev.: 0.0691)
  MultiSource/Applications/d/make_dparser: 5.23% (3.5353 => 3.7203, std.dev.: 0.0532)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.71% (0.7182 => 0.7520, std.dev.: 0.0110)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.70% (0.2768 => 0.2898, std.dev.: 0.0041)
  MultiSource/Applications/JM/ldecod/ldecod: 4.65% (7.2467 => 7.5834, std.dev.: 0.0933)
  MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.3358 => 0.3513, std.dev.: 0.0015)
  MultiSource/Applications/sqlite3/sqlite3: 4.49% (16.1895 => 16.9170, std.dev.: 0.1047)
  MultiSource/Benchmarks/sim/sim: 4.49% (0.3567 => 0.3727, std.dev.: 0.0015)
  MultiSource/Applications/JM/lencod/lencod: 4.46% (16.7203 => 17.4659, std.dev.: 0.1776)
  MultiSource/Benchmarks/MallocBench/gs/gs: 3.80% (4.4482 => 4.6174, std.dev.: 0.0382)
  MultiSource/Applications/SPASS/SPASS: 3.55% (16.3304 => 16.9099, std.dev.: 0.1473)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (0.8843 => 0.9145, std.dev.: 0.0058)
  MultiSource/Applications/kimwitu++/kc: 2.94% (18.4474 => 18.9903, std.dev.: 0.1511)
  MultiSource/Applications/ClamAV/clamscan: 2.77% (16.1821 => 16.6305, std.dev.: 0.1538)
  MultiSource/Applications/lua/lua: 2.72% (4.1835 => 4.2975, std.dev.: 0.0250)
  MultiSource/Applications/minisat/minisat: 2.55% (0.7554 => 0.7747, std.dev.: 0.0045)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.50% (0.4798 => 0.4918, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (0.9184 => 0.9389, std.dev.: 0.0069)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.21% (0.7996 => 0.8173, std.dev.: 0.0004)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 52.87% (0.0314 => 0.0480, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 30.21% (0.0384 => 0.0500, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/fp-convert: 22.80% (5.6800 => 6.9753, std.dev.: 0.1346)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.01% (2.5458 => 2.9535, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.55% (4.7906 => 5.5356, std.dev.: 0.0156)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 14.92% (3.3471 => 3.8466, std.dev.: 0.0947)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.38% (4.4289 => 5.0659, std.dev.: 0.0167)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.42% (12.6632 => 13.9822, std.dev.: 0.1151)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (5.1006 => 5.6041, std.dev.: 0.0687)
  SingleSource/Benchmarks/Misc/pi: 9.78% (2.0512 => 2.2518, std.dev.: 0.0197)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.79% (4.8642 => 5.2917, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.76% (4.0968 => 4.4558, std.dev.: 0.0139)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.91% (2.9511 => 3.1549, std.dev.: 0.0306)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.29% (4.7982 => 5.0998, std.dev.: 0.0992)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.81% (8.6184 => 9.1191, std.dev.: 0.0296)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.81% (1.0331 => 1.0931, std.dev.: 0.0221)
  SingleSource/Benchmarks/Shootout/lists: 5.70% (7.2055 => 7.6159, std.dev.: 0.0374)
  SingleSource/Benchmarks/Misc/flops-7: 5.11% (1.9399 => 2.0390, std.dev.: 0.0302)
  MultiSource/Applications/lambda-0_1_3/lambda: 4.62% (6.9897 => 7.3123, std.dev.: 0.0208)
  SingleSource/Benchmarks/Dhrystone/fldry: 4.27% (0.6480 => 0.6757, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.04% (5.1346 => 5.3419, std.dev.: 0.0343)
  SingleSource/Regression/C/uint64_to_float: 4.02% (1.6847 => 1.7524, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.62% (3.7569 => 3.8930, std.dev.: 0.0365)
  SingleSource/Benchmarks/Misc/richards_benchmark: 3.59% (1.3414 => 1.3896, std.dev.: 0.0042)
  MultiSource/Applications/siod/siod: 3.36% (3.4143 => 3.5290, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.16% (6.0602 => 6.2516, std.dev.: 0.0732)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.95% (9.6958 => 9.9819, std.dev.: 0.0103)
  SingleSource/Benchmarks/McGill/queens: 2.52% (1.7928 => 1.8380, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.49% (4.5865 => 4.7008, std.dev.: 0.0440)
  MultiSource/Benchmarks/sim/sim: 2.40% (3.8564 => 3.9490, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.99% (6.1397 => 6.2617, std.dev.: 0.0204)
  SingleSource/Benchmarks/Shootout/methcall: 1.88% (8.4644 => 8.6235, std.dev.: 0.0333)
  MultiSource/Benchmarks/FreeBench/neural/neural: 1.83% (1.0845 => 1.1044, std.dev.: 0.0025)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.58% (89.3093 => 90.7238, std.dev.: 0.1847)
  SingleSource/Benchmarks/Shootout/matrix: 1.55% (1.5499 => 1.5740, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.40% (6.0446 => 6.1294, std.dev.: 0.0318)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.29% (43.6112 => 44.1719, std.dev.: 0.1373)
  MultiSource/Applications/sgefa/sgefa: 1.21% (1.2184 => 1.2331, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/perlin: 1.21% (4.5691 => 4.6242, std.dev.: 0.0038)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.02% (3.8940 => 3.9339, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.01% (3.3943 => 3.4285, std.dev.: 0.0103)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -51.98% (0.0810 => 0.0389, std.dev.: 0.0022)
  MultiSource/Benchmarks/FreeBench/neural/neural: -21.87% (0.2542 => 0.1986, std.dev.: 0.0037)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.48% (0.0817 => 0.0666, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.94% (0.1176 => 0.0965, std.dev.: 0.0018)
  SingleSource/Benchmarks/McGill/chomp: -10.53% (0.1957 => 0.1751, std.dev.: 0.0080)
  SingleSource/Benchmarks/Linpack/linpack-pc: -8.51% (0.2751 => 0.2517, std.dev.: 0.0008)
  MultiSource/Applications/lemon/lemon: -6.57% (1.2932 => 1.2083, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.65% (6.9229 => 6.6010, std.dev.: 0.0984)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.66% (0.7818 => 0.7610, std.dev.: 0.0027)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/mason/mason: -39.42% (0.5213 => 0.3158, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/ary3: -30.06% (2.0100 => 1.4057, std.dev.: 0.2184)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -26.59% (0.0756 => 0.0555, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -18.96% (6.4626 => 5.2370, std.dev.: 0.1569)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.69% (0.3279 => 0.2666, std.dev.: 0.0024)
  SingleSource/Benchmarks/McGill/misr: -17.02% (0.4729 => 0.3924, std.dev.: 0.0019)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.26% (0.0950 => 0.0805, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.83% (7.1548 => 6.3085, std.dev.: 0.2174)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -11.19% (1.3761 => 1.2221, std.dev.: 0.0246)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -10.63% (5.6245 => 5.0268, std.dev.: 0.0811)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.29% (4.2970 => 3.9838, std.dev.: 0.0218)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.55% (3.4205 => 3.2648, std.dev.: 0.0171)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.23% (0.4111 => 0.3937, std.dev.: 0.0012)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.98% (0.6582 => 0.6320, std.dev.: 0.0045)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.70% (2.4484 => 2.3579, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.56% (4.8478 => 4.6751, std.dev.: 0.0032)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.47% (1.0088 => 0.9738, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.47% (3.0513 => 2.9455, std.dev.: 0.0080)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.07% (3.8286 => 3.7110, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.06% (3.3978 => 3.2938, std.dev.: 0.0220)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -3.03% (1.1586 => 1.1235, std.dev.: 0.0019)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.97% (4.3713 => 4.2414, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc/flops: -2.82% (9.3754 => 9.1109, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -2.39% (3.5506 => 3.4658, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.27% (5.0818 => 4.9663, std.dev.: 0.0337)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.10% (3.3922 => 3.3211, std.dev.: 0.0210)
  MultiSource/Applications/lua/lua: -1.82% (28.1709 => 27.6590, std.dev.: 0.0495)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.79% (9.0122 => 8.8510, std.dev.: 0.0167)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.77% (1.9660 => 1.9313, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/flops-3: -1.37% (2.0809 => 2.0524, std.dev.: 0.0028)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.34% (1.1828 => 1.1669, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.34% (8.7510 => 8.6341, std.dev.: 0.0119)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -0.32% (1.1288 => 1.1252, std.dev.: 0.0079)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.24% (0.0248 => 0.0261, std.dev.: 0.0001)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: 3.05% (0.1477 => 0.1522, std.dev.: 0.0055)
  MultiSource/Applications/lemon/lemon: -5.19% (1.1794 => 1.1182, std.dev.: 0.0473)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -15.66% (0.1309 => 0.1104, std.dev.: 0.0063)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.26% (0.0613 => 0.0633, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.16% (0.0276 => 0.0259, std.dev.: 0.0021)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.53% (1.1660 => 1.2888, std.dev.: 0.0312)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.02% (0.0594 => 0.0582, std.dev.: 0.0120)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.80% (0.0361 => 0.0239, std.dev.: 0.0024)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -42.39% (0.0092 => 0.0053, std.dev.: 0.0035)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.48% (29.7937 => 29.6507, std.dev.: 2.2284)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0009 => 0.0009, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -93.10% (0.0029 => 0.0002, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.76% (26.9213 => 27.1250, std.dev.: 0.0585)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130325/fff737ea/attachment.html>


More information about the llvm-testresults mailing list