[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Apr 3 14:02:12 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10173?compare_to=10168&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10173, Order: 178678, Start Time: 2013-04-03 19:16:29, End Time: 2013-04-03 21:03:12
      To: 10168, Order: 178666, Start Time: 2013-04-03 17:04:20, End Time: 2013-04-03 18:56:19
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (12 on baseline)
Performance Regressions: 5 (81 on baseline)
Performance Improvements: 76 (51 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 20 (20 on baseline)
Unchanged Tests: 1007 (938 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 15.47% (8.7846 => 10.1434, std.dev.: 0.3512)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 8.50% (4.3423 => 4.7116, std.dev.: 0.0133)
  SingleSource/Benchmarks/Shootout-C++/hash: 4.45% (0.6309 => 0.6590, std.dev.: 0.0065)
  SingleSource/Benchmarks/Linpack/linpack-pc: 2.41% (51.1729 => 52.4061, std.dev.: 0.0274)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.03% (1.4684 => 1.4982, std.dev.: 0.0056)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -39.45% (0.0659 => 0.0399, std.dev.: 0.0085)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -28.11% (0.0466 => 0.0335, std.dev.: 0.0007)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -27.48% (0.9170 => 0.6650, std.dev.: 0.0169)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -22.98% (0.6958 => 0.5359, std.dev.: 0.0134)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -20.37% (0.4576 => 0.3644, std.dev.: 0.0078)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -19.85% (0.1234 => 0.0989, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -17.06% (0.2914 => 0.2417, std.dev.: 0.0089)
  MultiSource/Benchmarks/McCat/05-eks/eks: -16.72% (0.5885 => 0.4901, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/constpool: -16.40% (10.7582 => 8.9934, std.dev.: 0.5908)
  MultiSource/Benchmarks/McCat/15-trie/trie: -16.34% (0.0710 => 0.0594, std.dev.: 0.0009)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -15.74% (0.1156 => 0.0974, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.26% (1.5833 => 1.3575, std.dev.: 0.0532)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.48% (0.1640 => 0.1419, std.dev.: 0.0051)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -12.97% (0.1665 => 0.1449, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -12.60% (1.2191 => 1.0655, std.dev.: 0.0244)
  MultiSource/Benchmarks/Olden/mst/mst: -11.93% (0.1458 => 0.1284, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -10.93% (0.2442 => 0.2175, std.dev.: 0.0033)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -10.69% (1.4392 => 1.2853, std.dev.: 0.0118)
  MultiSource/Applications/treecc/treecc: -10.55% (2.4947 => 2.2315, std.dev.: 0.0948)
  MultiSource/Benchmarks/Olden/power/power: -10.55% (0.1555 => 0.1391, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -10.54% (0.3197 => 0.2860, std.dev.: 0.0024)
  MultiSource/Benchmarks/Olden/health/health: -10.48% (0.1679 => 0.1503, std.dev.: 0.0048)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.28% (1.7605 => 1.5796, std.dev.: 0.0186)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.64% (0.7830 => 0.7075, std.dev.: 0.0121)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -9.01% (0.1643 => 0.1495, std.dev.: 0.0023)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.44% (0.1872 => 0.1714, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/bh/bh: -8.43% (0.3537 => 0.3239, std.dev.: 0.0035)
  MultiSource/Benchmarks/Olden/em3d/em3d: -8.36% (0.2081 => 0.1907, std.dev.: 0.0024)
  MultiSource/Benchmarks/McCat/08-main/main: -8.35% (0.3173 => 0.2908, std.dev.: 0.0015)
  MultiSource/Applications/JM/ldecod/ldecod: -8.29% (8.2674 => 7.5821, std.dev.: 0.2656)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.74% (0.9106 => 0.8401, std.dev.: 0.0207)
  MultiSource/Benchmarks/McCat/09-vor/vor: -7.65% (0.3789 => 0.3499, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.61% (1.5786 => 1.4584, std.dev.: 0.0309)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -7.36% (1.5630 => 1.4479, std.dev.: 0.0151)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.26% (0.4022 => 0.3730, std.dev.: 0.0062)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.81% (0.7560 => 0.7045, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.73% (0.3538 => 0.3300, std.dev.: 0.0082)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.34% (0.1861 => 0.1743, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.76% (0.5003 => 0.4715, std.dev.: 0.0062)
  MultiSource/Benchmarks/MallocBench/gs/gs: -5.73% (4.8647 => 4.5860, std.dev.: 0.0196)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.73% (11.4497 => 10.7942, std.dev.: 0.1932)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.68% (1.5631 => 1.4743, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.59% (1.5918 => 1.5028, std.dev.: 0.0284)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.59% (0.4025 => 0.3800, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.11% (1.5768 => 1.4963, std.dev.: 0.0133)
  MultiSource/Applications/JM/lencod/lencod: -5.06% (18.3795 => 17.4488, std.dev.: 0.2447)
  MultiSource/Benchmarks/PAQ8p/paq8p: -4.94% (2.7314 => 2.5965, std.dev.: 0.0475)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.67% (0.9768 => 0.9312, std.dev.: 0.0007)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.66% (0.3006 => 0.2866, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -4.59% (0.2333 => 0.2226, std.dev.: 0.0020)
  MultiSource/Benchmarks/sim/sim: -4.57% (0.3892 => 0.3714, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2192 => 0.2092, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.18% (0.6845 => 0.6559, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/ary3: -3.84% (0.2861 => 0.2751, std.dev.: 0.0023)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.65% (0.9808 => 0.9450, std.dev.: 0.0042)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.25% (7.8221 => 7.5676, std.dev.: 0.0522)
  MultiSource/Benchmarks/Prolangs-C/football/football: -2.95% (1.0011 => 0.9716, std.dev.: 0.0073)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -45.96% (0.2478 => 0.1339, std.dev.: 0.0052)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -39.74% (1.2519 => 0.7544, std.dev.: 0.0796)
  SingleSource/Benchmarks/Shootout/heapsort: -22.11% (4.3436 => 3.3832, std.dev.: 0.0909)
  MultiSource/Applications/JM/ldecod/ldecod: -14.05% (0.0726 => 0.0624, std.dev.: 0.0039)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -12.36% (1.4153 => 1.2403, std.dev.: 0.0649)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -7.86% (0.3893 => 0.3587, std.dev.: 0.0015)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.95% (3.3923 => 3.1565, std.dev.: 0.0721)
  SingleSource/Benchmarks/Shootout-C++/ary3: -5.76% (2.2424 => 2.1132, std.dev.: 0.0066)
  MultiSource/Benchmarks/llubenchmark/llu: -5.72% (2.1324 => 2.0105, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.53% (22.5822 => 21.3340, std.dev.: 0.3922)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.91% (0.4343 => 0.4173, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.67% (0.3491 => 0.3363, std.dev.: 0.0029)
  MultiSource/Benchmarks/Olden/health/health: -3.55% (0.3435 => 0.3313, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/bh/bh: -2.62% (2.4065 => 2.3434, std.dev.: 0.0055)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.59% (1.6786 => 1.6351, std.dev.: 0.0162)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.45% (4.6637 => 4.5493, std.dev.: 0.0362)
  MultiSource/Applications/aha/aha: -1.39% (3.6179 => 3.5675, std.dev.: 0.0015)
  MultiSource/Applications/sgefa/sgefa: -1.31% (1.3532 => 1.3355, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/power/power: -1.28% (1.2375 => 1.2217, std.dev.: 0.0052)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -3.69% (1.1746 => 1.1312, std.dev.: 0.0778)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0224 => 0.0224, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: -1.30% (0.1458 => 0.1439, std.dev.: 0.0028)
  MultiSource/Applications/lemon/lemon: 0.86% (1.2005 => 1.2108, std.dev.: 0.2658)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.27% (0.1104 => 0.1101, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.24% (0.0587 => 0.0568, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.35% (0.0243 => 0.0256, std.dev.: 0.0031)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.45% (0.0031 => 0.0029, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.70% (0.0649 => 0.0599, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.19% (0.0274 => 0.0268, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionTest: 40.00% (0.0005 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 29.70% (0.0101 => 0.0131, std.dev.: 0.0037)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.10% (24.6842 => 23.9185, std.dev.: 0.4509)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.70% (0.4125 => 0.4319, std.dev.: 0.0078)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.97% (0.0663 => 0.0577, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.80% (1.1660 => 1.1870, std.dev.: 0.0496)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -23.13% (1.6803 => 1.2917, std.dev.: 0.0976)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.56% (29.7937 => 29.0323, std.dev.: 2.3423)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1000.00% (0.0001 => 0.0011)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -48.28% (0.0029 => 0.0015, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.17% (1.0507 => 1.3047, std.dev.: 0.0656)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.66% (1.0687 => 1.3216, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 23.62% (1.0418 => 1.2879, std.dev.: 0.0366)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.63% (1.0958 => 1.3438, std.dev.: 0.0852)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.38% (1.1428 => 1.3986, std.dev.: 0.0300)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.14% (1.1209 => 1.3691, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 21.96% (1.1744 => 1.4323, std.dev.: 0.0545)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.83% (1.1626 => 1.4164, std.dev.: 0.0791)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.74% (1.0890 => 1.3257, std.dev.: 0.0364)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.45% (1.0526 => 1.2784, std.dev.: 0.0384)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 20.11% (1.2270 => 1.4737, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.66% (1.1727 => 1.4032, std.dev.: 0.0715)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.44% (1.1699 => 1.3973, std.dev.: 0.0730)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.78% (1.2419 => 1.4503, std.dev.: 0.0508)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 16.31% (1.2835 => 1.4928, std.dev.: 0.0788)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 16.23% (1.2929 => 1.5028, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.15% (1.2537 => 1.4562, std.dev.: 0.0441)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 16.06% (1.2566 => 1.4584, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.88% (1.2723 => 1.4743, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.77% (1.2925 => 1.4963, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.16% (1.2704 => 1.4630, std.dev.: 0.0569)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.71% (1.3638 => 1.5644, std.dev.: 0.0778)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.57% (1.3451 => 1.5411, std.dev.: 0.0538)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.93% (23.8286 => 26.9093, std.dev.: 0.7301)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.59% (7.0997 => 7.5676, std.dev.: 0.0522)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 6.57% (0.2116 => 0.2255, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/hello: 5.57% (0.1885 => 0.1990, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.39% (0.4580 => 0.4827, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.30% (0.3205 => 0.3375, std.dev.: 0.0008)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.30% (0.8843 => 0.9312, std.dev.: 0.0007)
  MultiSource/Applications/JM/lencod/lencod: 4.36% (16.7203 => 17.4488, std.dev.: 0.2447)
  MultiSource/Benchmarks/McCat/09-vor/vor: 4.20% (0.3358 => 0.3499, std.dev.: 0.0006)
  MultiSource/Benchmarks/sim/sim: 4.12% (0.3567 => 0.3714, std.dev.: 0.0043)
  MultiSource/Benchmarks/MallocBench/gs/gs: 3.10% (4.4482 => 4.5860, std.dev.: 0.0196)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.80% (0.6853 => 0.7045, std.dev.: 0.0026)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.15% (0.4798 => 0.4901, std.dev.: 0.0021)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 53.36% (0.3010 => 0.4616, std.dev.: 0.0183)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 45.05% (3.2482 => 4.7116, std.dev.: 0.0133)
  SingleSource/Benchmarks/Shootout-C++/ary2: 41.08% (0.0314 => 0.0443, std.dev.: 0.0019)
  MultiSource/Benchmarks/MallocBench/gs/gs: 39.64% (0.0608 => 0.0849, std.dev.: 0.0009)
  MultiSource/Benchmarks/mafft/pairlocalalign: 34.21% (57.5400 => 77.2228, std.dev.: 1.1939)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 34.04% (12.6632 => 16.9733, std.dev.: 0.6904)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.77% (8.7510 => 11.6188, std.dev.: 0.0129)
  SingleSource/Benchmarks/Shootout/sieve: 27.63% (6.8087 => 8.6902, std.dev.: 0.0359)
  SingleSource/Benchmarks/Shootout/ary3: 22.36% (8.2895 => 10.1434, std.dev.: 0.3512)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.50% (4.4289 => 5.3812, std.dev.: 0.0341)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.13% (9.6958 => 11.6479, std.dev.: 0.0214)
  SingleSource/Benchmarks/Misc/salsa20: 19.69% (9.1513 => 10.9535, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.66% (4.7982 => 5.3575, std.dev.: 0.0048)
  MultiSource/Applications/sgefa/sgefa: 9.61% (1.2184 => 1.3355, std.dev.: 0.0010)
  MultiSource/Applications/hexxagon/hexxagon: 9.48% (14.4795 => 15.8522, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout/heapsort: 7.73% (3.1404 => 3.3832, std.dev.: 0.0909)
  SingleSource/Benchmarks/McGill/chomp: 7.70% (1.0339 => 1.1135, std.dev.: 0.0262)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.96% (2.9511 => 3.1565, std.dev.: 0.0721)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.67% (6.9897 => 7.4562, std.dev.: 0.0097)
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.45% (8.6184 => 9.1742, std.dev.: 0.0163)
  MultiSource/Benchmarks/Olden/tsp/tsp: 6.12% (1.4232 => 1.5103, std.dev.: 0.0333)
  SingleSource/Benchmarks/Misc/richards_benchmark: 5.76% (1.3414 => 1.4186, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.36% (5.1006 => 5.3738, std.dev.: 0.0174)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.13% (2.0100 => 2.1132, std.dev.: 0.0066)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.06% (90.5803 => 95.1606, std.dev.: 1.4183)
  SingleSource/Benchmarks/Dhrystone/fldry: 5.00% (0.6480 => 0.6804, std.dev.: 0.0026)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.97% (1.4273 => 1.4982, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.94% (3.3978 => 3.5656, std.dev.: 0.0433)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.30% (23.4908 => 24.5017, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.23% (4.5865 => 4.7806, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.21% (4.0968 => 4.2693, std.dev.: 0.0121)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.16% (3.7953 => 3.9531, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.40% (4.1182 => 4.2582, std.dev.: 0.0308)
  SingleSource/Benchmarks/Shootout/lists: 3.22% (7.2055 => 7.4378, std.dev.: 0.0829)
  SingleSource/Benchmarks/Shootout-C++/lists1: 3.09% (0.6043 => 0.6230, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.98% (5.0054 => 5.1544, std.dev.: 0.0380)
  SingleSource/Benchmarks/Shootout/methcall: 2.47% (8.4644 => 8.6736, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.02% (4.7906 => 4.8873, std.dev.: 0.0043)
  MultiSource/Applications/aha/aha: 1.95% (3.4994 => 3.5675, std.dev.: 0.0015)
  MultiSource/Applications/siod/siod: 1.87% (3.4143 => 3.4780, std.dev.: 0.0222)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.85% (2.7893 => 2.8408, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.33% (3.6942 => 3.7433, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.22% (3.0513 => 3.0884, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/perlin: 1.13% (4.5691 => 4.6208, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout/fib2: 1.11% (4.9040 => 4.9582, std.dev.: 0.0163)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -50.74% (0.0810 => 0.0399, std.dev.: 0.0085)
  MultiSource/Benchmarks/FreeBench/neural/neural: -21.28% (0.2542 => 0.2001, std.dev.: 0.0011)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.24% (0.0817 => 0.0668, std.dev.: 0.0008)
  SingleSource/Benchmarks/McGill/chomp: -8.99% (0.1957 => 0.1781, std.dev.: 0.0011)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -8.67% (0.3990 => 0.3644, std.dev.: 0.0078)
  SingleSource/Benchmarks/Linpack/linpack-pc: -8.65% (0.2751 => 0.2513, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/football/football: -2.29% (0.9944 => 0.9716, std.dev.: 0.0073)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -67.87% (1.0845 => 0.3484, std.dev.: 0.0990)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -63.97% (0.3861 => 0.1391, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.82% (3.4380 => 1.4500, std.dev.: 0.0271)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -55.07% (3.8940 => 1.7494, std.dev.: 0.0186)
  MultiSource/Benchmarks/FreeBench/mason/mason: -44.85% (0.5213 => 0.2875, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -30.79% (0.1871 => 0.1295, std.dev.: 0.0063)
  MultiSource/Benchmarks/McCat/18-imp/imp: -25.26% (0.1465 => 0.1095, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -23.66% (0.2316 => 0.1768, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.89% (0.3279 => 0.2594, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -17.84% (3.5506 => 2.9172, std.dev.: 0.1223)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -17.83% (0.1789 => 0.1470, std.dev.: 0.0014)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.79% (0.0950 => 0.0781, std.dev.: 0.0009)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -16.83% (1.9660 => 1.6351, std.dev.: 0.0162)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -16.67% (0.0756 => 0.0630, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.88% (9.0122 => 7.9414, std.dev.: 0.0176)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -11.19% (0.4111 => 0.3651, std.dev.: 0.0033)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.89% (3.4205 => 3.0822, std.dev.: 0.0691)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -9.66% (9.5512 => 8.6288, std.dev.: 0.1157)
  SingleSource/Benchmarks/Stanford/Puzzle: -8.67% (0.1650 => 0.1507, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -8.57% (0.3091 => 0.2826, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -8.37% (2.5458 => 2.3326, std.dev.: 0.0073)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.95% (13.2022 => 12.1524, std.dev.: 0.0559)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -7.60% (0.4368 => 0.4036, std.dev.: 0.0008)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.42% (89.3093 => 82.6793, std.dev.: 0.0530)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -7.38% (3.7569 => 3.4795, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.33% (4.2970 => 3.9820, std.dev.: 0.0655)
  SingleSource/Benchmarks/McGill/queens: -7.31% (1.7928 => 1.6618, std.dev.: 0.0115)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.18% (3.9434 => 3.6998, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (5.8948 => 5.5607, std.dev.: 0.0083)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.46% (0.3093 => 0.2924, std.dev.: 0.0012)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.18% (0.2431 => 0.2305, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -5.12% (0.2167 => 0.2056, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -3.94% (4.7361 => 4.5493, std.dev.: 0.0362)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.88% (6.0602 => 5.8252, std.dev.: 0.0248)
  SingleSource/Benchmarks/Misc/mandel: -3.07% (1.0882 => 1.0548, std.dev.: 0.0098)
  MultiSource/Applications/JM/lencod/lencod: -2.53% (7.1542 => 6.9731, std.dev.: 0.0145)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.43% (3.3922 => 3.3098, std.dev.: 0.0161)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.29% (1.1828 => 1.1557, std.dev.: 0.0067)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.27% (4.3713 => 4.2721, std.dev.: 0.0337)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.25% (3.8286 => 3.7425, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.92% (5.1346 => 5.0362, std.dev.: 0.0121)
  SingleSource/Benchmarks/Misc/flops-3: -1.49% (2.0809 => 2.0499, std.dev.: 0.0061)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.43% (2.5722 => 2.5353, std.dev.: 0.0073)
  MultiSource/Benchmarks/Olden/bh/bh: -1.33% (2.3749 => 2.3434, std.dev.: 0.0055)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.21% (1.1288 => 1.1312, std.dev.: 0.0778)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.68% (0.0248 => 0.0224, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: -2.57% (0.1477 => 0.1439, std.dev.: 0.0028)
  MultiSource/Applications/lemon/lemon: 2.66% (1.1794 => 1.2108, std.dev.: 0.2658)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -15.89% (0.1309 => 0.1101, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.34% (0.0613 => 0.0568, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.25% (0.0276 => 0.0256, std.dev.: 0.0031)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.84% (0.0594 => 0.0599, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.76% (0.0361 => 0.0268, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 42.39% (0.0092 => 0.0131, std.dev.: 0.0037)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.15% (26.9213 => 23.9185, std.dev.: 0.4509)

Report Time: 1.32s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130403/99b268b0/attachment.html>


More information about the llvm-testresults mailing list