[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Apr 11 13:16:19 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10502?compare_to=10499&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10502, Order: 179303, Start Time: 2013-04-11 18:27:28, End Time: 2013-04-11 20:17:28
      To: 10499, Order: 179289, Start Time: 2013-04-11 16:18:07, End Time: 2013-04-11 18:05:45
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (13 on baseline)
Performance Regressions: 42 (108 on baseline)
Performance Improvements: 17 (60 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 19 (19 on baseline)
Unchanged Tests: 1030 (902 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 38.10% (0.5572 => 0.7695, std.dev.: 0.0148)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 35.78% (0.0682 => 0.0926, std.dev.: 0.0093)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 28.24% (0.6711 => 0.8606, std.dev.: 0.0568)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.85% (0.6951 => 0.7566, std.dev.: 0.0186)
  MultiSource/Benchmarks/Olden/bh/bh: 8.73% (0.3323 => 0.3613, std.dev.: 0.0048)
  MultiSource/Applications/siod/siod: 8.44% (2.4743 => 2.6831, std.dev.: 0.0077)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.23% (10.5695 => 11.3341, std.dev.: 0.1233)
  MultiSource/Benchmarks/Bullet/bullet: 6.92% (36.1777 => 38.6808, std.dev.: 0.7419)
  MultiSource/Applications/kimwitu++/kc: 6.39% (19.0989 => 20.3196, std.dev.: 0.2248)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (0.4683 => 0.4975, std.dev.: 0.0066)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.47% (0.2157 => 0.2275, std.dev.: 0.0028)
  MultiSource/Benchmarks/sim/sim: 4.78% (0.3639 => 0.3813, std.dev.: 0.0031)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.65% (0.7620 => 0.7898, std.dev.: 0.0074)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.44% (0.3077 => 0.3183, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.81% (1.5830 => 1.6275, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.47% (1.6996 => 1.7416, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.85% (1.5975 => 1.6270, std.dev.: 0.0099)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 54.12% (5.8738 => 9.0528, std.dev.: 0.7198)
  MultiSource/Benchmarks/Olden/bisort/bisort: 39.68% (0.6815 => 0.9519, std.dev.: 0.0442)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 38.27% (0.8827 => 1.2205, std.dev.: 0.0159)
  SingleSource/Benchmarks/Shootout/heapsort: 35.75% (3.1213 => 4.2372, std.dev.: 0.2425)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.42% (4.5741 => 5.9657, std.dev.: 0.0936)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 30.42% (3.4406 => 4.4872, std.dev.: 0.1947)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.59% (0.0732 => 0.0912, std.dev.: 0.0028)
  MultiSource/Applications/minisat/minisat: 22.21% (6.3017 => 7.7013, std.dev.: 0.4304)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 12.41% (3.3315 => 3.7448, std.dev.: 0.0070)
  MultiSource/Benchmarks/McCat/09-vor/vor: 10.60% (0.1142 => 0.1263, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/flops-7: 7.89% (1.9659 => 2.1211, std.dev.: 0.0110)
  SingleSource/Benchmarks/Shootout-C++/lists1: 7.71% (0.6034 => 0.6499, std.dev.: 0.0081)
  MultiSource/Benchmarks/llubenchmark/llu: 6.84% (2.0274 => 2.1660, std.dev.: 0.0445)
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.83% (8.4107 => 8.9855, std.dev.: 0.0430)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.53% (40.6258 => 43.2806, std.dev.: 0.7199)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 6.39% (2.8728 => 3.0565, std.dev.: 0.0231)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.36% (60.8718 => 64.7452, std.dev.: 0.5301)
  MultiSource/Benchmarks/Bullet/bullet: 4.68% (7.0707 => 7.4016, std.dev.: 0.0812)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.40% (2.7213 => 2.8139, std.dev.: 0.0173)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.37% (2.3302 => 2.4087, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.23% (7.1985 => 7.3587, std.dev.: 0.0418)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.89% (1.2356 => 1.2589, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/mandel: 1.55% (0.9542 => 0.9690, std.dev.: 0.0020)
  MultiSource/Applications/JM/lencod/lencod: 1.39% (6.8963 => 6.9921, std.dev.: 0.0255)
  SingleSource/Benchmarks/Shootout/methcall: 1.03% (8.4476 => 8.5342, std.dev.: 0.0173)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/EH/function_try_block: -35.86% (0.0488 => 0.0313, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -17.27% (0.1928 => 0.1595, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -16.27% (0.1106 => 0.0926, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -12.55% (0.2573 => 0.2250, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -12.53% (5.6145 => 4.9110, std.dev.: 0.2198)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -9.28% (2.1105 => 1.9146, std.dev.: 0.0630)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.75% (1.4385 => 1.3558, std.dev.: 0.0194)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.67% (16.1594 => 15.2426, std.dev.: 0.1276)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (1.6369 => 1.5571, std.dev.: 0.0279)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.48% (1.7898 => 1.7096, std.dev.: 0.0274)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.24% (1.2187 => 1.1670, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.14% (1.4072 => 1.3630, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.93% (1.8140 => 1.7608, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.14% (1.4598 => 1.4285, std.dev.: 0.0112)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -17.39% (2.9281 => 2.4189, std.dev.: 0.1322)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -5.51% (0.8828 => 0.8342, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.14% (0.7735 => 0.7492, std.dev.: 0.0054)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.49% (1.1443 => 1.1499, std.dev.: 0.0676)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 47.68% (0.0151 => 0.0223, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: -0.87% (0.1496 => 0.1483, std.dev.: 0.0233)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.33% (0.1142 => 0.1104, std.dev.: 0.0078)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0009 => 0.0009, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -14.22% (0.0689 => 0.0591, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.61% (0.0256 => 0.0193, std.dev.: 0.0050)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 170.00% (0.0010 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.95% (0.0535 => 0.0615, std.dev.: 0.0104)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.84% (0.0218 => 0.0246, std.dev.: 0.0012)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -65.62% (0.0096 => 0.0033, std.dev.: 0.0030)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.38% (24.6443 => 24.3032, std.dev.: 0.1107)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002)
  MultiSource/Applications/lemon/lemon: -21.42% (1.1794 => 0.9268, std.dev.: 0.2205)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.65% (0.4125 => 0.4482, std.dev.: 0.0359)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.52% (0.0663 => 0.0580, std.dev.: 0.0121)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.04% (1.1660 => 1.1898, std.dev.: 0.0718)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -7.56% (1.6803 => 1.5533, std.dev.: 0.0085)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.24% (29.7937 => 31.0583, std.dev.: 1.4651)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -58.62% (0.0029 => 0.0012, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 47.91% (0.0215 => 0.0318, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 42.90% (0.0648 => 0.0926, std.dev.: 0.0093)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 42.18% (0.5412 => 0.7695, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 35.24% (1.1023 => 1.4908, std.dev.: 0.0607)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 33.93% (1.1626 => 1.5571, std.dev.: 0.0279)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 32.61% (1.2270 => 1.6271, std.dev.: 0.0189)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 32.21% (1.0418 => 1.3774, std.dev.: 0.0375)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 31.90% (1.0528 => 1.3886, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.69% (1.2723 => 1.6755, std.dev.: 0.1131)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 31.49% (1.0617 => 1.3960, std.dev.: 0.0678)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 31.18% (1.0890 => 1.4285, std.dev.: 0.0112)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 30.75% (0.6582 => 0.8606, std.dev.: 0.0568)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 30.69% (1.0958 => 1.4321, std.dev.: 0.0310)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.61% (1.0687 => 1.3958, std.dev.: 0.0988)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 30.29% (1.0864 => 1.4155, std.dev.: 0.0634)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.05% (1.1744 => 1.5273, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.92% (1.1428 => 1.4847, std.dev.: 0.0457)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 29.57% (1.1209 => 1.4524, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.49% (1.0526 => 1.3630, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 29.48% (1.2566 => 1.6270, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 29.47% (1.2925 => 1.6734, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.25% (1.2929 => 1.6711, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.04% (1.0507 => 1.3558, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 28.85% (1.0951 => 1.4110, std.dev.: 0.0440)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.42% (1.3313 => 1.7096, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 28.35% (1.2419 => 1.5940, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.22% (1.2835 => 1.6457, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 28.11% (1.2704 => 1.6275, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.94% (1.3692 => 1.7518, std.dev.: 0.0437)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 27.70% (1.3638 => 1.7416, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.62% (1.1727 => 1.4966, std.dev.: 0.0220)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 27.23% (1.1699 => 1.4885, std.dev.: 0.0463)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 26.76% (1.4622 => 1.8535, std.dev.: 0.0332)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 26.29% (1.3491 => 1.7038, std.dev.: 0.0416)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.93% (1.2853 => 1.6186, std.dev.: 0.0341)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 25.73% (1.4005 => 1.7608, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 25.70% (1.3357 => 1.6790, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 24.07% (1.3451 => 1.6688, std.dev.: 0.1053)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.84% (23.8286 => 27.3642, std.dev.: 0.5059)
  MultiSource/Applications/d/make_dparser: 14.51% (3.5353 => 4.0483, std.dev.: 0.1835)
  MultiSource/Benchmarks/Bullet/bullet: 14.00% (33.9296 => 38.6808, std.dev.: 0.7419)
  MultiSource/Applications/siod/siod: 10.89% (2.4196 => 2.6831, std.dev.: 0.0077)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.40% (0.6853 => 0.7566, std.dev.: 0.0186)
  MultiSource/Applications/kimwitu++/kc: 10.15% (18.4474 => 20.3196, std.dev.: 0.2248)
  MultiSource/Benchmarks/Olden/bh/bh: 9.39% (0.3303 => 0.3613, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4580 => 0.4975, std.dev.: 0.0066)
  MultiSource/Applications/SPASS/SPASS: 8.48% (16.3304 => 17.7159, std.dev.: 0.4515)
  MultiSource/Benchmarks/sim/sim: 6.90% (0.3567 => 0.3813, std.dev.: 0.0031)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.79% (10.6134 => 11.3341, std.dev.: 0.1233)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2130 => 0.2262, std.dev.: 0.0006)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 5.81% (46.1715 => 48.8544, std.dev.: 0.6372)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.88% (0.4673 => 0.4901, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.29% (0.3052 => 0.3183, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.2950 => 0.3072, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (14.7643 => 15.2426, std.dev.: 0.1276)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 54.25% (0.3010 => 0.4643, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/fp-convert: 40.11% (5.6800 => 7.9581, std.dev.: 0.0239)
  MultiSource/Benchmarks/MallocBench/gs/gs: 38.98% (0.0608 => 0.0845, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 38.14% (3.2482 => 4.4872, std.dev.: 0.1947)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 37.21% (0.8895 => 1.2205, std.dev.: 0.0159)
  MultiSource/Benchmarks/Olden/bisort/bisort: 36.55% (0.6971 => 0.9519, std.dev.: 0.0442)
  SingleSource/Benchmarks/Shootout/heapsort: 34.93% (3.1404 => 4.2372, std.dev.: 0.2425)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.71% (4.4954 => 5.9657, std.dev.: 0.0936)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 28.48% (12.6632 => 16.2693, std.dev.: 1.0469)
  SingleSource/Benchmarks/Shootout/sieve: 28.19% (6.8087 => 8.7278, std.dev.: 0.0008)
  MultiSource/Applications/minisat/minisat: 24.32% (6.1945 => 7.7013, std.dev.: 0.4304)
  SingleSource/Benchmarks/Shootout/hash: 24.12% (4.1780 => 5.1857, std.dev.: 0.2450)
  SingleSource/Benchmarks/Shootout-C++/matrix: 21.39% (2.8804 => 3.4964, std.dev.: 0.0657)
  SingleSource/Benchmarks/McGill/chomp: 18.06% (1.0339 => 1.2206, std.dev.: 0.0213)
  MultiSource/Applications/lambda-0_1_3/lambda: 17.15% (6.9897 => 8.1887, std.dev.: 0.0099)
  MultiSource/Benchmarks/Olden/tsp/tsp: 17.12% (1.4232 => 1.6668, std.dev.: 0.0678)
  SingleSource/Benchmarks/Misc/salsa20: 16.29% (9.1513 => 10.6425, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.27% (3.7569 => 4.3305, std.dev.: 0.0069)
  SingleSource/Benchmarks/Shootout-C++/hash: 14.56% (0.6540 => 0.7492, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.22% (8.7510 => 9.9952, std.dev.: 0.0145)
  SingleSource/Benchmarks/Shootout-C++/ary3: 13.63% (2.0100 => 2.2840, std.dev.: 0.0967)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.69% (2.5659 => 2.8915, std.dev.: 0.0528)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 11.88% (3.3471 => 3.7448, std.dev.: 0.0070)
  MultiSource/Benchmarks/McCat/09-vor/vor: 11.18% (0.1136 => 0.1263, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout/matrix: 10.63% (1.5499 => 1.7146, std.dev.: 0.0527)
  MultiSource/Applications/hexxagon/hexxagon: 10.15% (14.4795 => 15.9489, std.dev.: 0.1703)
  SingleSource/Benchmarks/Misc/flops-7: 9.34% (1.9399 => 2.1211, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.31% (4.0968 => 4.4781, std.dev.: 0.0105)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 8.70% (59.5643 => 64.7452, std.dev.: 0.5301)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.72% (4.8642 => 5.2399, std.dev.: 0.1074)
  SingleSource/Benchmarks/Shootout-C++/lists1: 7.55% (0.6043 => 0.6499, std.dev.: 0.0081)
  MultiSource/Benchmarks/llubenchmark/llu: 7.35% (2.0177 => 2.1660, std.dev.: 0.0445)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.21% (5.1346 => 5.4022, std.dev.: 0.0505)
  SingleSource/Benchmarks/Dhrystone/fldry: 4.92% (0.6480 => 0.6799, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.56% (41.3934 => 43.2806, std.dev.: 0.7199)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (3.4205 => 3.5662, std.dev.: 0.0503)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.26% (8.6184 => 8.9855, std.dev.: 0.0430)
  SingleSource/Benchmarks/Shootout/lists: 4.08% (7.2055 => 7.4996, std.dev.: 0.0268)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.93% (5.1006 => 5.3013, std.dev.: 0.0450)
  MultiSource/Benchmarks/Olden/bh/bh: 3.75% (2.3749 => 2.4639, std.dev.: 0.0198)
  MultiSource/Benchmarks/Bullet/bullet: 3.74% (7.1351 => 7.4016, std.dev.: 0.0812)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.66% (4.7982 => 4.9739, std.dev.: 0.0181)
  SingleSource/Benchmarks/Misc/whetstone: 3.56% (3.4590 => 3.5822, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.21% (6.1397 => 6.3369, std.dev.: 0.0400)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.85% (7.1548 => 7.3587, std.dev.: 0.0418)
  MultiSource/Applications/aha/aha: 2.61% (3.4994 => 3.5906, std.dev.: 0.0106)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.56% (2.7893 => 2.8607, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.39% (9.6958 => 9.9273, std.dev.: 0.0345)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.32% (1.4499 => 1.4835, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.00% (2.7587 => 2.8139, std.dev.: 0.0173)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.96% (1.4273 => 1.4553, std.dev.: 0.0078)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.32% (3.4522 => 3.4977, std.dev.: 0.0153)
  SingleSource/Benchmarks/Shootout/fib2: 1.06% (4.9040 => 4.9558, std.dev.: 0.0027)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -51.60% (0.0810 => 0.0392, std.dev.: 0.0118)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.39% (0.1176 => 0.0995, std.dev.: 0.0067)
  SingleSource/Benchmarks/McGill/chomp: -9.86% (0.1957 => 0.1764, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.26% (0.3861 => 0.1380, std.dev.: 0.0021)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -57.04% (3.8940 => 1.6730, std.dev.: 0.0050)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.04% (3.4380 => 1.4771, std.dev.: 0.0565)
  MultiSource/Benchmarks/FreeBench/mason/mason: -43.93% (0.5213 => 0.2923, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.26% (6.8267 => 4.5564, std.dev.: 0.0111)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -32.71% (0.1871 => 0.1259, std.dev.: 0.0092)
  MultiSource/Benchmarks/FreeBench/neural/neural: -32.32% (1.0845 => 0.7340, std.dev.: 0.0158)
  MultiSource/Applications/viterbi/viterbi: -24.74% (3.4506 => 2.5969, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -23.58% (0.2316 => 0.1770, std.dev.: 0.0118)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -23.02% (0.0756 => 0.0582, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.39% (5.8948 => 4.6337, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc/perlin: -19.24% (4.5691 => 3.6899, std.dev.: 0.0141)
  MultiSource/Benchmarks/McCat/18-imp/imp: -18.16% (0.1465 => 0.1199, std.dev.: 0.0092)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -17.78% (0.1789 => 0.1471, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -17.48% (6.0446 => 4.9879, std.dev.: 0.0431)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -16.49% (1.9660 => 1.6419, std.dev.: 0.0590)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.43% (6.4626 => 5.4010, std.dev.: 0.0088)
  SingleSource/Benchmarks/McGill/misr: -15.35% (0.4729 => 0.4003, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -14.54% (6.7010 => 5.7269, std.dev.: 0.0207)
  MultiSource/Benchmarks/mafft/pairlocalalign: -14.23% (57.5400 => 49.3510, std.dev.: 0.2836)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -13.92% (3.5506 => 3.0565, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.59% (9.0122 => 7.8777, std.dev.: 0.0609)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.24% (6.0602 => 5.3186, std.dev.: 0.0148)
  SingleSource/Benchmarks/Misc/mandel: -10.95% (1.0882 => 0.9690, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.16% (5.0054 => 4.4967, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.52% (5.0816 => 4.6489, std.dev.: 0.0135)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -8.08% (0.4111 => 0.3779, std.dev.: 0.0128)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.85% (89.3093 => 82.2957, std.dev.: 0.2663)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -7.80% (2.5458 => 2.3472, std.dev.: 0.0119)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -7.69% (0.4368 => 0.4032, std.dev.: 0.0117)
  SingleSource/Benchmarks/McGill/queens: -7.69% (1.7928 => 1.6550, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.68% (0.4924 => 0.4546, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.52% (9.5512 => 8.8332, std.dev.: 0.0372)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.30% (13.2022 => 12.2389, std.dev.: 0.0358)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.16% (4.2970 => 3.9894, std.dev.: 0.1072)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.05% (3.3978 => 3.1582, std.dev.: 0.0281)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.53% (3.9434 => 3.7252, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.25% (6.2349 => 5.9077, std.dev.: 0.0509)
  MultiSource/Applications/sgefa/sgefa: -4.83% (1.2184 => 1.1596, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.71% (3.0513 => 2.9077, std.dev.: 0.0043)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -4.48% (1.5779 => 1.5072, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.48% (5.6245 => 5.3726, std.dev.: 0.0407)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.47% (9.0356 => 8.6319, std.dev.: 0.1082)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.33% (3.3618 => 3.2162, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.31% (5.7666 => 5.5183, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.24% (4.4289 => 4.2409, std.dev.: 0.0351)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.96% (2.4484 => 2.3515, std.dev.: 0.0338)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -3.83% (4.7361 => 4.5547, std.dev.: 0.0430)
  SingleSource/Benchmarks/Misc/fbench: -3.78% (4.9661 => 4.7784, std.dev.: 0.0236)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.23% (3.3922 => 3.2828, std.dev.: 0.0195)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.76% (3.8286 => 3.7230, std.dev.: 0.0016)
  MultiSource/Applications/JM/lencod/lencod: -2.27% (7.1542 => 6.9921, std.dev.: 0.0255)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.14% (0.6582 => 0.6441, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.13% (4.3713 => 4.2784, std.dev.: 0.0044)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.07% (35.0623 => 34.3373, std.dev.: 0.0699)
  SingleSource/Benchmarks/Linpack/linpack-pc: -1.89% (52.8418 => 51.8442, std.dev.: 0.3137)
  SingleSource/Benchmarks/Misc/flops-3: -1.60% (2.0809 => 2.0477, std.dev.: 0.0008)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.87% (1.1288 => 1.1499, std.dev.: 0.0676)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.08% (0.0248 => 0.0223, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: 0.41% (0.1477 => 0.1483, std.dev.: 0.0233)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -15.66% (0.1309 => 0.1104, std.dev.: 0.0078)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.59% (0.0613 => 0.0591, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.07% (0.0276 => 0.0193, std.dev.: 0.0050)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.54% (0.0594 => 0.0615, std.dev.: 0.0104)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.86% (0.0361 => 0.0246, std.dev.: 0.0012)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -64.13% (0.0092 => 0.0033, std.dev.: 0.0030)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.73% (26.9213 => 24.3032, std.dev.: 0.1107)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130411/88c28430/attachment.html>


More information about the llvm-testresults mailing list