[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 5 07:41:09 PST 2013


http://llvm.org/perf/db_default/v4/nts/18009?compare_to=18005&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18009, Order: 196503, Start Time: 2013-12-05 14:01:56, End Time: 2013-12-05 15:45:18
      To: 18005, Order: 196494, Start Time: 2013-12-05 11:48:03, End Time: 2013-12-05 13:37:22
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 27 (22 on baseline)
Performance Improvements: 69 (10 on baseline)
Unchanged Tests: 1014 (1078 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 51.32% (1.7228 => 2.6069, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 35.88% (0.1466 => 0.1992, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout/sieve: 21.54% (6.6922 => 8.1339, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/strcat: 16.81% (0.0815 => 0.0952, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout/matrix: 16.63% (1.8098 => 2.1107, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/ReedSolomon: 12.79% (8.5235 => 9.6137, std.dev.: 0.0796)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.53% (6.5142 => 7.0696, std.dev.: 0.2075)
  SingleSource/Benchmarks/McGill/misr: 8.03% (0.3800 => 0.4105, std.dev.: 0.0022)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.30% (1.4053 => 1.5079, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 6.91% (0.3560 => 0.3806, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/lists: 4.76% (7.1776 => 7.5195, std.dev.: 0.0041)
  MultiSource/Applications/hexxagon/hexxagon: 3.98% (14.9914 => 15.5882, std.dev.: 0.0144)
  MultiSource/Applications/spiff/spiff: 3.88% (2.8369 => 2.9471, std.dev.: 0.0224)
  SingleSource/Benchmarks/Misc/fp-convert: 3.23% (7.5146 => 7.7572, std.dev.: 0.0489)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.13% (0.4787 => 0.4937, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.12% (5.2676 => 5.4321, std.dev.: 0.0018)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.39% (0.6244 => 0.6393, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/oourafft: 2.34% (3.6439 => 3.7290, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.16% (0.7136 => 0.7290, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.5962 => 3.6664, std.dev.: 0.0015)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.83% (2.3792 => 2.4228, std.dev.: 0.0119)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.76% (15.7374 => 16.0137, std.dev.: 0.0861)
  MultiSource/Applications/viterbi/viterbi: 1.73% (2.6303 => 2.6757, std.dev.: 0.0058)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.60% (1.6493 => 1.6757, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc/mandel: 1.45% (1.0495 => 1.0647, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.35% (6.0106 => 6.0918, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.20% (3.8137 => 3.8593, std.dev.: 0.0070)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -39.05% (0.1649 => 0.1005, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -37.59% (0.0822 => 0.0513, std.dev.: 0.0066)
  SingleSource/UnitTests/Vector/constpool: -29.59% (12.9092 => 9.0892, std.dev.: 0.0559)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -29.57% (1.0276 => 0.7237, std.dev.: 0.0344)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -28.64% (0.9447 => 0.6741, std.dev.: 0.0166)
  MultiSource/Applications/obsequi/Obsequi: -23.17% (1.4993 => 1.1519, std.dev.: 0.0095)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -23.15% (0.0527 => 0.0405, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -22.05% (0.0857 => 0.0668, std.dev.: 0.0034)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.82% (0.0999 => 0.0781, std.dev.: 0.0082)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.91% (0.3796 => 0.3116, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/ffbench: -17.67% (0.0945 => 0.0778, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -16.17% (0.1620 => 0.1358, std.dev.: 0.0044)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.19% (0.1064 => 0.0913, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -14.12% (0.1105 => 0.0949, std.dev.: 0.0046)
  MultiSource/Benchmarks/Olden/health/health: -13.90% (0.1784 => 0.1536, std.dev.: 0.0040)
  MultiSource/Applications/hbd/hbd: -13.60% (1.7819 => 1.5395, std.dev.: 0.0375)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -12.67% (1.4011 => 1.2236, std.dev.: 0.0267)
  MultiSource/Applications/hexxagon/hexxagon: -12.56% (1.1950 => 1.0449, std.dev.: 0.0217)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -11.92% (0.3221 => 0.2837, std.dev.: 0.0122)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -11.69% (0.4310 => 0.3806, std.dev.: 0.0116)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -11.64% (1.3021 => 1.1505, std.dev.: 0.0157)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -11.39% (1.6275 => 1.4422, std.dev.: 0.0597)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -11.38% (1.8872 => 1.6725, std.dev.: 0.0452)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.10% (1.2698 => 1.1416, std.dev.: 0.0181)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.03% (6.3835 => 5.8706, std.dev.: 0.0852)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.95% (0.6752 => 0.6215, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.92% (1.4794 => 1.3622, std.dev.: 0.0180)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.58% (0.3437 => 0.3211, std.dev.: 0.0059)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.55% (2.6629 => 2.4885, std.dev.: 0.0348)
  MultiSource/Applications/sqlite3/sqlite3: -6.30% (16.9564 => 15.8874, std.dev.: 0.2986)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (25.5316 => 23.9220, std.dev.: 0.6085)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.89% (0.2089 => 0.1966, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/wc: -5.84% (0.2365 => 0.2227, std.dev.: 0.0001)
  MultiSource/Applications/lua/lua: -5.60% (4.5153 => 4.2625, std.dev.: 0.0913)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.51% (0.8566 => 0.8094, std.dev.: 0.0052)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -5.24% (0.2271 => 0.2152, std.dev.: 0.0025)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.21% (0.3818 => 0.3619, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.73% (0.9279 => 0.8840, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.51% (4.4517 => 4.2510, std.dev.: 0.0738)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.02% (5.7285 => 5.4984, std.dev.: 0.0857)
  SingleSource/Benchmarks/Shootout-C++/moments: -3.96% (0.3969 => 0.3812, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.88% (1.2594 => 1.2105, std.dev.: 0.0110)
  MultiSource/Benchmarks/sim/sim: -3.86% (0.3812 => 0.3665, std.dev.: 0.0039)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.37% (0.4955 => 0.4788, std.dev.: 0.0032)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.86% (1.1142 => 1.0935, std.dev.: 0.0057)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -24.32% (6.0438 => 4.5740, std.dev.: 0.0547)
  MultiSource/Applications/minisat/minisat: -23.78% (8.3851 => 6.3915, std.dev.: 0.7640)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -22.36% (3.6286 => 2.8172, std.dev.: 0.1003)
  SingleSource/Benchmarks/Shootout/heapsort: -22.27% (3.6836 => 2.8631, std.dev.: 0.0483)
  SingleSource/Benchmarks/Shootout/ary3: -19.60% (5.1724 => 4.1585, std.dev.: 0.2365)
  MultiSource/Benchmarks/Olden/health/health: -17.61% (0.3895 => 0.3209, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -16.59% (4.4842 => 3.7404, std.dev.: 0.1084)
  SingleSource/Benchmarks/Shootout-C++/ary3: -12.02% (5.4116 => 4.7610, std.dev.: 0.0354)
  SingleSource/Benchmarks/Shootout-C++/moments: -11.05% (0.1231 => 0.1095, std.dev.: 0.0023)
  MultiSource/Applications/obsequi/Obsequi: -10.47% (2.5532 => 2.2858, std.dev.: 0.0105)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.60% (31.4598 => 28.4381, std.dev.: 0.0646)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.35% (10.4144 => 9.4404, std.dev.: 0.1470)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -8.56% (2.4874 => 2.2744, std.dev.: 0.0530)
  SingleSource/Benchmarks/Shootout-C++/fibo: -7.41% (5.3907 => 4.9915, std.dev.: 0.1314)
  SingleSource/Benchmarks/Misc/salsa20: -6.97% (8.0570 => 7.4952, std.dev.: 0.1077)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.70% (0.2438 => 0.2299, std.dev.: 0.0049)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -4.77% (2.4756 => 2.3575, std.dev.: 0.0252)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -4.67% (4.1369 => 3.9437, std.dev.: 0.0142)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -4.50% (42.6273 => 40.7075, std.dev.: 0.6882)
  SingleSource/Benchmarks/Shootout-C++/methcall: -2.72% (7.8955 => 7.6805, std.dev.: 0.0345)
  MultiSource/Benchmarks/Olden/power/power: -2.01% (1.2068 => 1.1826, std.dev.: 0.0073)
  SingleSource/Benchmarks/McGill/chomp: -1.79% (1.0323 => 1.0138, std.dev.: 0.0023)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.20% (35.5254 => 35.0974, std.dev.: 0.0483)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.17% (2.9575 => 2.9230, std.dev.: 0.0033)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.24% (1.6685 => 2.6069, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout/sieve: 20.58% (6.7454 => 8.1339, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/matrix: 17.52% (1.7960 => 2.1107, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/ReedSolomon: 13.09% (8.5010 => 9.6137, std.dev.: 0.0796)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.10% (6.4210 => 7.0696, std.dev.: 0.2075)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.97% (1.3838 => 1.5079, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.70% (0.3534 => 0.3806, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/lists: 7.53% (6.9930 => 7.5195, std.dev.: 0.0041)
  SingleSource/Benchmarks/Stanford/Puzzle: 6.95% (0.1668 => 0.1784, std.dev.: 0.0033)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.06% (0.6939 => 0.7290, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/fp-convert: 4.98% (7.3892 => 7.7572, std.dev.: 0.0489)
  MultiSource/Applications/spiff/spiff: 4.77% (2.8130 => 2.9471, std.dev.: 0.0224)
  MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.9989 => 15.5882, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.50% (5.2486 => 5.4321, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.46% (5.9456 => 6.0918, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/oourafft: 2.16% (3.6501 => 3.7290, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.12% (15.6810 => 16.0137, std.dev.: 0.0861)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.11% (0.6261 => 0.6393, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.05% (2.5025 => 2.5538, std.dev.: 0.0075)
  MultiSource/Benchmarks/llubenchmark/llu: 1.51% (1.9763 => 2.0061, std.dev.: 0.0088)
  MultiSource/Applications/viterbi/viterbi: 1.48% (2.6366 => 2.6757, std.dev.: 0.0058)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.45% (2.3882 => 2.4228, std.dev.: 0.0119)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -17.75% (0.1938 => 0.1594, std.dev.: 0.0116)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -10.75% (0.3247 => 0.2898, std.dev.: 0.0041)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.87% (25.9661 => 23.9220, std.dev.: 0.6085)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.24% (0.2540 => 0.2356, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.45% (1.3676 => 1.2794, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.34% (1.3819 => 1.3081, std.dev.: 0.0273)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.50% (1.2544 => 1.2105, std.dev.: 0.0110)
  MultiSource/Applications/obsequi/Obsequi: -3.24% (1.1905 => 1.1519, std.dev.: 0.0095)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: -5.80% (10.0217 => 9.4404, std.dev.: 0.1470)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -4.34% (6.0535 => 5.7910, std.dev.: 0.0753)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131205/58e61f3b/attachment.html>


More information about the llvm-testresults mailing list