[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 31 11:52:38 PST 2013


http://llvm.org/perf/db_default/v4/nts/19407?compare_to=19402&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19407, Order: 198265, Start Time: 2013-12-31 18:16:07, End Time: 2013-12-31 19:57:16
      To: 19402, Order: 198263, Start Time: 2013-12-31 16:07:59, End Time: 2013-12-31 17:51:35
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 22 (37 on baseline)
Performance Improvements: 10 (45 on baseline)
Unchanged Tests: 1078 (1028 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 35.05% (1.6574 => 2.2383, std.dev.: 0.1752)
  SingleSource/Benchmarks/Shootout/matrix: 16.39% (1.8065 => 2.1026, std.dev.: 0.0042)
  MultiSource/Benchmarks/nbench/nbench: 13.99% (18.8793 => 21.5202, std.dev.: 0.8668)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.18% (1.0218 => 1.1360, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.60% (6.5595 => 7.1239, std.dev.: 0.1788)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.18% (0.4366 => 0.4636, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/lists: 5.47% (7.1211 => 7.5106, std.dev.: 0.0117)
  MultiSource/Applications/obsequi/Obsequi: 5.46% (2.1988 => 2.3188, std.dev.: 0.0127)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 5.07% (0.4968 => 0.5220, std.dev.: 0.0005)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 4.69% (1.1414 => 1.1949, std.dev.: 0.0008)
  MultiSource/Benchmarks/sim/sim: 4.59% (3.8351 => 4.0111, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.22% (5.0396 => 5.2522, std.dev.: 0.0130)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (0.6362 => 0.6590, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/fp-convert: 2.48% (7.6113 => 7.8003, std.dev.: 0.0394)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.43% (5.8680 => 6.0106, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.37% (5.2787 => 5.4038, std.dev.: 0.0326)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.32% (1.8502 => 1.8931, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 2.27% (1.4728 => 1.5063, std.dev.: 0.0007)
  MultiSource/Applications/hexxagon/hexxagon: 1.67% (15.3329 => 15.5886, std.dev.: 0.0149)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (1.6680 => 1.6897, std.dev.: 0.0019)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (7.8395 => 7.9338, std.dev.: 0.0315)
  SingleSource/Benchmarks/Shootout/methcall: 1.16% (8.5953 => 8.6948, std.dev.: 0.0212)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.66% (0.2949 => 0.2841, std.dev.: 0.0017)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -3.40% (0.3826 => 0.3696, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.14% (0.4974 => 0.4818, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.62% (0.5680 => 0.5531, std.dev.: 0.0056)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.52% (1.4266 => 1.3906, std.dev.: 0.0061)
  MultiSource/Benchmarks/Prolangs-C/football/football: -1.13% (1.0116 => 1.0002, std.dev.: 0.0044)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: -7.09% (4.0615 => 3.7735, std.dev.: 0.0602)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.19% (0.4474 => 0.4197, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/ary3: -6.05% (4.8487 => 4.5554, std.dev.: 0.1135)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -1.63% (0.7744 => 0.7618, std.dev.: 0.0039)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 38.74% (15.7419 => 21.8401, std.dev.: 0.1004)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 24.49% (0.3859 => 0.4804, std.dev.: 0.0060)
  MultiSource/Applications/lemon/lemon: 9.49% (1.2200 => 1.3358, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.18% (0.6412 => 0.6680, std.dev.: 0.0013)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.88% (1.5198 => 1.5635, std.dev.: 0.0016)
  MultiSource/Applications/siod/siod: 1.76% (2.5491 => 2.5940, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.49% (0.8787 => 0.8918, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.11% (5.0556 => 5.1115, std.dev.: 0.0071)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.70% (2.8607 => 4.0250, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/pi: 34.15% (1.6685 => 2.2383, std.dev.: 0.1752)
  SingleSource/Benchmarks/Shootout/matrix: 17.07% (1.7960 => 2.1026, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.10% (5.9583 => 6.9174, std.dev.: 0.1459)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.02% (1.0232 => 1.1360, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.95% (6.4210 => 7.1239, std.dev.: 0.1788)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.85% (1.3838 => 1.5063, std.dev.: 0.0007)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.44% (1.1019 => 1.1949, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.91% (3.3810 => 3.6486, std.dev.: 0.0083)
  SingleSource/Benchmarks/Shootout/lists: 7.40% (6.9930 => 7.5106, std.dev.: 0.0117)
  SingleSource/Benchmarks/Stanford/Puzzle: 6.12% (0.1668 => 0.1770, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/fp-convert: 5.56% (7.3892 => 7.8003, std.dev.: 0.0394)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.35% (1.2278 => 1.2935, std.dev.: 0.0022)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.25% (0.6261 => 0.6590, std.dev.: 0.0011)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.09% (0.6939 => 0.7292)
  MultiSource/Applications/siod/siod: 4.90% (3.4258 => 3.5937, std.dev.: 0.0272)
  MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.9989 => 15.5886, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.80% (5.0601 => 5.2522, std.dev.: 0.0130)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.84% (1.8409 => 1.8931, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.61% (15.6810 => 16.0899, std.dev.: 0.0383)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.55% (3.7315 => 3.8268, std.dev.: 0.0028)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.43% (0.4526 => 0.4636, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.99% (5.8933 => 6.0106, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.95% (5.9126 => 6.0278, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.87% (11.7894 => 12.0101, std.dev.: 0.0393)
  MultiSource/Applications/viterbi/viterbi: 1.62% (2.6366 => 2.6794, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/fib2: 1.47% (3.5960 => 3.6487, std.dev.: 0.0041)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.37% (3.1455 => 3.1886, std.dev.: 0.0080)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (1.6699 => 1.6897, std.dev.: 0.0019)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.74% (0.0688 => 0.0504, std.dev.: 0.0018)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -21.21% (0.0528 => 0.0416, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -17.91% (0.1938 => 0.1591, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.48% (0.1088 => 0.0974, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.91% (0.1523 => 0.1372, std.dev.: 0.0032)
  MultiSource/Benchmarks/Bullet/bullet: -9.60% (36.6274 => 33.1110, std.dev.: 0.5478)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.52% (0.3402 => 0.3112, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/mst/mst: -7.96% (0.1369 => 0.1260, std.dev.: 0.0042)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.65% (1.0197 => 0.9417, std.dev.: 0.0143)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.50% (1.5034 => 1.3906, std.dev.: 0.0061)
  MultiSource/Applications/viterbi/viterbi: -7.47% (0.2021 => 0.1870, std.dev.: 0.0055)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.40% (0.2540 => 0.2352, std.dev.: 0.0029)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.98% (0.2824 => 0.2627, std.dev.: 0.0020)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.1774 => 0.1651, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.74% (5.8749 => 5.4787, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.48% (0.6882 => 0.6436, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.80% (2.0207 => 1.9036, std.dev.: 0.0433)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2758 => 0.2600, std.dev.: 0.0037)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.50% (0.2691 => 0.2543, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.38% (0.2251 => 0.2130, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.98% (0.2810 => 0.2670, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.75% (1.4277 => 1.3599, std.dev.: 0.0245)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.44% (1.4449 => 1.3807, std.dev.: 0.0174)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.38% (0.6942 => 0.6638, std.dev.: 0.0108)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.26% (15.4053 => 14.7494, std.dev.: 0.1850)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.86% (1.2914 => 1.2415, std.dev.: 0.0171)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.72% (0.3714 => 0.3576, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.60% (1.3127 => 1.2654, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.35% (0.6995 => 0.6761, std.dev.: 0.0088)
  MultiSource/Benchmarks/nbench/nbench: -2.92% (1.2647 => 1.2278, std.dev.: 0.0039)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.79% (1.1767 => 1.1439, std.dev.: 0.0018)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.63% (0.5322 => 0.5182, std.dev.: 0.0020)
  MultiSource/Applications/d/make_dparser: -2.29% (3.6428 => 3.5594, std.dev.: 0.0133)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.72% (0.8880 => 0.8727, std.dev.: 0.0027)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.70% (1.1608 => 1.1411, std.dev.: 0.0040)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.49% (1.6656 => 1.6408, std.dev.: 0.0037)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.40% (1.3256 => 1.3071, std.dev.: 0.0041)
  MultiSource/Applications/ClamAV/clamscan: -1.14% (16.9661 => 16.7721, std.dev.: 0.0586)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.84% (1.4335 => 1.3068, std.dev.: 0.0088)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -6.36% (10.0217 => 9.3842, std.dev.: 0.2107)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -5.01% (2.9945 => 2.8446, std.dev.: 0.0072)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.61% (0.4400 => 0.4197, std.dev.: 0.0034)
  MultiSource/Applications/lemon/lemon: -4.11% (0.8632 => 0.8277, std.dev.: 0.0118)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.60% (6.0535 => 5.8353, std.dev.: 0.0263)
  MultiSource/Applications/sqlite3/sqlite3: -2.24% (4.2978 => 4.2014, std.dev.: 0.0031)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131231/143d4ab3/attachment.html>


More information about the llvm-testresults mailing list