[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Dec 8 23:58:32 PST 2013


http://llvm.org/perf/db_default/v4/nts/18182?compare_to=18178&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18182, Order: 196757, Start Time: 2013-12-09 06:21:49, End Time: 2013-12-09 08:02:43
      To: 18178, Order: 196748, Start Time: 2013-12-09 04:11:25, End Time: 2013-12-09 05:57:32
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 29 (27 on baseline)
Performance Improvements: 46 (40 on baseline)
Unchanged Tests: 1035 (1043 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.4479 => 1.4683, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 57.81% (1.6538 => 2.6098, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 30.25% (0.1534 => 0.1998, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/flops: 13.94% (8.1286 => 9.2621, std.dev.: 0.1650)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.81% (1.3733 => 1.5080, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.83% (0.3539 => 0.3816, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.68% (1.2566 => 1.3531, std.dev.: 0.0166)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.57% (0.4334 => 0.4662, std.dev.: 0.0001)
  MultiSource/Applications/JM/lencod/lencod: 7.08% (7.7951 => 8.3471, std.dev.: 0.1347)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 5.96% (1.2325 => 1.3059, std.dev.: 0.0069)
  MultiSource/Applications/aha/aha: 5.63% (3.5714 => 3.7723, std.dev.: 0.0064)
  MultiSource/Benchmarks/sim/sim: 5.41% (3.8081 => 4.0142, std.dev.: 0.0056)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 5.33% (0.4954 => 0.5218, std.dev.: 0.0008)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.80% (2.0001 => 2.0962, std.dev.: 0.0014)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.52% (1.2376 => 1.2935, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.02% (0.3833 => 0.3987, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.76% (4.2210 => 4.3797, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.53% (5.1268 => 5.3076, std.dev.: 0.0462)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 3.34% (1.5918 => 1.6450, std.dev.: 0.0027)
  MultiSource/Applications/siod/siod: 3.19% (3.4362 => 3.5458, std.dev.: 0.0253)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.92% (5.4726 => 5.6322, std.dev.: 0.0197)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.88% (2.6304 => 2.7062, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.39% (3.5798 => 3.6653, std.dev.: 0.0012)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.5153 => 0.5272, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.09% (5.3248 => 5.4360, std.dev.: 0.0026)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.93% (2.3782 => 2.4241, std.dev.: 0.0048)
  MultiSource/Applications/viterbi/viterbi: 1.55% (2.6330 => 2.6738, std.dev.: 0.0027)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.53% (3.8083 => 3.8665, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.21% (6.7597 => 6.8418, std.dev.: 0.0005)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -38.86% (0.1315 => 0.0804, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -25.44% (0.0963 => 0.0718, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -20.25% (0.1570 => 0.1252, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -15.69% (0.0886 => 0.0747, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -14.60% (0.0870 => 0.0743, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.55% (0.0756 => 0.0646, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -14.07% (0.0846 => 0.0727, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.0962 => 0.0827, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc/oourafft: -9.29% (0.2703 => 0.2452, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.58% (2.9450 => 2.7512, std.dev.: 0.0159)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.32% (1.2144 => 1.1376, std.dev.: 0.0088)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.00% (4.5207 => 4.2495, std.dev.: 0.0025)
  MultiSource/Applications/hbd/hbd: -5.84% (1.6663 => 1.5690, std.dev.: 0.0024)
  MultiSource/Applications/sqlite3/sqlite3: -4.81% (16.4492 => 15.6584, std.dev.: 0.0770)
  MultiSource/Applications/Burg/burg: -3.97% (1.4747 => 1.4162, std.dev.: 0.0208)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.95% (0.3442 => 0.3306, std.dev.: 0.0044)
  MultiSource/Applications/spiff/spiff: -3.34% (0.9220 => 0.8912, std.dev.: 0.0043)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.30% (0.5245 => 0.5072, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.88% (2.0316 => 1.9731, std.dev.: 0.0004)
  MultiSource/Applications/minisat/minisat: -2.62% (0.7682 => 0.7481, std.dev.: 0.0009)
  MultiSource/Applications/lemon/lemon: -2.55% (1.2366 => 1.2051, std.dev.: 0.0040)
  MultiSource/Applications/JM/lencod/lencod: -2.26% (17.5751 => 17.1781, std.dev.: 0.0054)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.11% (0.8296 => 0.8121, std.dev.: 0.0025)
  MultiSource/Applications/lua/lua: -2.06% (4.3407 => 4.2512, std.dev.: 0.0323)
  MultiSource/Applications/d/make_dparser: -1.80% (3.5876 => 3.5229, std.dev.: 0.0129)
  MultiSource/Applications/oggenc/oggenc: -1.78% (5.5635 => 5.4646, std.dev.: 0.0004)
  MultiSource/Applications/SPASS/SPASS: -1.51% (16.6412 => 16.3900, std.dev.: 0.0824)
  MultiSource/Applications/JM/ldecod/ldecod: -1.42% (7.6595 => 7.5504, std.dev.: 0.0213)
  MultiSource/Applications/siod/siod: -1.33% (2.5574 => 2.5235, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.24% (1.2515 => 1.2360, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -11.49% (40.5843 => 35.9208, std.dev.: 0.3463)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -9.57% (0.1974 => 0.1785, std.dev.: 0.0009)
  MultiSource/Applications/minisat/minisat: -7.52% (6.9082 => 6.3884, std.dev.: 0.1299)
  SingleSource/Benchmarks/Misc/salsa20: -7.30% (8.0767 => 7.4871, std.dev.: 0.0540)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -5.93% (2.8250 => 2.6575, std.dev.: 0.0338)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -5.92% (4.1849 => 3.9372, std.dev.: 0.0926)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.87% (22.2729 => 20.9648, std.dev.: 0.2610)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.29% (0.6565 => 0.6218, std.dev.: 0.0130)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.88% (63.3813 => 60.2874, std.dev.: 0.0290)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -4.36% (42.3850 => 40.5388, std.dev.: 0.1443)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -3.97% (4.1689 => 4.0033, std.dev.: 0.0066)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.94% (0.3480 => 0.3343, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -3.71% (3.0128 => 2.9009, std.dev.: 0.0231)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -2.64% (3.6863 => 3.5890, std.dev.: 0.0297)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.80% (4.1176 => 4.0434, std.dev.: 0.0279)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.21% (2.9519 => 2.9161, std.dev.: 0.0132)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.42% (1.6685 => 2.6098, std.dev.: 0.0007)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.53% (0.1668 => 0.1827, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.98% (1.3838 => 1.5080, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.98% (0.3534 => 0.3816, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.77% (1.2556 => 1.3531, std.dev.: 0.0166)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.25% (1.9729 => 2.0962, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.24% (3.5027 => 3.7214, std.dev.: 0.0023)
  MultiSource/Applications/aha/aha: 5.83% (3.5645 => 3.7723, std.dev.: 0.0064)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.35% (1.2278 => 1.2935, std.dev.: 0.0049)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.09% (0.6939 => 0.7292, std.dev.: 0.0003)
  MultiSource/Applications/JM/lencod/lencod: 5.06% (7.9450 => 8.3471, std.dev.: 0.1347)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.68% (4.1840 => 4.3797, std.dev.: 0.0166)
  MultiSource/Applications/spiff/spiff: 3.93% (2.8130 => 2.9236, std.dev.: 0.0388)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.57% (5.2486 => 5.4360, std.dev.: 0.0026)
  MultiSource/Applications/siod/siod: 3.50% (3.4258 => 3.5458, std.dev.: 0.0253)
  SingleSource/Benchmarks/McGill/misr: 3.20% (0.4029 => 0.4158, std.dev.: 0.0003)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.13% (0.5112 => 0.5272, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.11% (1.2463 => 1.2851, std.dev.: 0.0086)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.00% (0.4526 => 0.4662, std.dev.: 0.0001)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.97% (2.6281 => 2.7062, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.90% (1.5986 => 1.6450, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.89% (15.6810 => 16.1339, std.dev.: 0.1534)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.41% (5.4994 => 5.6322, std.dev.: 0.0197)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.96% (5.8933 => 6.0088, std.dev.: 0.0150)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.50% (2.3882 => 2.4241, std.dev.: 0.0048)
  MultiSource/Applications/viterbi/viterbi: 1.41% (2.6366 => 2.6738, std.dev.: 0.0027)
  SingleSource/Benchmarks/McGill/chomp: 1.18% (1.0099 => 1.0218, std.dev.: 0.0010)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.60% (0.0688 => 0.0505, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -13.73% (0.1938 => 0.1672, std.dev.: 0.0053)
  MultiSource/Benchmarks/Bullet/bullet: -9.81% (36.6274 => 33.0338, std.dev.: 1.0663)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.81% (0.2540 => 0.2367, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.41% (1.3819 => 1.2933, std.dev.: 0.0206)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.38% (2.0207 => 1.8918, std.dev.: 0.0435)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.02% (1.4113 => 1.3263, std.dev.: 0.0268)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.83% (1.2824 => 1.2077, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.69% (1.5305 => 1.4434, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (1.4277 => 1.3503, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.37% (0.2810 => 0.2659, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.24% (1.3146 => 1.2457, std.dev.: 0.0102)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.01% (0.3714 => 0.3528, std.dev.: 0.0063)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.77% (1.1409 => 1.0865, std.dev.: 0.0087)
  MultiSource/Applications/obsequi/Obsequi: -4.11% (1.1905 => 1.1416, std.dev.: 0.0112)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.97% (0.6995 => 0.6717, std.dev.: 0.0105)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -3.94% (0.2691 => 0.2585, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.93% (1.2544 => 1.2051, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.69% (1.4449 => 1.3916, std.dev.: 0.0115)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -3.32% (1.1767 => 1.1376, std.dev.: 0.0088)
  MultiSource/Applications/d/make_dparser: -3.29% (3.6428 => 3.5229, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.13% (1.2583 => 1.2189, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.57% (1.2952 => 1.2619, std.dev.: 0.0056)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.52% (0.5322 => 0.5188, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.45% (1.2670 => 1.2360, std.dev.: 0.0015)
  MultiSource/Applications/SPASS/SPASS: -1.96% (16.7177 => 16.3900, std.dev.: 0.0824)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (5.5433 => 5.4437, std.dev.: 0.0332)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.71% (0.6322 => 0.6214, std.dev.: 0.0013)
  MultiSource/Applications/kimwitu++/kc: -1.45% (18.6861 => 18.4154, std.dev.: 0.0535)
  MultiSource/Applications/ClamAV/clamscan: -1.43% (16.9661 => 16.7229, std.dev.: 0.0264)
  MultiSource/Applications/JM/ldecod/ldecod: -1.38% (7.6560 => 7.5504, std.dev.: 0.0213)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.25% (0.8224 => 0.8121, std.dev.: 0.0025)
  MultiSource/Applications/lemon/lemon: -1.22% (1.2200 => 1.2051, std.dev.: 0.0040)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.15% (1.1016 => 1.0889, std.dev.: 0.0044)
  MultiSource/Applications/siod/siod: -1.00% (2.5491 => 2.5235, std.dev.: 0.0075)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.90% (1.4335 => 1.3059, std.dev.: 0.0069)
  MultiSource/Benchmarks/Bullet/bullet: -5.25% (7.4226 => 7.0326, std.dev.: 0.0368)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.17% (6.0535 => 5.8619, std.dev.: 0.0122)
  SingleSource/Benchmarks/Shootout/hash: -1.61% (5.1896 => 5.1059, std.dev.: 0.0319)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.30% (61.0792 => 60.2874, std.dev.: 0.0290)

Report Time: 0.98s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131209/13105a12/attachment.html>


More information about the llvm-testresults mailing list