[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 18 01:39:48 PST 2013


http://llvm.org/perf/db_default/v4/nts/18557?compare_to=18554&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18557, Order: 197552, Start Time: 2013-12-18 08:01:34, End Time: 2013-12-18 09:44:07
      To: 18554, Order: 197550, Start Time: 2013-12-18 05:54:41, End Time: 2013-12-18 07:38:43
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 17 (34 on baseline)
Performance Improvements: 15 (41 on baseline)
Unchanged Tests: 1078 (1035 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.29% (1.3151 => 1.3321, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 64.09% (1.5894 => 2.6080, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.19% (0.3562 => 0.3818, std.dev.: 0.0020)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 5.37% (1.4308 => 1.5077, std.dev.: 0.0001)
  MultiSource/Benchmarks/sim/sim: 4.91% (3.8287 => 4.0165, std.dev.: 0.0038)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.75% (1.9904 => 2.0850, std.dev.: 0.0012)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.25% (2.4052 => 2.4834, std.dev.: 0.0019)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.06% (5.4762 => 5.6437, std.dev.: 0.0141)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.94% (1.3060 => 1.3444, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.62% (1.6004 => 1.6423, std.dev.: 0.0072)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.61% (3.7310 => 3.8284, std.dev.: 0.0033)
  MultiSource/Applications/aha/aha: 2.07% (3.6982 => 3.7746, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.03% (6.5589 => 6.6920, std.dev.: 0.0151)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.95% (2.4782 => 2.5265, std.dev.: 0.0015)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.87% (7.8485 => 7.9950, std.dev.: 0.0031)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.42% (1.8709 => 1.8975, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.29% (3.1534 => 3.1942, std.dev.: 0.0126)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -6.83% (0.1494 => 0.1392, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.36% (0.3189 => 0.3082, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.34% (0.6985 => 0.6752, std.dev.: 0.0055)
  MultiSource/Applications/JM/ldecod/ldecod: -2.42% (7.7595 => 7.5720, std.dev.: 0.0039)
  MultiSource/Applications/spiff/spiff: -1.98% (0.9200 => 0.9018, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.73% (0.7040 => 0.6918, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.69% (0.8953 => 0.8802, std.dev.: 0.0052)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.60% (5.1513 => 5.0689, std.dev.: 0.0179)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.43% (1.1665 => 1.1498, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/football/football: -1.32% (1.0104 => 0.9971, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.09% (1.1086 => 1.0965, std.dev.: 0.0022)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/city/city: -21.38% (0.0491 => 0.0386, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -4.91% (3.0299 => 2.8810, std.dev.: 0.0267)
  MultiSource/Benchmarks/llubenchmark/llu: -1.79% (1.9986 => 1.9629, std.dev.: 0.0073)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.45% (1.3036 => 1.2847, std.dev.: 0.0059)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 39.28% (15.7419 => 21.9254, std.dev.: 0.0606)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 25.81% (0.3859 => 0.4855, std.dev.: 0.0076)
  MultiSource/Applications/lemon/lemon: 9.02% (1.2200 => 1.3300, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.20% (0.6412 => 0.6617, std.dev.: 0.0053)
  MultiSource/Applications/oggenc/oggenc: 2.08% (5.4968 => 5.6110, std.dev.: 0.0300)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.95% (0.6322 => 0.6445, std.dev.: 0.0030)
  MultiSource/Applications/minisat/minisat: 1.42% (0.7533 => 0.7640, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.25% (1.0830 => 1.0965, std.dev.: 0.0022)
  MultiSource/Applications/siod/siod: 1.14% (2.5491 => 2.5781, std.dev.: 0.0054)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.31% (1.6685 => 2.6080, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.03% (5.9583 => 6.9134, std.dev.: 0.1482)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.87% (1.0232 => 1.1344, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.95% (1.3838 => 1.5077, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/ReedSolomon: 8.91% (8.5010 => 9.2581, std.dev.: 0.2200)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.49% (1.1019 => 1.1955, std.dev.: 0.0007)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 8.04% (0.3534 => 0.3818, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout/lists: 7.34% (6.9930 => 7.5062, std.dev.: 0.0196)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2556 => 1.3444, std.dev.: 0.0009)
  MultiSource/Applications/aha/aha: 5.89% (3.5645 => 3.7746, std.dev.: 0.0040)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.68% (1.9729 => 2.0850, std.dev.: 0.0012)
  MultiSource/Applications/siod/siod: 4.96% (3.4258 => 3.5957, std.dev.: 0.0093)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.69% (4.1840 => 4.3803, std.dev.: 0.0113)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.63% (1.2278 => 1.2847, std.dev.: 0.0059)
  MultiSource/Applications/sgefa/sgefa: 3.81% (0.8745 => 0.9078, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.07% (1.8409 => 1.8975, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.73% (1.5986 => 1.6423, std.dev.: 0.0072)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.62% (5.4994 => 5.6437, std.dev.: 0.0141)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.60% (3.7315 => 3.8284, std.dev.: 0.0033)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.50% (0.4526 => 0.4639, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.49% (6.5291 => 6.6920, std.dev.: 0.0151)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.98% (15.6810 => 15.9916, std.dev.: 0.0771)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.93% (11.7894 => 12.0174, std.dev.: 0.0242)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (2.4894 => 2.5348, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.25% (3.1547 => 3.1942, std.dev.: 0.0126)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -17.91% (0.1938 => 0.1591, std.dev.: 0.0031)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.18% (0.2540 => 0.2256, std.dev.: 0.0060)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.29% (0.1088 => 0.0976, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.41% (0.3402 => 0.3082, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.98% (1.5034 => 1.3835, std.dev.: 0.0119)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.91% (0.3247 => 0.2990, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.88% (0.1523 => 0.1403, std.dev.: 0.0011)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.86% (0.2824 => 0.2602, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.83% (0.1673 => 0.1542, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.00% (0.6882 => 0.6400, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.41% (1.3676 => 1.2799, std.dev.: 0.0259)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.29% (2.0207 => 1.8935, std.dev.: 0.0082)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -6.07% (1.0197 => 0.9578, std.dev.: 0.0125)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.87% (0.2810 => 0.2645, std.dev.: 0.0017)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.58% (0.2758 => 0.2604, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.40% (1.3819 => 1.3073, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.64% (1.1409 => 1.0880, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.37% (1.2824 => 1.2263, std.dev.: 0.0061)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.33% (15.4053 => 14.7375, std.dev.: 0.0722)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.24% (1.3127 => 1.2570, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.15% (1.2914 => 1.2378, std.dev.: 0.0174)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.70% (1.4449 => 1.3915, std.dev.: 0.0094)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.50% (0.3714 => 0.3584, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.47% (0.6995 => 0.6752, std.dev.: 0.0055)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.93% (7.5124 => 7.2921, std.dev.: 0.0073)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.93% (0.5322 => 0.5166, std.dev.: 0.0040)
  MultiSource/Applications/d/make_dparser: -2.87% (3.6428 => 3.5384, std.dev.: 0.0134)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.82% (0.7375 => 0.7167, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.78% (1.3702 => 1.3321, std.dev.: 0.0045)
  MultiSource/Applications/obsequi/Obsequi: -2.34% (1.1905 => 1.1627, std.dev.: 0.0108)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.31% (4.7807 => 4.6704, std.dev.: 0.0075)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (1.3256 => 1.3075, std.dev.: 0.0020)
  MultiSource/Applications/kimwitu++/kc: -1.13% (18.6861 => 18.4749, std.dev.: 0.0401)
  MultiSource/Applications/JM/ldecod/ldecod: -1.10% (7.6560 => 7.5720, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.44% (2.8850 => 2.3818, std.dev.: 0.1469)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.59% (1.4335 => 1.3104, std.dev.: 0.0432)
  MultiSource/Applications/sqlite3/sqlite3: -4.38% (4.2978 => 4.1094, std.dev.: 0.0492)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.84% (2.5559 => 2.4834, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.39% (6.0535 => 5.9091, std.dev.: 0.0083)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.16% (40.4190 => 39.5449, std.dev.: 0.3323)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.33% (3.5813 => 3.5338, std.dev.: 0.0129)

Report Time: 1.33s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131218/e761eb36/attachment.html>


More information about the llvm-testresults mailing list