[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 8 20:49:53 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16125?compare_to=16121&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16125, Order: 192262, Start Time: 2013-10-09 02:04:45, End Time: 2013-10-09 03:52:56
      To: 16121, Order: 192247, Start Time: 2013-10-08 23:50:16, End Time: 2013-10-09 01:43:14
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 15 (29 on baseline)
Performance Improvements: 29 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1063 (1063 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: 14.79% (7.1520 => 8.2101, std.dev.: 0.2583)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.62% (6.5249 => 7.2829, std.dev.: 0.1487)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.32% (0.3554 => 0.3814, std.dev.: 0.0010)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.30% (97.8236 => 102.0281, std.dev.: 1.1211)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.64% (0.6293 => 0.6522, std.dev.: 0.0044)
  SingleSource/Regression/C/uint64_to_float: 3.16% (1.4250 => 1.4700, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.98% (3.1581 => 3.2207, std.dev.: 0.0039)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.94% (5.5274 => 5.6349, std.dev.: 0.0096)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.77% (23.4145 => 23.8278, std.dev.: 0.0101)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.39% (18.4534 => 18.7105, std.dev.: 0.0534)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.33% (2.3925 => 2.4244, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.32% (5.9431 => 6.0218, std.dev.: 0.0045)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (2.5076 => 2.5360, std.dev.: 0.0032)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.12% (2.1884 => 2.2130, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/fib2: 1.05% (3.6028 => 3.6406, std.dev.: 0.0072)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/15-trie/trie: -41.75% (0.1049 => 0.0611, std.dev.: 0.0023)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -26.86% (0.1046 => 0.0765, std.dev.: 0.0047)
  MultiSource/Benchmarks/McCat/05-eks/eks: -25.06% (0.7102 => 0.5322, std.dev.: 0.0178)
  MultiSource/Benchmarks/Olden/power/power: -23.94% (0.1834 => 0.1395, std.dev.: 0.0143)
  MultiSource/Benchmarks/McCat/09-vor/vor: -21.86% (0.4588 => 0.3585, std.dev.: 0.0110)
  MultiSource/Benchmarks/Olden/mst/mst: -20.74% (0.1712 => 0.1357, std.dev.: 0.0105)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -17.02% (0.3519 => 0.2920, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -14.57% (1.4476 => 1.2367, std.dev.: 0.0685)
  MultiSource/Benchmarks/McCat/18-imp/imp: -14.33% (0.4640 => 0.3975, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -13.80% (1.5355 => 1.3236, std.dev.: 0.0740)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -11.47% (1.4263 => 1.2627, std.dev.: 0.0622)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -10.49% (1.4934 => 1.3367, std.dev.: 0.0114)
  MultiSource/Applications/oggenc/oggenc: -9.92% (6.0852 => 5.4813, std.dev.: 0.2313)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.86% (0.1106 => 0.0997, std.dev.: 0.0034)
  MultiSource/Benchmarks/Olden/bh/bh: -9.59% (0.3638 => 0.3289, std.dev.: 0.0031)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.75% (1.1740 => 1.0947, std.dev.: 0.0060)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.25% (0.9914 => 0.9394, std.dev.: 0.0147)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.43% (1.9541 => 1.9261, std.dev.: 0.0103)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.37% (1.4490 => 1.4292, std.dev.: 0.0065)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -59.15% (0.3322 => 0.1357, std.dev.: 0.0683)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -39.53% (0.0296 => 0.0179, std.dev.: 0.0037)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -30.89% (0.1975 => 0.1365, std.dev.: 0.0170)
  MultiSource/Applications/oggenc/oggenc: -25.49% (0.2181 => 0.1625, std.dev.: 0.0116)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -24.58% (0.1139 => 0.0859, std.dev.: 0.0104)
  MultiSource/Benchmarks/McCat/09-vor/vor: -12.81% (0.1304 => 0.1137, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/em3d/em3d: -7.62% (5.4458 => 5.0311, std.dev.: 0.1099)
  MultiSource/Benchmarks/Olden/bh/bh: -6.26% (2.5355 => 2.3769, std.dev.: 0.0567)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.57% (5.8832 => 5.7909, std.dev.: 0.0355)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.45% (1.1447 => 1.1281, std.dev.: 0.0063)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -9.94% (0.1499 => 0.1350, std.dev.: 0.0190)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.75% (0.3096 => 0.3243, std.dev.: 0.0034)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.2728 => 1.3066, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.8775 => 1.9261, std.dev.: 0.0103)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.28% (4.5883 => 4.6929, std.dev.: 0.0156)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.4033 => 1.4292, std.dev.: 0.0065)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.78% (1.0756 => 1.0947, std.dev.: 0.0060)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.72% (0.6296 => 0.6404, std.dev.: 0.0014)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.53% (7.6426 => 12.4978, std.dev.: 0.0764)
  SingleSource/Benchmarks/Shootout/sieve: 13.63% (7.2254 => 8.2101, std.dev.: 0.2583)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.04% (6.4425 => 7.2829, std.dev.: 0.1487)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.56% (1.1013 => 1.2176, std.dev.: 0.0402)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.15% (0.8273 => 0.8947, std.dev.: 0.0159)
  SingleSource/UnitTests/Vector/multiplies: 6.62% (0.5561 => 0.5929, std.dev.: 0.0088)
  MultiSource/Applications/spiff/spiff: 5.57% (2.8194 => 2.9764, std.dev.: 0.0533)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.42% (96.7834 => 102.0281, std.dev.: 1.1211)
  SingleSource/Benchmarks/McGill/misr: 5.09% (0.3771 => 0.3963, std.dev.: 0.0001)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.90% (5.3716 => 5.6349, std.dev.: 0.0096)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.66% (0.2842 => 0.2946, std.dev.: 0.0029)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (2.1472 => 2.2130, std.dev.: 0.0012)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.51% (0.5182 => 0.5312, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/power/power: 2.37% (1.2170 => 1.2459, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (3.1569 => 3.2207, std.dev.: 0.0039)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (2.4920 => 2.5423, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.65% (1.7652 => 1.7943, std.dev.: 0.0095)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.52% (23.4704 => 23.8278, std.dev.: 0.0101)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.37% (3.8582 => 3.9110, std.dev.: 0.0100)
  SingleSource/Benchmarks/Shootout/fib2: 1.22% (3.5966 => 3.6406, std.dev.: 0.0072)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.21% (16.7972 => 17.0005, std.dev.: 0.0507)
  SingleSource/Regression/C/uint64_to_float: 1.18% (1.4528 => 1.4700, std.dev.: 0.0054)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.04% (0.1483 => 0.1171, std.dev.: 0.0014)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.71% (0.5226 => 0.2367, std.dev.: 0.0023)
  MultiSource/Applications/sgefa/sgefa: -46.87% (1.5790 => 0.8389, std.dev.: 0.0391)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -28.00% (0.0400 => 0.0288, std.dev.: 0.0011)
  SingleSource/Benchmarks/Linpack/linpack-pc: -22.33% (57.2347 => 44.4553, std.dev.: 2.8866)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.81% (15.9508 => 12.7903, std.dev.: 0.4680)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -14.56% (4.0006 => 3.4180, std.dev.: 0.1486)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.15% (20.8247 => 18.7105, std.dev.: 0.0534)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.94% (3.4956 => 3.2180, std.dev.: 0.0003)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.34% (50.0284 => 46.3554, std.dev.: 0.4975)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.90% (4.3592 => 4.1891, std.dev.: 0.0659)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.38% (3.7437 => 3.6172, std.dev.: 0.0338)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.23% (2.5938 => 2.5360, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.66% (17.1431 => 16.8586, std.dev.: 0.1089)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.15% (0.1348 => 0.1350, std.dev.: 0.0190)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131008/070b8ef8/attachment.html>


More information about the llvm-testresults mailing list