[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jun 1 16:03:28 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11960?compare_to=11956&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11960, Order: 183079, Start Time: 2013-06-01 21:20:23, End Time: 2013-06-01 23:04:04
      To: 11956, Order: 183076, Start Time: 2013-06-01 19:12:06, End Time: 2013-06-01 20:56:40
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 11 (9 on baseline)
Performance Improvements: 3 (61 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1093 (1037 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (2.4754 => 2.5134, std.dev.: 0.0020)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.04% (1.0131 => 1.0236, std.dev.: 0.0029)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 21.41% (1.5618 => 1.8962, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout/matrix: 17.96% (1.7363 => 2.0481, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 13.85% (3.6242 => 4.1262, std.dev.: 0.0074)
  SingleSource/Benchmarks/Shootout-C++/hash: 8.36% (0.7204 => 0.7806, std.dev.: 0.0006)
  MultiSource/Benchmarks/nbench/nbench: 5.64% (20.9689 => 22.1523, std.dev.: 0.2998)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.47% (3.0229 => 3.1279, std.dev.: 0.0245)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.80% (5.0275 => 5.1685, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.00% (5.7813 => 5.8967, std.dev.: 0.0173)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.55% (4.7526 => 4.8261, std.dev.: 0.0188)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.33% (7.5487 => 6.7690, std.dev.: 0.1893)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.59% (0.1245 => 0.1138, std.dev.: 0.0036)
  MultiSource/Benchmarks/FreeBench/neural/neural: -3.16% (0.3452 => 0.3343, std.dev.: 0.0038)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.02% (0.1425 => 0.1468, std.dev.: 0.0336)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.58% (0.2721 => 0.2900, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: 18.01% (1.7355 => 2.0481, std.dev.: 0.0011)
  MultiSource/Applications/sgefa/sgefa: 17.75% (1.1695 => 1.3771, std.dev.: 0.0448)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.39% (0.8276 => 0.8888, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.46% (3.0234 => 3.1279, std.dev.: 0.0245)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.51% (4.3727 => 4.4825, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.17% (3.9713 => 4.0573, std.dev.: 0.0251)
  SingleSource/Benchmarks/Misc/ffbench: 1.24% (1.3696 => 1.3866, std.dev.: 0.0065)
  MultiSource/Applications/siod/siod: 1.09% (3.7240 => 3.7645, std.dev.: 0.0107)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.13% (0.1113 => 0.0722, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/whetstone: -16.23% (0.1097 => 0.0919, std.dev.: 0.0065)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.67% (0.7918 => 0.6836, std.dev.: 0.0186)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.77% (0.1151 => 0.1004, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -12.19% (0.1075 => 0.0944, std.dev.: 0.0008)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.94% (51.0211 => 45.9480, std.dev.: 0.1086)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.89% (0.8025 => 0.7231, std.dev.: 0.0236)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.67% (0.2006 => 0.1812, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.98% (1.7804 => 1.6206, std.dev.: 0.0195)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.71% (5.4314 => 4.9581, std.dev.: 0.1625)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.27% (1.0314 => 0.9461, std.dev.: 0.0114)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -7.10% (0.1886 => 0.1752, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.10% (0.7381 => 0.6857, std.dev.: 0.0014)
  MultiSource/Benchmarks/McCat/18-imp/imp: -6.10% (0.4199 => 0.3943, std.dev.: 0.0035)
  MultiSource/Applications/kimwitu++/kc: -6.07% (20.1855 => 18.9606, std.dev.: 0.3312)
  MultiSource/Benchmarks/Olden/em3d/em3d: -6.05% (0.2117 => 0.1989, std.dev.: 0.0009)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.95% (0.5698 => 0.5359, std.dev.: 0.0069)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.94% (2.0439 => 1.9224, std.dev.: 0.0060)
  MultiSource/Benchmarks/McCat/09-vor/vor: -5.91% (0.3723 => 0.3503, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/strcat: -5.80% (0.2309 => 0.2175, std.dev.: 0.0041)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2753 => 0.2613, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.75% (6.6236 => 6.3088, std.dev.: 0.0483)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.36% (0.2961 => 0.2832, std.dev.: 0.0048)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.59% (7.7211 => 7.4437, std.dev.: 0.0221)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.26% (0.8969 => 0.8677, std.dev.: 0.0109)
  MultiSource/Benchmarks/Olden/bh/bh: -3.24% (0.3429 => 0.3318, std.dev.: 0.0012)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.08% (10.7257 => 10.5024, std.dev.: 0.0284)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.78% (1.1782 => 1.1572, std.dev.: 0.0049)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.41% (1.2911 => 0.7306, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.55% (4.4050 => 3.2353, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc/salsa20: -22.34% (10.3398 => 8.0294, std.dev.: 0.4616)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.64% (0.8606 => 0.6744, std.dev.: 0.0521)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.38% (6.2328 => 5.0246, std.dev.: 0.0268)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.45% (25.3677 => 21.1944, std.dev.: 0.3011)
  MultiSource/Benchmarks/mafft/pairlocalalign: -16.42% (48.3307 => 40.3937, std.dev.: 1.5101)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.39% (0.0920 => 0.0806, std.dev.: 0.0033)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.47% (10.2418 => 9.1699, std.dev.: 0.1495)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.81% (0.3702 => 0.3339, std.dev.: 0.0114)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.10% (3.5327 => 3.2112, std.dev.: 0.0817)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.77% (0.2777 => 0.2589, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/flops: -6.64% (10.2170 => 9.5383, std.dev.: 0.1631)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.48% (0.1945 => 0.1819, std.dev.: 0.0026)
  MultiSource/Applications/sqlite3/sqlite3: -6.13% (4.6358 => 4.3515, std.dev.: 0.0596)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.60% (4.5717 => 4.3159, std.dev.: 0.0121)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.02% (0.2332 => 0.2215, std.dev.: 0.0043)
  MultiSource/Benchmarks/FreeBench/neural/neural: -4.84% (0.3513 => 0.3343, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -4.83% (3.2030 => 3.0484, std.dev.: 0.0523)
  MultiSource/Benchmarks/Bullet/bullet: -4.44% (7.1938 => 6.8743, std.dev.: 0.0456)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.91% (9.1099 => 8.7535, std.dev.: 0.0384)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -3.57% (4.1768 => 4.0277, std.dev.: 0.0308)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.51% (1.6613 => 1.6030, std.dev.: 0.0132)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.15% (0.9806 => 0.9497, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.10% (2.8537 => 2.7653, std.dev.: 0.0322)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.82% (5.7342 => 5.5725, std.dev.: 0.0268)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.79% (3.8665 => 3.7585, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.15% (4.2167 => 4.1262, std.dev.: 0.0074)
  MultiSource/Applications/obsequi/Obsequi: -2.06% (2.2398 => 2.1936, std.dev.: 0.0139)
  SingleSource/Benchmarks/Shootout/hash: -2.03% (5.3656 => 5.2566, std.dev.: 0.0126)
  SingleSource/Benchmarks/Shootout-C++/hash: -1.70% (0.7941 => 0.7806, std.dev.: 0.0006)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.36% (2.8573 => 2.8183, std.dev.: 0.0065)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.36% (12.1841 => 12.0181, std.dev.: 0.0568)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.87% (0.1441 => 0.1468, std.dev.: 0.0336)

Report Time: 1.86s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130601/2dd672d8/attachment.html>


More information about the llvm-testresults mailing list