[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jun 20 20:41:22 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12593?compare_to=12590&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12593, Order: 184514, Start Time: 2013-06-21 01:53:58, End Time: 2013-06-21 03:42:20
      To: 12590, Order: 184495, Start Time: 2013-06-20 23:41:39, End Time: 2013-06-21 01:31:21
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 18 (31 on baseline)
Performance Improvements: 13 (35 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1076 (1041 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 36.47% (0.2767 => 0.3776, std.dev.: 0.0096)
  MultiSource/Applications/treecc/treecc: 15.83% (2.3608 => 2.7346, std.dev.: 0.1302)
  MultiSource/Applications/ClamAV/clamscan: 6.99% (17.4643 => 18.6856, std.dev.: 0.4198)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.06% (1.7234 => 1.8106, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.70% (1.6291 => 1.6893, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.65% (1.5077 => 1.5627, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.29% (1.6184 => 1.6716, std.dev.: 0.0187)
  MultiSource/Applications/oggenc/oggenc: 3.22% (5.8413 => 6.0292, std.dev.: 0.0696)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.30% (1.1853 => 1.2126, std.dev.: 0.0012)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/salsa20: 11.71% (8.0408 => 8.9822, std.dev.: 0.0075)
  SingleSource/Benchmarks/Linpack/linpack-pc: 10.89% (46.5510 => 51.6181, std.dev.: 0.0643)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.14% (2.5939 => 2.8309, std.dev.: 0.0553)
  MultiSource/Benchmarks/Olden/em3d/em3d: 8.04% (4.7992 => 5.1849, std.dev.: 0.0413)
  SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.7315 => 0.7630, std.dev.: 0.0098)
  MultiSource/Applications/sgefa/sgefa: 4.10% (1.5492 => 1.6127, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.90% (3.3196 => 3.3828, std.dev.: 0.0232)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.49% (2.5636 => 2.6018, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.01% (4.7413 => 4.7890, std.dev.: 0.0167)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -9.76% (1.5988 => 1.4427, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -9.54% (1.7797 => 1.6099, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -8.55% (1.5317 => 1.4008, std.dev.: 0.0331)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -7.17% (1.5950 => 1.4807, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.39% (1.7874 => 1.6731, std.dev.: 0.0282)
  SingleSource/Benchmarks/Shootout-C++/moments: -3.57% (0.4281 => 0.4128, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.92% (1.6066 => 1.5757, std.dev.: 0.0082)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/minisat/minisat: -21.89% (8.1278 => 6.3485, std.dev.: 0.3840)
  SingleSource/Benchmarks/Shootout-C++/moments: -17.43% (0.1239 => 0.1023, std.dev.: 0.0063)
  MultiSource/Benchmarks/Bullet/bullet: -3.85% (7.2466 => 6.9677, std.dev.: 0.0842)
  MultiSource/Applications/JM/lencod/lencod: -2.89% (7.2575 => 7.0477, std.dev.: 0.0510)
  MultiSource/Applications/sqlite3/sqlite3: -2.79% (4.5456 => 4.4188, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.02% (3.2516 => 3.2185, std.dev.: 0.0003)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.19% (0.1430 => 0.1413, std.dev.: 0.0059)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 38.11% (0.2734 => 0.3776, std.dev.: 0.0096)
  MultiSource/Applications/treecc/treecc: 17.68% (2.3237 => 2.7346, std.dev.: 0.1302)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.21% (1.5612 => 1.6893, std.dev.: 0.0138)
  MultiSource/Applications/ClamAV/clamscan: 7.87% (17.3229 => 18.6856, std.dev.: 0.4198)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.29% (1.5727 => 1.6716, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.87% (1.7102 => 1.8106, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.80% (1.4771 => 1.5627, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.05% (1.4999 => 1.5757, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.75% (1.7006 => 1.7814, std.dev.: 0.0164)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.92% (1.1782 => 1.2126, std.dev.: 0.0012)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 37.90% (1.1695 => 1.6127, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.48% (6.1372 => 7.1486, std.dev.: 0.3090)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.84% (2.5800 => 2.9112, std.dev.: 0.0362)
  SingleSource/Benchmarks/Misc/pi: 12.20% (1.8318 => 2.0552, std.dev.: 0.0836)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.60% (2.5366 => 2.8309, std.dev.: 0.0553)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.43% (5.2003 => 5.6388, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.20% (3.1853 => 3.3828, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.58% (4.6639 => 4.9241, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.90% (3.2201 => 3.3778, std.dev.: 0.0400)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.70% (1.0571 => 1.1068, std.dev.: 0.0160)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.33% (1.2224 => 1.2753, std.dev.: 0.0192)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.10% (40.6198 => 42.2852, std.dev.: 0.4706)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.78% (2.9004 => 3.0101, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.75% (5.9362 => 6.1590, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.44% (4.8986 => 5.0669, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.07% (4.8966 => 5.0468, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.00% (5.5010 => 5.6663, std.dev.: 0.0434)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.47% (3.9713 => 4.0695, std.dev.: 0.0352)
  MultiSource/Applications/lua/lua: 2.09% (28.2496 => 28.8399, std.dev.: 0.1845)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (4.3727 => 4.4553, std.dev.: 0.0143)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.66% (2.5593 => 2.6018, std.dev.: 0.0071)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.49% (0.1113 => 0.0718, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -10.75% (0.7918 => 0.7067, std.dev.: 0.0321)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.67% (0.2006 => 0.1792, std.dev.: 0.0057)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.59% (51.0211 => 46.1283, std.dev.: 1.3058)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -8.00% (0.1563 => 0.1438, std.dev.: 0.0047)
  MultiSource/Applications/lemon/lemon: -5.26% (1.3155 => 1.2463, std.dev.: 0.0236)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.38% (1.2911 => 0.7310, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.94% (4.4050 => 3.2185, std.dev.: 0.0003)
  MultiSource/Benchmarks/FreeBench/neural/neural: -24.17% (0.3513 => 0.2664, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -23.16% (6.2328 => 4.7890, std.dev.: 0.0167)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.10% (25.3677 => 21.2824, std.dev.: 0.3849)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.09% (11.6227 => 9.9852, std.dev.: 0.0130)
  MultiSource/Applications/minisat/minisat: -13.86% (7.3703 => 6.3485, std.dev.: 0.3840)
  SingleSource/Benchmarks/Misc/salsa20: -13.13% (10.3398 => 8.9822, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.29% (7.0179 => 6.2955, std.dev.: 0.0050)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.75% (32.4581 => 29.2945, std.dev.: 1.1948)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.29% (1.6679 => 1.5130, std.dev.: 0.0265)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.71% (9.1099 => 8.3160, std.dev.: 0.0222)
  MultiSource/Applications/siod/siod: -7.64% (3.7240 => 3.4396, std.dev.: 0.0164)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -6.76% (0.3267 => 0.3046, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.63% (5.5889 => 5.2184, std.dev.: 0.0297)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.95% (48.3307 => 45.4529, std.dev.: 0.3994)
  SingleSource/Benchmarks/Misc/flops: -5.71% (10.2170 => 9.6335, std.dev.: 0.0935)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.60% (3.5327 => 3.3348, std.dev.: 0.0551)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (4.5717 => 4.3162, std.dev.: 0.0064)
  MultiSource/Applications/sqlite3/sqlite3: -4.68% (4.6358 => 4.4188, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.40% (4.2167 => 4.0310, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.13% (5.3184 => 5.0985, std.dev.: 0.0700)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.04% (5.3276 => 5.1126, std.dev.: 0.0439)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.92% (0.7941 => 0.7630, std.dev.: 0.0098)
  MultiSource/Benchmarks/Bullet/bullet: -3.14% (7.1938 => 6.9677, std.dev.: 0.0842)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.85% (3.8665 => 3.7564, std.dev.: 0.0147)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.16% (5.7342 => 5.6102, std.dev.: 0.0237)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.25% (12.1841 => 12.0314, std.dev.: 0.0503)
  MultiSource/Applications/hexxagon/hexxagon: -1.14% (15.4979 => 15.3216, std.dev.: 0.0180)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.94% (0.1441 => 0.1413, std.dev.: 0.0059)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130620/26a9af23/attachment.html>


More information about the llvm-testresults mailing list