[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jun 10 22:19:07 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12263?compare_to=12259&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12263, Order: 183721, Start Time: 2013-06-11 03:36:22, End Time: 2013-06-11 05:19:55
      To: 12259, Order: 183717, Start Time: 2013-06-11 01:30:24, End Time: 2013-06-11 03:16:05
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 6 (20 on baseline)
Performance Improvements: 27 (55 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1074 (1032 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.04% (1.5848 => 1.6489, std.dev.: 0.0212)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 12.78% (2.1302 => 2.4024, std.dev.: 0.0712)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.79% (40.6672 => 43.4288, std.dev.: 0.0763)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.26% (1.2447 => 1.3102, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.54% (4.7484 => 4.9165, std.dev.: 0.0137)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.78% (3.9850 => 4.0559, std.dev.: 0.0176)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -15.75% (1.3838 => 1.1658, std.dev.: 0.0328)
  MultiSource/Applications/JM/ldecod/ldecod: -14.81% (8.7044 => 7.4157, std.dev.: 0.2296)
  MultiSource/Applications/hbd/hbd: -14.65% (1.9101 => 1.6303, std.dev.: 0.0084)
  MultiSource/Benchmarks/Olden/tsp/tsp: -14.10% (0.1589 => 0.1365, std.dev.: 0.0002)
  MultiSource/Applications/ClamAV/clamscan: -12.26% (19.1423 => 16.7962, std.dev.: 0.0945)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.81% (4.5291 => 4.1752, std.dev.: 0.0370)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.80% (0.8819 => 0.8219, std.dev.: 0.0059)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.74% (0.5076 => 0.4734, std.dev.: 0.0076)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.35% (2.7995 => 2.6217, std.dev.: 0.0303)
  MultiSource/Applications/minisat/minisat: -6.08% (0.8159 => 0.7663, std.dev.: 0.0061)
  MultiSource/Applications/lemon/lemon: -5.85% (1.2960 => 1.2202, std.dev.: 0.0291)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.81% (0.5556 => 0.5233, std.dev.: 0.0024)
  MultiSource/Applications/hexxagon/hexxagon: -4.86% (1.1607 => 1.1043, std.dev.: 0.0014)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.80% (0.7403 => 0.7196, std.dev.: 0.0010)
  MultiSource/Applications/JM/lencod/lencod: -2.77% (17.3209 => 16.8407, std.dev.: 0.1556)
  MultiSource/Applications/oggenc/oggenc: -2.59% (5.7358 => 5.5875, std.dev.: 0.0239)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.99% (1.3470 => 1.3202, std.dev.: 0.0026)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.80% (0.9906 => 0.9728, std.dev.: 0.0053)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -25.04% (1.1497 => 0.8618, std.dev.: 0.0793)
  MultiSource/Applications/minisat/minisat: -20.56% (7.8769 => 6.2571, std.dev.: 0.1409)
  MultiSource/Benchmarks/Olden/bisort/bisort: -10.78% (0.7771 => 0.6933, std.dev.: 0.0184)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -7.45% (0.8998 => 0.8328, std.dev.: 0.0176)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.41% (63.6303 => 60.8264, std.dev.: 0.8946)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.58% (1.6643 => 1.6048, std.dev.: 0.0070)
  MultiSource/Benchmarks/llubenchmark/llu: -2.93% (2.0453 => 1.9853, std.dev.: 0.0196)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -1.18% (2.5580 => 2.5279, std.dev.: 0.0062)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.11% (1.3083 => 1.2938, std.dev.: 0.0045)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -22.86% (0.1833 => 0.1414, std.dev.: 0.0043)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.84% (0.2721 => 0.2907, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.32% (1.5806 => 1.6489, std.dev.: 0.0212)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 2.63% (1.5862 => 1.6279, std.dev.: 0.0145)
  MultiSource/Applications/hexxagon/hexxagon: 2.31% (1.0794 => 1.1043, std.dev.: 0.0014)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 31.15% (1.8318 => 2.4024, std.dev.: 0.0712)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.42% (6.1372 => 7.2678, std.dev.: 0.1837)
  MultiSource/Applications/sgefa/sgefa: 17.82% (1.1695 => 1.3779, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout-C++/ary: 15.80% (0.0633 => 0.0733, std.dev.: 0.0021)
  SingleSource/Benchmarks/Stanford/Puzzle: 15.46% (0.1455 => 0.1680, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.25% (5.2003 => 5.6293, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.24% (3.2201 => 3.4211, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.23% (3.1853 => 3.3837, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.36% (4.6639 => 4.9141, std.dev.: 0.0202)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.16% (1.2579 => 1.3102, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.72% (5.9362 => 6.1568, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.55% (5.2788 => 5.4664, std.dev.: 0.0271)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.10% (5.5010 => 5.6713, std.dev.: 0.0402)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.13% (3.9713 => 4.0559, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.86% (5.6582 => 5.7634, std.dev.: 0.0308)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.79% (4.3727 => 4.4510, std.dev.: 0.0158)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.69% (0.0803 => 0.0669, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/whetstone: -14.77% (0.1097 => 0.0935, std.dev.: 0.0004)
  MultiSource/Applications/JM/lencod/lencod: -11.08% (18.9387 => 16.8407, std.dev.: 0.1556)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.86% (0.1151 => 0.1026, std.dev.: 0.0015)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -10.17% (0.1563 => 0.1404, std.dev.: 0.0011)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.86% (51.0211 => 45.9905, std.dev.: 1.4206)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.22% (0.2006 => 0.1821, std.dev.: 0.0036)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.07% (1.0314 => 0.9379, std.dev.: 0.0147)
  MultiSource/Applications/lemon/lemon: -7.24% (1.3155 => 1.2202, std.dev.: 0.0291)
  MultiSource/Applications/oggenc/oggenc: -6.70% (5.9886 => 5.5875, std.dev.: 0.0239)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.79% (0.7381 => 0.6954, std.dev.: 0.0104)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.97% (0.8649 => 0.8219, std.dev.: 0.0059)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.54% (1.3686 => 1.3202, std.dev.: 0.0026)
  MultiSource/Applications/ClamAV/clamscan: -3.04% (17.3229 => 16.7962, std.dev.: 0.0945)
  MultiSource/Applications/minisat/minisat: -2.31% (0.7844 => 0.7663, std.dev.: 0.0061)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.30% (0.9957 => 0.9728, std.dev.: 0.0053)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.88% (0.7334 => 0.7196, std.dev.: 0.0010)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.55% (1.2911 => 0.7288, std.dev.: 0.0071)
  MultiSource/Benchmarks/Olden/mst/mst: -38.45% (0.2099 => 0.1292, std.dev.: 0.0054)
  MultiSource/Applications/lemon/lemon: -36.16% (1.3499 => 0.8618, std.dev.: 0.0793)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.57% (4.4050 => 3.2346, std.dev.: 0.1355)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -25.38% (1.0251 => 0.7649, std.dev.: 0.0774)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -24.63% (6.2328 => 4.6976, std.dev.: 0.1735)
  SingleSource/Benchmarks/Misc/salsa20: -20.60% (10.3398 => 8.2093, std.dev.: 0.3680)
  MultiSource/Benchmarks/Olden/bisort/bisort: -19.44% (0.8606 => 0.6933, std.dev.: 0.0184)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.24% (25.3677 => 21.2483, std.dev.: 0.2784)
  MultiSource/Applications/minisat/minisat: -15.10% (7.3703 => 6.2571, std.dev.: 0.1409)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.14% (48.3307 => 43.4288, std.dev.: 0.0763)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.33% (0.7941 => 0.7200, std.dev.: 0.0274)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.31% (1.6679 => 1.5126, std.dev.: 0.0207)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.22% (3.5327 => 3.2071, std.dev.: 0.0656)
  MultiSource/Applications/SPASS/SPASS: -8.39% (8.8720 => 8.1277, std.dev.: 0.1097)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.03% (9.8728 => 9.0799, std.dev.: 0.1517)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.97% (5.5889 => 5.1996, std.dev.: 0.0309)
  SingleSource/Benchmarks/Misc/flops: -6.64% (10.2170 => 9.5384, std.dev.: 0.1540)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.43% (0.1945 => 0.1820, std.dev.: 0.0014)
  MultiSource/Applications/sqlite3/sqlite3: -6.15% (4.6358 => 4.3505, std.dev.: 0.0422)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -6.11% (3.5120 => 3.2973, std.dev.: 0.0583)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.91% (4.5717 => 4.3016, std.dev.: 0.0145)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -5.29% (3.2030 => 3.0336, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.83% (5.3184 => 5.0617, std.dev.: 0.0254)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.04% (9.1099 => 8.7420, std.dev.: 0.0531)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.67% (0.2777 => 0.2675, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.40% (1.6613 => 1.6048, std.dev.: 0.0070)
  MultiSource/Benchmarks/Bullet/bullet: -3.03% (7.1938 => 6.9760, std.dev.: 0.0442)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.99% (3.8665 => 3.7510, std.dev.: 0.0055)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.82% (5.7342 => 5.5727, std.dev.: 0.0300)
  MultiSource/Benchmarks/llubenchmark/llu: -2.80% (2.0425 => 1.9853, std.dev.: 0.0196)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.51% (4.2334 => 4.1271, std.dev.: 0.0343)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.46% (2.8537 => 2.7836, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.24% (4.5094 => 4.4083, std.dev.: 0.0227)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.92% (8.5243 => 8.3608, std.dev.: 0.0040)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.41% (2.8573 => 2.8171, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.22% (9.6556 => 9.5374, std.dev.: 0.0321)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.09% (1.6105 => 1.5930, std.dev.: 0.0050)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.87% (0.1441 => 0.1414, std.dev.: 0.0043)

Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130611/88d63c3b/attachment.html>


More information about the llvm-testresults mailing list