[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jun 7 01:22:33 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12145?compare_to=12141&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12145, Order: 183488, Start Time: 2013-06-07 06:35:50, End Time: 2013-06-07 08:23:15
      To: 12141, Order: 183484, Start Time: 2013-06-07 04:25:48, End Time: 2013-06-07 06:11:56
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 18 (22 on baseline)
Performance Improvements: 6 (30 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1083 (1055 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/SciMark2-C/scimark2: 39.32% (0.3840 => 0.5350, std.dev.: 0.0035)
  MultiSource/Benchmarks/FreeBench/distray/distray: 34.94% (0.1059 => 0.1429, std.dev.: 0.0072)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.07% (1.1329 => 1.3943, std.dev.: 0.0604)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.92% (0.3871 => 0.4642, std.dev.: 0.0200)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.70% (7.5549 => 8.8165, std.dev.: 0.3280)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: 33.48% (0.6730 => 0.8983, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 13.85% (3.6316 => 4.1345, std.dev.: 0.0055)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.47% (2.6878 => 3.0229, std.dev.: 0.0550)
  SingleSource/Benchmarks/Misc/salsa20: 11.47% (8.0677 => 8.9927, std.dev.: 0.2335)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 10.46% (3.1543 => 3.4843, std.dev.: 0.1062)
  SingleSource/Benchmarks/Shootout-C++/fibo: 9.27% (4.3073 => 4.7064, std.dev.: 0.0620)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.44% (0.1546 => 0.1661, std.dev.: 0.0024)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.77% (15.7311 => 16.7960, std.dev.: 0.0960)
  MultiSource/Benchmarks/nbench/nbench: 4.39% (20.8270 => 21.7405, std.dev.: 0.1013)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.63% (4.5477 => 4.6671, std.dev.: 0.0394)
  MultiSource/Benchmarks/Olden/tsp/tsp: 2.25% (1.6295 => 1.6661, std.dev.: 0.0134)
  MultiSource/Applications/sqlite3/sqlite3: 1.22% (4.3776 => 4.4308, std.dev.: 0.0090)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.03% (12.0230 => 12.1469, std.dev.: 0.0158)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -9.83% (0.1099 => 0.0991, std.dev.: 0.0020)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.44% (0.2593 => 0.2452, std.dev.: 0.0049)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.02% (2.4975 => 2.3722, std.dev.: 0.0401)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.52% (2.9397 => 2.8950, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.10% (5.4712 => 5.4108, std.dev.: 0.0224)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.10% (2.7490 => 2.7187, std.dev.: 0.0062)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.84% (0.1437 => 0.1449, std.dev.: 0.0041)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/SciMark2-C/scimark2: 42.10% (0.3765 => 0.5350, std.dev.: 0.0035)
  MultiSource/Benchmarks/FreeBench/distray/distray: 37.80% (0.1037 => 0.1429, std.dev.: 0.0072)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 24.57% (1.1193 => 1.3943, std.dev.: 0.0604)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.19% (0.4030 => 0.4642, std.dev.: 0.0200)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.19% (7.7211 => 8.8165, std.dev.: 0.3280)
  SingleSource/Benchmarks/Shootout-C++/random: 4.77% (0.2116 => 0.2217, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.17% (2.5366 => 3.0229, std.dev.: 0.0550)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.73% (6.1372 => 7.2254, std.dev.: 0.2886)
  MultiSource/Applications/sgefa/sgefa: 17.60% (1.1695 => 1.3753, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.89% (5.2003 => 5.6105, std.dev.: 0.0075)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.72% (0.1542 => 0.1661, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.10% (3.1853 => 3.3795, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.93% (3.2201 => 3.3790, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.71% (4.6639 => 4.8835, std.dev.: 0.0507)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.44% (1.2224 => 1.2767, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.92% (5.9362 => 6.1690, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.54% (5.2788 => 5.4658, std.dev.: 0.0207)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.18% (3.9713 => 4.0976, std.dev.: 0.0438)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.03% (5.5010 => 5.6678, std.dev.: 0.0097)
  SingleSource/Benchmarks/Shootout/methcall: 2.21% (8.3425 => 8.5267, std.dev.: 0.0267)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (4.3727 => 4.4628, std.dev.: 0.0129)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.00% (16.4665 => 16.7960, std.dev.: 0.0960)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.94% (0.1113 => 0.0713, std.dev.: 0.0005)
  MultiSource/Applications/viterbi/viterbi: -24.35% (0.2431 => 0.1839, std.dev.: 0.0012)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.54% (1.6793 => 1.5863, std.dev.: 0.0007)
  MultiSource/Benchmarks/McCat/05-eks/eks: -4.25% (0.5698 => 0.5456, std.dev.: 0.0040)
  MultiSource/Benchmarks/McCat/09-vor/vor: -2.69% (0.3723 => 0.3623, std.dev.: 0.0012)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.67% (1.2911 => 0.7273, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.64% (4.4050 => 3.2317, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.13% (6.2328 => 5.0405, std.dev.: 0.0173)
  MultiSource/Benchmarks/mafft/pairlocalalign: -16.41% (48.3307 => 40.4001, std.dev.: 1.4235)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.13% (25.3677 => 21.2759, std.dev.: 0.1023)
  SingleSource/Benchmarks/Misc/salsa20: -13.03% (10.3398 => 8.9927, std.dev.: 0.2335)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.29% (1.6679 => 1.5130, std.dev.: 0.0373)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.48% (3.5327 => 3.2332, std.dev.: 0.0450)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.89% (9.8728 => 9.1925, std.dev.: 0.0515)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.78% (5.5889 => 5.2100, std.dev.: 0.0682)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (4.5717 => 4.3163, std.dev.: 0.0971)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.78% (5.3184 => 5.0642, std.dev.: 0.0029)
  MultiSource/Applications/sqlite3/sqlite3: -4.42% (4.6358 => 4.4308, std.dev.: 0.0090)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.38% (2.4808 => 2.3722, std.dev.: 0.0401)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.01% (9.1099 => 8.7450, std.dev.: 0.0920)
  SingleSource/Benchmarks/Misc/flops: -3.63% (10.2170 => 9.8464, std.dev.: 0.0345)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.41% (0.9806 => 0.9472, std.dev.: 0.0124)
  SingleSource/Benchmarks/Shootout/sieve: -2.96% (8.0178 => 7.7806, std.dev.: 0.0131)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.86% (3.8665 => 3.7558, std.dev.: 0.0301)
  MultiSource/Benchmarks/nbench/nbench: -2.51% (22.3004 => 21.7405, std.dev.: 0.1013)
  MultiSource/Applications/JM/lencod/lencod: -2.43% (7.0353 => 6.8641, std.dev.: 0.0388)
  SingleSource/Benchmarks/Shootout/hash: -2.26% (5.3656 => 5.2443, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.95% (4.2167 => 4.1345, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.52% (8.5243 => 8.3946, std.dev.: 0.0387)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.26% (5.4801 => 5.4108, std.dev.: 0.0224)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1441 => 0.1449, std.dev.: 0.0041)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130607/cb396728/attachment.html>


More information about the llvm-testresults mailing list