[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 30 21:17:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16855?compare_to=16852&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16855, Order: 193731, Start Time: 2013-10-31 02:31:33, End Time: 2013-10-31 04:20:39
      To: 16852, Order: 193722, Start Time: 2013-10-31 00:17:40, End Time: 2013-10-31 02:04:14
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 23 (41 on baseline)
Performance Improvements: 4 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1080 (1046 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.05% (1.3253 => 1.3392, std.dev.: 0.0004)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.86% (0.1635 => 0.1976, std.dev.: 0.0115)
  SingleSource/Benchmarks/Shootout/matrix: 20.16% (1.7577 => 2.1120, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/sieve: 17.36% (6.9310 => 8.1344, std.dev.: 0.0012)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.89% (0.3549 => 0.3829, std.dev.: 0.0094)
  MultiSource/Benchmarks/FreeBench/neural/neural: 6.15% (0.2308 => 0.2450, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.05% (2.2878 => 2.4261, std.dev.: 0.0282)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.64% (3.2845 => 3.4697, std.dev.: 0.0327)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.82% (1.8088 => 1.8960, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/salsa20: 4.51% (7.5800 => 7.9216, std.dev.: 0.0974)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.17% (5.1876 => 5.4040, std.dev.: 0.0016)
  MultiSource/Applications/spiff/spiff: 4.11% (2.8704 => 2.9885, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (5.0471 => 5.2489, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.61% (5.2458 => 5.4354, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (1.1045 => 1.1391, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.02% (4.0171 => 4.1384, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout/lists: 2.88% (7.3001 => 7.5106, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.58% (3.5790 => 3.6713, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.75% (3.9209 => 3.9895, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.50% (6.5641 => 6.6626, std.dev.: 0.0145)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.35% (23.5202 => 23.8380, std.dev.: 0.0165)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.21% (3.6229 => 3.6667, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.20% (5.9384 => 6.0097, std.dev.: 0.0011)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.71% (0.5911 => 0.5810, std.dev.: 0.0038)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: -8.13% (5.1007 => 4.6860, std.dev.: 0.0367)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.31% (4.2855 => 4.1007, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.34% (4.3363 => 4.2348, std.dev.: 0.0035)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.88% (0.1391 => 0.1431, std.dev.: 0.0343)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.01% (24.6139 => 25.3546, std.dev.: 0.0825)
  MultiSource/Applications/spiff/spiff: 2.86% (0.8911 => 0.9166, std.dev.: 0.0064)
  MultiSource/Benchmarks/Bullet/bullet: 2.75% (32.7552 => 33.6550, std.dev.: 0.1659)
  MultiSource/Applications/d/make_dparser: 1.96% (3.4962 => 3.5648, std.dev.: 0.0259)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.84% (0.5705 => 0.5810, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.79% (1.2086 => 1.2302, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.55% (1.4792 => 1.5022, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.28% (1.2152 => 1.2308, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.25% (1.2007 => 1.2157, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.20% (1.2201 => 1.2348, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.19% (1.3235 => 1.3392, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.19% (1.3499 => 1.3659, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.16% (1.2948 => 1.3098, std.dev.: 0.0021)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.89% (7.6426 => 12.2961, std.dev.: 0.0371)
  SingleSource/Benchmarks/Shootout-C++/matrix: 47.65% (2.8554 => 4.2159, std.dev.: 0.0371)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.24% (1.1431 => 1.3745, std.dev.: 0.0715)
  SingleSource/Benchmarks/Shootout/matrix: 18.59% (1.7809 => 2.1120, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/sieve: 12.58% (7.2254 => 8.1344, std.dev.: 0.0012)
  SingleSource/Benchmarks/McGill/misr: 10.18% (0.3771 => 0.4155, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/multiplies: 6.58% (0.5561 => 0.5927, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.57% (3.1730 => 3.3814, std.dev.: 0.0772)
  MultiSource/Applications/spiff/spiff: 6.00% (2.8194 => 2.9885, std.dev.: 0.0179)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.10% (2.3084 => 2.4261, std.dev.: 0.0282)
  MultiSource/Applications/hexxagon/hexxagon: 5.09% (14.7810 => 15.5340, std.dev.: 0.1411)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.00% (2.5368 => 2.6382, std.dev.: 0.0293)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.43% (1.1013 => 1.1391, std.dev.: 0.0123)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.16% (89.7126 => 92.5496, std.dev.: 0.2390)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.99% (4.0181 => 4.1384, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.89% (3.5683 => 3.6713, std.dev.: 0.0105)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.74% (0.3836 => 0.3941, std.dev.: 0.0030)
  MultiSource/Applications/sqlite3/sqlite3: 2.61% (4.2733 => 4.3849, std.dev.: 0.0412)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.52% (4.0596 => 4.1618, std.dev.: 0.0318)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.49% (3.5642 => 3.6530, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.41% (5.4925 => 5.6250, std.dev.: 0.0016)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.38% (1.8519 => 1.8960, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.00% (3.1569 => 3.2200, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.92% (5.3022 => 5.4040, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/lists: 1.90% (7.3703 => 7.5106, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/fib2: 1.68% (3.5966 => 3.6571, std.dev.: 0.0008)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.57% (23.4704 => 23.8380, std.dev.: 0.0165)
  SingleSource/Benchmarks/Shootout/methcall: 1.22% (8.5434 => 8.6475, std.dev.: 0.0138)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.23% (0.1483 => 0.1183, std.dev.: 0.0005)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.04% (0.1195 => 0.1087, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.12% (1.2622 => 1.2481, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.12% (0.5226 => 0.2450, std.dev.: 0.0021)
  MultiSource/Applications/sgefa/sgefa: -42.16% (1.5790 => 0.9133, std.dev.: 0.0063)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.70% (57.2347 => 43.6714, std.dev.: 3.0836)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.31% (15.9508 => 12.8706, std.dev.: 0.2062)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.50% (3.4956 => 3.1286, std.dev.: 0.0286)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.12% (20.8247 => 18.7176, std.dev.: 0.1517)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.81% (50.0284 => 45.6231, std.dev.: 0.3238)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.32% (3.7437 => 3.4697, std.dev.: 0.0327)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.17% (8.1346 => 7.6324, std.dev.: 0.0382)
  SingleSource/Benchmarks/Shootout-C++/ary3: -4.45% (5.0002 => 4.7778, std.dev.: 0.0787)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.12% (3.7874 => 3.6692, std.dev.: 0.0111)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.07% (2.4471 => 2.3719, std.dev.: 0.0246)
  SingleSource/Benchmarks/Misc/oourafft: -2.70% (3.7484 => 3.6472, std.dev.: 0.0338)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.63% (2.5938 => 2.5255, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.27% (17.1431 => 16.7539, std.dev.: 0.0166)
  SingleSource/Benchmarks/Misc/whetstone: -1.44% (3.6303 => 3.5782, std.dev.: 0.0106)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.24% (4.3592 => 4.3052, std.dev.: 0.0073)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 6.16% (0.1348 => 0.1431, std.dev.: 0.0343)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131030/1d5e66f9/attachment.html>


More information about the llvm-testresults mailing list