[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Oct 6 07:49:46 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16037?compare_to=16033&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16037, Order: 192062, Start Time: 2013-10-06 13:02:27, End Time: 2013-10-06 14:52:45
      To: 16033, Order: 192061, Start Time: 2013-10-06 10:57:59, End Time: 2013-10-06 12:41:27
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 22 (35 on baseline)
Performance Improvements: 4 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1081 (1052 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 70.05% (0.2671 => 0.4542, std.dev.: 0.0104)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 48.62% (0.9570 => 1.4223, std.dev.: 0.1170)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 38.22% (0.2224 => 0.3074, std.dev.: 0.0120)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 25.93% (4.6658 => 5.8758, std.dev.: 0.2570)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 14.88% (1.2328 => 1.4163, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.44% (1.2695 => 1.4274, std.dev.: 0.0227)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.04% (25.2428 => 28.2825, std.dev.: 0.1993)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.20% (1.3595 => 1.5117, std.dev.: 0.0335)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.95% (1.3395 => 1.4728, std.dev.: 0.0293)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 9.58% (0.1065 => 0.1167, std.dev.: 0.0002)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 58.98% (0.1024 => 0.1628, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout/heapsort: 47.03% (2.8842 => 4.2406, std.dev.: 0.3306)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 35.44% (2.4063 => 3.2590, std.dev.: 0.0589)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 22.82% (1.4824 => 1.8207, std.dev.: 0.0397)
  SingleSource/Benchmarks/Shootout/matrix: 10.37% (1.8354 => 2.0257, std.dev.: 0.0355)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (12.9319 => 13.7057, std.dev.: 0.0954)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.51% (1.0136 => 1.0694, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.73% (4.5756 => 4.7920, std.dev.: 0.0688)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.68% (4.1020 => 4.2938, std.dev.: 0.0235)
  SingleSource/Benchmarks/Misc/ffbench: 3.45% (1.3666 => 1.4138, std.dev.: 0.0093)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.58% (97.0022 => 99.5012, std.dev.: 0.4544)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.71% (5.7884 => 5.8876, std.dev.: 0.0095)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -5.17% (21.5145 => 20.4020, std.dev.: 0.3127)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.80% (4.6228 => 4.4933, std.dev.: 0.0124)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.02% (1.0965 => 1.0744, std.dev.: 0.0057)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.50% (1.6895 => 1.6641, std.dev.: 0.0033)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: - (0.1352 => 0.1352, std.dev.: 0.0017)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 74.63% (0.2601 => 0.4542, std.dev.: 0.0104)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 49.81% (0.9494 => 1.4223, std.dev.: 0.1170)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 37.91% (0.2229 => 0.3074, std.dev.: 0.0120)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 26.57% (4.6423 => 5.8758, std.dev.: 0.2570)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 15.76% (1.2235 => 1.4163, std.dev.: 0.0190)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.32% (0.1012 => 0.1167, std.dev.: 0.0002)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.90% (24.6139 => 28.2825, std.dev.: 0.1993)
  SingleSource/Benchmarks/Linpack/linpack-pc: 14.68% (0.2949 => 0.3382, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.74% (1.2550 => 1.4274, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.99% (1.3498 => 1.5117, std.dev.: 0.0335)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.92% (1.3278 => 1.4728, std.dev.: 0.0293)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.10% (0.6297 => 0.6429, std.dev.: 0.0039)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.30% (7.6426 => 12.5566, std.dev.: 0.0413)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 58.52% (0.1027 => 0.1628, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/pi: 57.54% (1.6574 => 2.6110, std.dev.: 0.0002)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 35.74% (2.4010 => 3.2590, std.dev.: 0.0589)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 22.77% (1.4830 => 1.8207, std.dev.: 0.0397)
  SingleSource/Benchmarks/Shootout/matrix: 13.75% (1.7809 => 2.0257, std.dev.: 0.0355)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0049)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (8.1346 => 8.6457, std.dev.: 0.1476)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.45% (0.1871 => 0.1973, std.dev.: 0.0012)
  MultiSource/Applications/spiff/spiff: 4.85% (2.8194 => 2.9562, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.76% (4.5744 => 4.7920, std.dev.: 0.0688)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.70% (4.1011 => 4.2938, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.05% (6.5990 => 6.8665, std.dev.: 0.0815)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.3836 => 0.3963, std.dev.: 0.0015)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.81% (96.7834 => 99.5012, std.dev.: 0.4544)
  MultiSource/Applications/siod/siod: 2.78% (3.5310 => 3.6292, std.dev.: 0.0348)
  MultiSource/Benchmarks/Olden/power/power: 2.37% (1.2170 => 1.2459, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.96% (3.5683 => 3.6381, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.71% (5.7884 => 5.8876, std.dev.: 0.0095)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0001)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.34% (16.7972 => 17.0215, std.dev.: 0.0430)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.14% (3.8582 => 3.9023, std.dev.: 0.0136)
  SingleSource/Benchmarks/Shootout/fib2: 1.01% (3.5966 => 3.6328, std.dev.: 0.0138)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.98% (0.5226 => 0.2405, std.dev.: 0.0861)
  MultiSource/Applications/sgefa/sgefa: -47.10% (1.5790 => 0.8353, std.dev.: 0.0384)
  SingleSource/Benchmarks/Linpack/linpack-pc: -15.07% (57.2347 => 48.6095, std.dev.: 1.8070)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.08% (15.9508 => 13.7057, std.dev.: 0.0954)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.27% (20.8247 => 18.4775, std.dev.: 0.1783)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.03% (50.0284 => 46.0129, std.dev.: 0.2852)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.97% (3.4956 => 3.2171, std.dev.: 0.0392)
  MultiSource/Benchmarks/nbench/nbench: -7.79% (22.1263 => 20.4020, std.dev.: 0.3127)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.07% (3.7437 => 3.4792, std.dev.: 0.0869)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.70% (3.0561 => 2.8820, std.dev.: 0.0230)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.11% (0.7474 => 0.7167, std.dev.: 0.0075)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.99% (1.1075 => 1.0744, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.80% (17.1431 => 16.6630, std.dev.: 0.1527)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.44% (2.3365 => 2.2794, std.dev.: 0.0218)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.27% (2.5938 => 2.5350, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.26% (4.9022 => 4.7912, std.dev.: 0.0417)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.15% (5.2422 => 5.1297, std.dev.: 0.0176)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.54% (4.3592 => 4.2920, std.dev.: 0.0165)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.30% (2.1472 => 2.1193, std.dev.: 0.0088)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.17% (89.7126 => 88.6645, std.dev.: 0.2421)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.30% (0.1348 => 0.1352, std.dev.: 0.0017)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131006/7bf6f310/attachment.html>


More information about the llvm-testresults mailing list