[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Sep 29 12:24:49 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15790?compare_to=15787&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15790, Order: 191641, Start Time: 2013-09-29 17:43:50, End Time: 2013-09-29 19:27:41
      To: 15787, Order: 191640, Start Time: 2013-09-29 14:10:36, End Time: 2013-09-29 15:51:11
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 20 (53 on baseline)
Performance Improvements: 1 (25 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1086 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.71% (1.4108 => 1.4349, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.54% (1.8998 => 1.9291, std.dev.: 0.0023)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 63.80% (1.5941 => 2.6111, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/matrix: 18.27% (3.2701 => 3.8675, std.dev.: 0.0385)
  SingleSource/Benchmarks/Shootout/sieve: 14.35% (7.4271 => 8.4931, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/ReedSolomon: 11.52% (8.7724 => 9.7832, std.dev.: 0.0015)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.29% (94.8128 => 104.5682, std.dev.: 1.4132)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 9.04% (3.3595 => 3.6631, std.dev.: 0.1032)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.72% (2.8128 => 3.0581, std.dev.: 0.0291)
  MultiSource/Applications/JM/lencod/lencod: 7.03% (7.8853 => 8.4396, std.dev.: 0.1462)
  MultiSource/Benchmarks/sim/sim: 6.23% (3.8285 => 4.0670, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.55% (4.8003 => 5.0666, std.dev.: 0.0458)
  MultiSource/Applications/hexxagon/hexxagon: 4.05% (15.1492 => 15.7630, std.dev.: 0.0213)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.86% (1.0446 => 1.0849, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.69% (20.3622 => 21.1145, std.dev.: 0.1933)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.92% (15.7753 => 16.2364, std.dev.: 0.0175)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.57% (5.5137 => 5.6554, std.dev.: 0.0121)
  SingleSource/Benchmarks/Misc/ffbench: 1.98% (1.3899 => 1.4174, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.27% (5.3368 => 5.4045, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.14% (3.5992 => 3.6402, std.dev.: 0.0148)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.78% (47.2199 => 46.3801, std.dev.: 0.2697)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.55% (0.1351 => 0.1330, std.dev.: 0.0011)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.50% (4.0397 => 4.1812, std.dev.: 0.0424)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.36% (2.6492 => 2.7383, std.dev.: 0.0027)
  MultiSource/Applications/siod/siod: 3.36% (2.4480 => 2.5302, std.dev.: 0.0136)
  MultiSource/Applications/d/make_dparser: 2.96% (3.4962 => 3.5996, std.dev.: 0.0096)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.92% (0.6297 => 0.6481, std.dev.: 0.0001)
  MultiSource/Applications/hexxagon/hexxagon: 2.88% (1.0276 => 1.0572, std.dev.: 0.0090)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (1.8775 => 1.9291, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.65% (6.0284 => 6.1882, std.dev.: 0.0005)
  MultiSource/Applications/sgefa/sgefa: 2.65% (0.3848 => 0.3950, std.dev.: 0.0019)
  MultiSource/Applications/spiff/spiff: 2.50% (0.8911 => 0.9134, std.dev.: 0.0083)
  MultiSource/Applications/treecc/treecc: 2.34% (2.2516 => 2.3044, std.dev.: 0.0078)
  MultiSource/Applications/Burg/burg: 2.25% (1.3994 => 1.4309, std.dev.: 0.0074)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.19% (1.4041 => 1.4349, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (14.4764 => 14.7578, std.dev.: 0.0705)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.91% (0.8233 => 0.8390, std.dev.: 0.0008)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.88% (1.4033 => 1.4297, std.dev.: 0.0082)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.13% (2.5666 => 2.5955, std.dev.: 0.0095)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.86% (7.6426 => 12.5994, std.dev.: 0.0619)
  SingleSource/Benchmarks/Misc/pi: 57.54% (1.6574 => 2.6111, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/matrix: 35.45% (2.8554 => 3.8675, std.dev.: 0.0385)
  SingleSource/Benchmarks/Shootout/matrix: 18.59% (1.7809 => 2.1119, std.dev.: 0.0005)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.41% (0.1374 => 0.1627, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout/sieve: 17.55% (7.2254 => 8.4931, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.75% (8.5256 => 9.7832, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.57% (3.5550 => 3.8598, std.dev.: 0.0087)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.04% (96.7834 => 104.5682, std.dev.: 1.4132)
  MultiSource/Applications/hexxagon/hexxagon: 6.64% (14.7810 => 15.7630, std.dev.: 0.0213)
  SingleSource/UnitTests/Vector/multiplies: 6.47% (0.5561 => 0.5921, std.dev.: 0.0005)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.43% (8.1346 => 8.6574, std.dev.: 0.0044)
  MultiSource/Benchmarks/sim/sim: 6.15% (3.8312 => 4.0670, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 6.09% (0.1871 => 0.1985, std.dev.: 0.0006)
  MultiSource/Applications/aha/aha: 5.90% (3.5731 => 3.7840, std.dev.: 0.0025)
  MultiSource/Applications/spiff/spiff: 5.72% (2.8194 => 2.9807, std.dev.: 0.0130)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.28% (5.3716 => 5.6554, std.dev.: 0.0121)
  SingleSource/Benchmarks/McGill/misr: 4.59% (0.3771 => 0.3944, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.33% (0.3836 => 0.4002, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/fp-convert: 3.11% (7.5877 => 7.8233, std.dev.: 0.0331)
  MultiSource/Applications/siod/siod: 2.77% (3.5310 => 3.6287, std.dev.: 0.0079)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.70% (1.5940 => 1.6371, std.dev.: 0.0073)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.69% (1.7652 => 1.8127, std.dev.: 0.0014)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.60% (1.8519 => 1.9001, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/power/power: 2.42% (1.2170 => 1.2464, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.15% (5.7757 => 5.9001, std.dev.: 0.0459)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.01% (3.5683 => 3.6402, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (5.3022 => 5.4045, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout/lists: 1.88% (7.3703 => 7.5090, std.dev.: 0.0027)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.88% (3.8582 => 3.9306, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout/fib2: 1.63% (3.5966 => 3.6553, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.48% (1.0477 => 1.0632, std.dev.: 0.0010)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.46% (23.4704 => 23.8124, std.dev.: 0.0114)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6950, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.16% (6.7429 => 6.8213, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (3.7874 => 3.8287, std.dev.: 0.0003)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.89% (0.1483 => 0.1188, std.dev.: 0.0075)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -8.62% (0.1195 => 0.1092, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.31% (0.2571 => 0.2383, std.dev.: 0.0022)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.82% (0.5226 => 0.2361, std.dev.: 0.0087)
  MultiSource/Applications/sgefa/sgefa: -46.76% (1.5790 => 0.8406, std.dev.: 0.0005)
  SingleSource/Benchmarks/Linpack/linpack-pc: -24.24% (57.2347 => 43.3597, std.dev.: 2.3164)
  SingleSource/Benchmarks/Shootout/heapsort: -19.79% (3.5900 => 2.8795, std.dev.: 0.0346)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.51% (15.9508 => 12.8395, std.dev.: 0.2668)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.43% (20.8247 => 18.6525, std.dev.: 0.0364)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.3304 => 0.2977)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -8.44% (4.0006 => 3.6631, std.dev.: 0.1032)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.99% (3.4956 => 3.2164, std.dev.: 0.0002)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.29% (50.0284 => 46.3801, std.dev.: 0.2697)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.97% (3.7437 => 3.5201, std.dev.: 0.0522)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.37% (0.3501 => 0.3313, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/salsa20: -3.82% (7.7964 => 7.4986, std.dev.: 0.0545)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.63% (17.1431 => 16.5204, std.dev.: 0.1047)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.58% (36.8417 => 35.5243, std.dev.: 0.2203)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.51% (0.7474 => 0.7212, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/hash: -2.36% (5.2009 => 5.0780, std.dev.: 0.0329)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.32% (6.1088 => 5.9669, std.dev.: 0.0056)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.04% (1.1075 => 1.0849, std.dev.: 0.0082)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.04% (2.5938 => 2.5409, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.37% (4.9022 => 4.8352, std.dev.: 0.0117)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -1.02% (4.1004 => 4.0587, std.dev.: 0.0125)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.34% (0.1348 => 0.1330, std.dev.: 0.0011)

Report Time: 0.82s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130929/de8bb791/attachment.html>


More information about the llvm-testresults mailing list