[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Sep 28 07:01:41 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15757?compare_to=15754&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15757, Order: 191610, Start Time: 2013-09-28 12:21:45, End Time: 2013-09-28 14:04:32
      To: 15754, Order: 191609, Start Time: 2013-09-28 06:18:48, End Time: 2013-09-28 08:00:06
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 27 (84 on baseline)
Performance Improvements: 1 (25 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1079 (998 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.12% (0.6772 => 0.6983, std.dev.: 0.0009)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.9216 => 0.9401, std.dev.: 0.0010)
  MultiSource/Applications/treecc/treecc: 1.72% (2.2769 => 2.3160, std.dev.: 0.0075)
  MultiSource/Applications/spiff/spiff: 1.69% (0.9063 => 0.9216, std.dev.: 0.0044)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.46% (1.5939 => 1.6172, std.dev.: 0.0029)
  MultiSource/Applications/sqlite3/sqlite3: 1.16% (16.7359 => 16.9306, std.dev.: 0.0336)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.15% (4.9545 => 5.0117, std.dev.: 0.0014)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (7.3726 => 7.4552, std.dev.: 0.0170)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 44.24% (1.8095 => 2.6100, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/matrix: 37.57% (2.8707 => 3.9491, std.dev.: 0.0068)
  SingleSource/Benchmarks/Shootout/matrix: 19.67% (1.7658 => 2.1131, std.dev.: 0.0011)
  MultiSource/Applications/JM/lencod/lencod: 12.01% (7.5338 => 8.4389, std.dev.: 0.0061)
  SingleSource/Benchmarks/Linpack/linpack-pc: 9.35% (43.1787 => 47.2156, std.dev.: 0.7551)
  SingleSource/Benchmarks/Misc/ReedSolomon: 9.08% (8.9712 => 9.7856, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.87% (0.1271 => 0.1371, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 7.24% (2.7943 => 2.9966, std.dev.: 0.0085)
  MultiSource/Benchmarks/PAQ8p/paq8p: 7.17% (94.3650 => 101.1336, std.dev.: 2.6090)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.65% (3.8881 => 3.9911, std.dev.: 0.0090)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.30% (21.0442 => 21.5284, std.dev.: 0.1539)
  SingleSource/Benchmarks/Shootout/methcall: 1.93% (8.5534 => 8.7189, std.dev.: 0.0046)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.75% (1.7817 => 1.8129, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.60% (15.9733 => 16.2295, std.dev.: 0.0065)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.51% (3.5852 => 3.6395, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.51% (1.5999 => 1.6240, std.dev.: 0.0068)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.26% (18.4454 => 18.6771, std.dev.: 0.0477)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (1.6745 => 1.6950, std.dev.: 0.0001)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.19% (3.7840 => 3.8292, std.dev.: 0.0002)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: -6.26% (3.8919 => 3.6482, std.dev.: 0.0543)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1352 => 0.1355, std.dev.: 0.0008)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/constpool: 6.30% (8.8921 => 9.4519, std.dev.: 0.0976)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.15% (0.4624 => 0.4816, std.dev.: 0.0010)
  MultiSource/Applications/siod/siod: 4.06% (2.4480 => 2.5475, std.dev.: 0.0077)
  MultiSource/Applications/sqlite3/sqlite3: 3.94% (16.2888 => 16.9306, std.dev.: 0.0336)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.51% (4.0397 => 4.1813, std.dev.: 0.0461)
  MultiSource/Applications/spiff/spiff: 3.42% (0.8911 => 0.9216, std.dev.: 0.0044)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.37% (0.8014 => 0.8284, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.29% (0.3096 => 0.3198, std.dev.: 0.0011)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.18% (1.1393 => 1.1755, std.dev.: 0.0031)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (2.6492 => 2.7323, std.dev.: 0.0027)
  MultiSource/Applications/SPASS/SPASS: 3.09% (16.1646 => 16.6644, std.dev.: 0.0310)
  MultiSource/Applications/lemon/lemon: 3.08% (1.1862 => 1.2227, std.dev.: 0.0004)
  MultiSource/Applications/sgefa/sgefa: 3.07% (0.3848 => 0.3966, std.dev.: 0.0027)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.07% (1.9476 => 2.0073, std.dev.: 0.0205)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.93% (0.5705 => 0.5872, std.dev.: 0.0016)
  MultiSource/Applications/treecc/treecc: 2.86% (2.2516 => 2.3160, std.dev.: 0.0075)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.84% (1.5333 => 1.5769, std.dev.: 0.0013)
  MultiSource/Applications/Burg/burg: 2.70% (1.3994 => 1.4372, std.dev.: 0.0040)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (0.6297 => 0.6467, std.dev.: 0.0006)
  MultiSource/Applications/JM/lencod/lencod: 2.63% (16.5902 => 17.0270, std.dev.: 0.0283)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.60% (7.2661 => 7.4552, std.dev.: 0.0170)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.9828 => 1.0069, std.dev.: 0.0029)
  MultiSource/Applications/d/make_dparser: 2.41% (3.4962 => 3.5804, std.dev.: 0.0153)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (14.4764 => 14.8233, std.dev.: 0.0643)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.39% (1.3365 => 1.3684, std.dev.: 0.0036)
  MultiSource/Applications/kimwitu++/kc: 2.31% (18.3608 => 18.7853, std.dev.: 0.0626)
  MultiSource/Applications/JM/ldecod/ldecod: 2.26% (7.4026 => 7.5699, std.dev.: 0.0164)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.26% (1.0756 => 1.0999, std.dev.: 0.0061)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (1.8775 => 1.9199, std.dev.: 0.0025)
  MultiSource/Applications/minisat/minisat: 2.22% (0.7439 => 0.7604, std.dev.: 0.0040)
  MultiSource/Benchmarks/nbench/nbench: 2.12% (1.2484 => 1.2749, std.dev.: 0.0100)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.9212 => 0.9401, std.dev.: 0.0010)
  MultiSource/Applications/oggenc/oggenc: 2.02% (5.3339 => 5.4417, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.6439 => 0.6568, std.dev.: 0.0013)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (4.5883 => 4.6775, std.dev.: 0.0122)
  MultiSource/Applications/ClamAV/clamscan: 1.88% (16.5398 => 16.8512, std.dev.: 0.0726)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.67% (4.9293 => 5.0117, std.dev.: 0.0014)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.63% (0.8233 => 0.8367, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.48% (1.4304 => 1.4516, std.dev.: 0.0013)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (5.5014 => 5.5704, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.16% (1.3036 => 1.3187, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.06% (1.3498 => 1.3641, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.02% (1.2981 => 1.3114, std.dev.: 0.0009)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 65.59% (7.6426 => 12.6553, std.dev.: 0.0224)
  SingleSource/Benchmarks/Misc/pi: 57.48% (1.6574 => 2.6100, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.30% (2.8554 => 3.9491, std.dev.: 0.0068)
  SingleSource/Benchmarks/Shootout/matrix: 18.65% (1.7809 => 2.1131, std.dev.: 0.0011)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.49% (0.1374 => 0.1628, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.89% (6.4425 => 7.4015, std.dev.: 0.3041)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.78% (8.5256 => 9.7856, std.dev.: 0.0020)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.51% (1.1013 => 1.2171, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.08% (1.2516 => 1.3527, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.54% (3.5550 => 3.8229, std.dev.: 0.0212)
  MultiSource/Applications/obsequi/Obsequi: 7.42% (2.1884 => 2.3508, std.dev.: 0.0094)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0002)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.23% (8.1346 => 8.6410, std.dev.: 0.0087)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.99% (0.1871 => 0.1983, std.dev.: 0.0009)
  MultiSource/Applications/aha/aha: 5.67% (3.5731 => 3.7758, std.dev.: 0.0025)
  MultiSource/Applications/spiff/spiff: 5.52% (2.8194 => 2.9749, std.dev.: 0.0040)
  SingleSource/Benchmarks/McGill/misr: 5.09% (0.3771 => 0.3963, std.dev.: 0.0002)
  MultiSource/Benchmarks/sim/sim: 4.52% (3.8312 => 4.0045, std.dev.: 0.0320)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.99% (0.3836 => 0.3989, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.82% (5.7757 => 5.9962, std.dev.: 0.0113)
  MultiSource/Applications/hexxagon/hexxagon: 3.76% (14.7810 => 15.3365, std.dev.: 0.2035)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.65% (5.3716 => 5.5678, std.dev.: 0.0509)
  MultiSource/Applications/JM/lencod/lencod: 3.18% (8.1785 => 8.4389, std.dev.: 0.0061)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (2.1472 => 2.2128, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.02% (4.4696 => 4.6048, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.81% (4.0181 => 4.1310, std.dev.: 0.0157)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.70% (1.7652 => 1.8129, std.dev.: 0.0009)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.56% (1.8519 => 1.8993, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/power/power: 2.41% (1.2170 => 1.2463, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/fp-convert: 2.25% (7.5877 => 7.7585, std.dev.: 0.0349)
  MultiSource/Applications/sqlite3/sqlite3: 2.08% (4.2733 => 4.3620, std.dev.: 0.0072)
  SingleSource/Regression/C/uint64_to_float: 2.06% (1.4528 => 1.4828, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout/methcall: 2.05% (8.5434 => 8.7189, std.dev.: 0.0046)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (2.4920 => 2.5428, std.dev.: 0.0046)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.88% (3.8582 => 3.9309, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.88% (1.5940 => 1.6240, std.dev.: 0.0068)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6950, std.dev.: 0.0001)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.37% (16.7972 => 17.0278, std.dev.: 0.0067)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.16% (6.7429 => 6.8212, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (3.7874 => 3.8292, std.dev.: 0.0002)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.65% (0.1483 => 0.1162, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/matrix: -6.73% (0.2571 => 0.2398, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.01% (0.2716 => 0.2607, std.dev.: 0.0037)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.71% (0.5226 => 0.2367, std.dev.: 0.0016)
  MultiSource/Applications/sgefa/sgefa: -47.38% (1.5790 => 0.8309, std.dev.: 0.0047)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.80% (15.9508 => 12.7933, std.dev.: 0.0972)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.51% (57.2347 => 47.2156, std.dev.: 0.7551)
  SingleSource/Benchmarks/Shootout/heapsort: -17.49% (3.5900 => 2.9620, std.dev.: 0.2261)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -15.55% (1.7197 => 1.4523, std.dev.: 0.0321)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.31% (20.8247 => 18.6771, std.dev.: 0.0477)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.96% (0.3304 => 0.2975, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -8.81% (4.0006 => 3.6482, std.dev.: 0.0543)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.99% (3.4956 => 3.2164, std.dev.: 0.0006)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.99% (3.7437 => 3.4821, std.dev.: 0.0643)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.50% (50.0284 => 46.7759, std.dev.: 0.0863)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.48% (0.3501 => 0.3309, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.88% (0.7474 => 0.7109, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/salsa20: -3.86% (7.7964 => 7.4956, std.dev.: 0.0512)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.07% (36.8417 => 35.7100, std.dev.: 0.1754)
  SingleSource/Benchmarks/Shootout/hash: -2.66% (5.2009 => 5.0626, std.dev.: 0.0394)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.52% (1.1075 => 1.0796, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.33% (17.1431 => 16.7437, std.dev.: 0.0542)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.05% (2.5938 => 2.5406, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.36% (4.5479 => 4.4859, std.dev.: 0.0206)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.29% (89.7126 => 88.5509, std.dev.: 0.1131)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.52% (0.1348 => 0.1355, std.dev.: 0.0008)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130928/d521eb13/attachment.html>


More information about the llvm-testresults mailing list