[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 15 22:45:09 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16357?compare_to=16353&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16357, Order: 192767, Start Time: 2013-10-16 04:03:31, End Time: 2013-10-16 05:48:21
      To: 16353, Order: 192757, Start Time: 2013-10-16 01:45:12, End Time: 2013-10-16 03:36:19
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 25 (47 on baseline)
Performance Improvements: 25 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1057 (1036 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.55% (1.9740 => 2.0046, std.dev.: 0.0027)
  MultiSource/Applications/d/make_dparser: 1.41% (3.5858 => 3.6365, std.dev.: 0.0136)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 58.67% (1.6453 => 2.6106, std.dev.: 0.0004)
  SingleSource/Benchmarks/Stanford/Puzzle: 8.41% (0.1725 => 0.1870, std.dev.: 0.0001)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2495 => 1.3378, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.32% (3.4986 => 3.7196, std.dev.: 0.0018)
  MultiSource/Benchmarks/BitBench/five11/five11: 6.17% (5.3077 => 5.6350, std.dev.: 0.0132)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.12% (2.9062 => 3.0551, std.dev.: 0.0283)
  SingleSource/Benchmarks/Linpack/linpack-pc: 4.55% (45.1458 => 47.1996, std.dev.: 0.1496)
  SingleSource/Benchmarks/McGill/misr: 4.33% (0.3974 => 0.4146, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/ReedSolomon: 4.26% (9.1439 => 9.5338, std.dev.: 0.1335)
  MultiSource/Applications/aha/aha: 4.12% (3.6258 => 3.7751, std.dev.: 0.0064)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 4.11% (0.4597 => 0.4786, std.dev.: 0.0049)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.98% (2.1280 => 2.2128, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/fp-convert: 3.93% (7.5421 => 7.8385, std.dev.: 0.0048)
  MultiSource/Applications/siod/siod: 3.69% (3.4696 => 3.5976, std.dev.: 0.0061)
  MultiSource/Applications/hexxagon/hexxagon: 3.46% (15.2488 => 15.7762, std.dev.: 0.0067)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.70% (0.7100 => 0.7292, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.46% (3.1437 => 3.2209, std.dev.: 0.0131)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.34% (3.5350 => 3.6178, std.dev.: 0.0311)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.93% (6.7161 => 6.8456, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.93% (3.1264 => 3.1866, std.dev.: 0.0004)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 1.63% (2.2513 => 2.2879, std.dev.: 0.0078)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.52% (1.0492 => 1.0652, std.dev.: 0.0001)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.29% (23.3444 => 23.6448, std.dev.: 0.0874)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/SignlessTypes/div: -48.22% (0.0647 => 0.0335, std.dev.: 0.0007)
  SingleSource/UnitTests/Threads/tls: -45.68% (0.0405 => 0.0220, std.dev.: 0.0006)
  SingleSource/UnitTests/SignlessTypes/cast2: -45.02% (0.0311 => 0.0171, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/flops-5: -30.58% (0.0448 => 0.0311, std.dev.: 0.0000)
  SingleSource/UnitTests/initp1: -29.03% (0.0720 => 0.0511, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/ary2: -17.54% (0.3084 => 0.2543, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/rem: -17.52% (0.1461 => 0.1205, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/flops: -8.85% (0.1209 => 0.1102, std.dev.: 0.0015)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -8.54% (0.2879 => 0.2633, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -5.09% (0.2140 => 0.2031, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.26% (0.4963 => 0.4851, std.dev.: 0.0025)
  MultiSource/Applications/Burg/burg: -1.35% (1.4521 => 1.4325, std.dev.: 0.0071)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -17.67% (0.1664 => 0.1370, std.dev.: 0.0004)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.32% (45.6091 => 40.9045, std.dev.: 1.2790)
  SingleSource/Benchmarks/Misc/salsa20: -8.02% (8.1541 => 7.4998, std.dev.: 0.0307)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.76% (0.2939 => 0.2799, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -4.15% (4.2376 => 4.0619, std.dev.: 0.0117)
  SingleSource/Benchmarks/Misc/flops: -3.74% (9.6309 => 9.2703, std.dev.: 0.0485)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.65% (6.3152 => 6.0849, std.dev.: 0.0025)
  SingleSource/Benchmarks/McGill/chomp: -2.64% (1.0330 => 1.0057, std.dev.: 0.0104)
  SingleSource/Benchmarks/Misc/ffbench: -2.49% (1.4018 => 1.3669, std.dev.: 0.0105)
  SingleSource/Benchmarks/Shootout-C++/hash: -1.76% (0.7565 => 0.7432, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.62% (2.6883 => 2.6447, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc/flops-7: -1.46% (1.7412 => 1.7157, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.27% (4.0310 => 3.9799, std.dev.: 0.0176)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.52% (0.1356 => 0.1363, std.dev.: 0.0093)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.53% (2.6492 => 2.7957, std.dev.: 0.0284)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.91% (0.4624 => 0.4851, std.dev.: 0.0025)
  MultiSource/Applications/d/make_dparser: 4.01% (3.4962 => 3.6365, std.dev.: 0.0136)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.75% (4.0397 => 4.1913, std.dev.: 0.0023)
  MultiSource/Applications/siod/siod: 3.67% (2.4480 => 2.5378, std.dev.: 0.0086)
  MultiSource/Applications/sgefa/sgefa: 3.04% (0.3848 => 0.3965, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.93% (1.9476 => 2.0046, std.dev.: 0.0027)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.67% (0.6297 => 0.6465, std.dev.: 0.0004)
  MultiSource/Applications/Burg/burg: 2.37% (1.3994 => 1.4325, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.6439 => 0.6581, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.17% (1.2932 => 1.3213, std.dev.: 0.0043)
  MultiSource/Applications/treecc/treecc: 2.13% (2.2516 => 2.2996, std.dev.: 0.0101)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.08% (6.0284 => 6.1539, std.dev.: 0.0277)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.02% (0.5046 => 0.5148, std.dev.: 0.0013)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.8233 => 0.8386, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.47% (0.8802 => 0.8931, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.31% (1.2550 => 1.2715, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.21% (1.3514 => 1.3677, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.38% (7.6426 => 12.5631, std.dev.: 0.0719)
  SingleSource/Benchmarks/Misc/pi: 57.51% (1.6574 => 2.6106, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 26.82% (1.1431 => 1.4497, std.dev.: 0.0282)
  SingleSource/Benchmarks/Misc/ReedSolomon: 11.83% (8.5256 => 9.5338, std.dev.: 0.1335)
  SingleSource/Benchmarks/McGill/misr: 9.94% (0.3771 => 0.4146, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.89% (1.2516 => 1.3378, std.dev.: 0.0068)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 6.73% (0.1871 => 0.1997, std.dev.: 0.0006)
  MultiSource/Applications/hexxagon/hexxagon: 6.73% (14.7810 => 15.7762, std.dev.: 0.0067)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0031)
  MultiSource/Applications/aha/aha: 5.65% (3.5731 => 3.7751, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.49% (3.1730 => 3.3473, std.dev.: 0.0029)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.90% (5.3716 => 5.6350, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.36% (3.5642 => 3.7196, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.17% (0.3836 => 0.3996, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.83% (5.7757 => 5.9970, std.dev.: 0.0017)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.53% (89.7126 => 92.8765, std.dev.: 0.2912)
  SingleSource/Benchmarks/Misc/fp-convert: 3.31% (7.5877 => 7.8385, std.dev.: 0.0048)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (2.1472 => 2.2128, std.dev.: 0.0050)
  MultiSource/Benchmarks/Olden/power/power: 2.39% (1.2170 => 1.2461, std.dev.: 0.0065)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (1.7652 => 1.8061, std.dev.: 0.0047)
  MultiSource/Applications/sqlite3/sqlite3: 2.20% (4.2733 => 4.3675, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.03% (3.1569 => 3.2209, std.dev.: 0.0131)
  SingleSource/Regression/C/uint64_to_float: 1.96% (1.4528 => 1.4813, std.dev.: 0.0026)
  MultiSource/Applications/siod/siod: 1.89% (3.5310 => 3.5976, std.dev.: 0.0061)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (8.1346 => 8.2801, std.dev.: 0.0077)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.67% (1.0477 => 1.0652, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/methcall: 1.66% (8.5434 => 8.6856, std.dev.: 0.0471)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.52% (6.7429 => 6.8456, std.dev.: 0.0004)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.18% (16.7972 => 16.9953, std.dev.: 0.0144)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.04% (0.1483 => 0.1171, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.31% (0.2571 => 0.2383, std.dev.: 0.0065)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.40% (0.5226 => 0.2331, std.dev.: 0.0594)
  MultiSource/Applications/sgefa/sgefa: -42.22% (1.5790 => 0.9124, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/em3d/em3d: -29.23% (5.0288 => 3.5588, std.dev.: 0.0285)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.09% (15.9508 => 12.7462, std.dev.: 0.5013)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.24% (50.0284 => 40.9045, std.dev.: 1.2790)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.53% (57.2347 => 47.1996, std.dev.: 0.1496)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.19% (20.8247 => 18.4936, std.dev.: 0.1301)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.84% (3.4956 => 3.1866, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -8.04% (4.0006 => 3.6788, std.dev.: 0.0876)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.92% (0.7474 => 0.7181, std.dev.: 0.0083)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.87% (36.8417 => 35.4164, std.dev.: 0.3231)
  SingleSource/Benchmarks/Misc/salsa20: -3.80% (7.7964 => 7.4998, std.dev.: 0.0307)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.36% (3.7437 => 3.6178, std.dev.: 0.0311)
  SingleSource/Benchmarks/Misc/ffbench: -2.57% (1.4030 => 1.3669, std.dev.: 0.0105)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.33% (3.7874 => 3.6991, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.13% (17.1431 => 16.7787, std.dev.: 0.0306)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.08% (2.3365 => 2.2879, std.dev.: 0.0078)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.97% (1.1075 => 1.0857, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc/flops: -1.83% (9.4433 => 9.2703, std.dev.: 0.0485)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.72% (2.5938 => 2.5493, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (4.9459 => 4.8703, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.17% (4.3592 => 4.3082, std.dev.: 0.0026)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1348 => 0.1363, std.dev.: 0.0093)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131016/d34e644f/attachment.html>


More information about the llvm-testresults mailing list