[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Nov 2 14:10:34 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16941?compare_to=16939&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16941, Order: 193931, Start Time: 2013-11-02 19:29:49, End Time: 2013-11-02 21:14:03
      To: 16939, Order: 193927, Start Time: 2013-11-02 17:16:52, End Time: 2013-11-02 19:08:34
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 22 (44 on baseline)
Performance Improvements: 24 (23 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1061 (1040 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/SIBsim4/SIBsim4: 1.00% (1.5263 => 1.5416, std.dev.: 0.0049)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 57.78% (1.6543 => 2.6102, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 36.57% (0.1452 => 0.1983, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/matrix: 11.01% (1.7717 => 1.9667, std.dev.: 0.0666)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.99% (6.4352 => 7.1427, std.dev.: 0.1010)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.11% (3.2370 => 3.5319, std.dev.: 0.0080)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.03% (1.3824 => 1.4796, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.99% (6.9642 => 7.4512, std.dev.: 0.0090)
  MultiSource/Applications/obsequi/Obsequi: 6.37% (2.2031 => 2.3434, std.dev.: 0.0206)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.96% (0.4231 => 0.4483, std.dev.: 0.0071)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.55% (0.8458 => 0.8927, std.dev.: 0.0168)
  MultiSource/Applications/spiff/spiff: 4.69% (2.8208 => 2.9532, std.dev.: 0.0159)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.65% (0.6940 => 0.7263, std.dev.: 0.0013)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.90% (2.6056 => 2.7073, std.dev.: 0.0243)
  SingleSource/Benchmarks/Misc/fp-convert: 2.68% (7.5913 => 7.7951, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.51% (3.5635 => 3.6529, std.dev.: 0.0322)
  MultiSource/Applications/aha/aha: 2.32% (3.6880 => 3.7735, std.dev.: 0.0058)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (3.1280 => 3.1774, std.dev.: 0.0068)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.47% (2.3788 => 2.4138, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.46% (3.9538 => 4.0114, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.42% (6.0084 => 6.0940, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.30% (11.9835 => 12.1391, std.dev.: 0.0343)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2002-10-13-BadLoad: -55.26% (0.0228 => 0.0102, std.dev.: 0.0005)
  SingleSource/UnitTests/DefaultInitDynArrays: -50.63% (0.0237 => 0.0117, std.dev.: 0.0005)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: -50.48% (0.0315 => 0.0156, std.dev.: 0.0007)
  SingleSource/UnitTests/SignlessTypes/cast-bug: -48.67% (0.0226 => 0.0116, std.dev.: 0.0007)
  SingleSource/UnitTests/2003-05-26-Shorts: -47.97% (0.0419 => 0.0218, std.dev.: 0.0006)
  SingleSource/UnitTests/2008-04-18-LoopBug: -45.85% (0.0301 => 0.0163, std.dev.: 0.0000)
  SingleSource/UnitTests/member-function-pointers: -45.69% (0.0394 => 0.0214, std.dev.: 0.0006)
  SingleSource/UnitTests/2003-05-07-VarArgs: -45.12% (0.0461 => 0.0253, std.dev.: 0.0007)
  SingleSource/UnitTests/initp1: -44.52% (0.0894 => 0.0496, std.dev.: 0.0008)
  SingleSource/UnitTests/2003-10-13-SwitchTest: -43.21% (0.0280 => 0.0159, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-07-09-LoadShorts: -43.08% (0.0441 => 0.0251, std.dev.: 0.0006)
  SingleSource/UnitTests/2003-07-06-IntOverflow: -34.24% (0.0330 => 0.0217, std.dev.: 0.0000)
  SingleSource/Benchmarks/Dhrystone/dry: -15.34% (0.0665 => 0.0563, std.dev.: 0.0028)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -11.34% (0.1632 => 0.1447, std.dev.: 0.0021)
  SingleSource/UnitTests/SignlessTypes/rem: -7.81% (0.1280 => 0.1180, std.dev.: 0.0010)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -4.76% (0.4160 => 0.3962, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.72% (6.2042 => 6.0976, std.dev.: 0.0242)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.71% (4.3138 => 4.2399, std.dev.: 0.0283)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -73.08% (49.8066 => 13.4089, std.dev.: 0.0816)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -21.63% (1.8653 => 1.4619, std.dev.: 0.1305)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.89% (5.2035 => 4.5850, std.dev.: 0.0154)
  SingleSource/Benchmarks/Dhrystone/dry: -3.72% (0.5050 => 0.4862, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/ffbench: -2.85% (1.4297 => 1.3890, std.dev.: 0.0155)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.64% (1.6501 => 1.6230, std.dev.: 0.0088)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.65% (0.1382 => 0.1373, std.dev.: 0.0011)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/oourafft: 10.81% (0.2294 => 0.2542, std.dev.: 0.0003)
  SingleSource/Benchmarks/Linpack/linpack-pc: 5.63% (0.2949 => 0.3115, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.96% (4.0397 => 4.2399, std.dev.: 0.0283)
  MultiSource/Applications/JM/lencod/lencod: 4.11% (16.5902 => 17.2722, std.dev.: 0.0567)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.04% (2.6492 => 2.7563, std.dev.: 0.0076)
  MultiSource/Applications/siod/siod: 3.24% (2.4480 => 2.5274, std.dev.: 0.0003)
  MultiSource/Applications/JM/ldecod/ldecod: 3.07% (7.4026 => 7.6296, std.dev.: 0.0271)
  MultiSource/Applications/minisat/minisat: 2.18% (0.7439 => 0.7601, std.dev.: 0.0045)
  MultiSource/Applications/oggenc/oggenc: 2.08% (5.3339 => 5.4451, std.dev.: 0.0254)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.81% (0.8802 => 0.8961, std.dev.: 0.0051)
  MultiSource/Applications/Burg/burg: 1.71% (1.3994 => 1.4233, std.dev.: 0.0043)
  MultiSource/Applications/d/make_dparser: 1.49% (3.4962 => 3.5484, std.dev.: 0.0102)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.15% (6.0284 => 6.0976, std.dev.: 0.0242)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 66.71% (4.4696 => 7.4512, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.91% (7.6426 => 12.3741, std.dev.: 0.0316)
  SingleSource/Benchmarks/Misc/pi: 57.49% (1.6574 => 2.6102, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/matrix: 50.28% (2.8554 => 4.2912, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 40.94% (4.2391 => 5.9744, std.dev.: 0.1198)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 29.44% (1.1431 => 1.4796, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.87% (6.4425 => 7.1427, std.dev.: 0.1010)
  SingleSource/Benchmarks/Shootout/matrix: 10.43% (1.7809 => 1.9667, std.dev.: 0.0666)
  SingleSource/Benchmarks/McGill/misr: 9.15% (0.3771 => 0.4116, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.41% (0.1331 => 0.1443, std.dev.: 0.0002)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.14% (1.2516 => 1.3535, std.dev.: 0.0173)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.91% (0.8273 => 0.8927, std.dev.: 0.0168)
  MultiSource/Applications/obsequi/Obsequi: 7.08% (2.1884 => 2.3434, std.dev.: 0.0206)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.72% (2.5368 => 2.7073, std.dev.: 0.0243)
  SingleSource/UnitTests/Vector/multiplies: 6.58% (0.5561 => 0.5927, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.42% (3.1730 => 3.3768, std.dev.: 0.0021)
  MultiSource/Applications/oggenc/oggenc: 6.36% (0.1699 => 0.1807, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.99% (0.1871 => 0.1983, std.dev.: 0.0006)
  MultiSource/Applications/aha/aha: 5.61% (3.5731 => 3.7735, std.dev.: 0.0058)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.28% (0.4258 => 0.4483, std.dev.: 0.0071)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.10% (5.3716 => 5.6458, std.dev.: 0.0125)
  MultiSource/Applications/spiff/spiff: 4.75% (2.8194 => 2.9532, std.dev.: 0.0159)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 4.12% (89.7126 => 93.4072, std.dev.: 0.0619)
  SingleSource/Benchmarks/Misc/fp-convert: 2.73% (7.5877 => 7.7951, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.49% (3.5642 => 3.6529, std.dev.: 0.0322)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.82% (1.5940 => 1.6230, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.76% (11.9288 => 12.1391, std.dev.: 0.0343)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.50% (6.0038 => 6.0940, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.40% (6.6028 => 6.6953, std.dev.: 0.0256)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.32% (1.0477 => 1.0615, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.11% (5.3022 => 5.3612, std.dev.: 0.0203)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.51% (0.1483 => 0.1164, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/matrix: -8.60% (0.2571 => 0.2350, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.02% (0.2193 => 0.2083, std.dev.: 0.0016)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -76.57% (57.2347 => 13.4089, std.dev.: 0.0816)
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.92% (0.5226 => 0.2408, std.dev.: 0.0121)
  MultiSource/Applications/sgefa/sgefa: -42.17% (1.5790 => 0.9131, std.dev.: 0.0009)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.33% (15.9508 => 12.7081, std.dev.: 0.4788)
  SingleSource/Benchmarks/Shootout-C++/moments: -15.95% (0.1285 => 0.1080, std.dev.: 0.0009)
  MultiSource/Applications/SIBsim4/SIBsim4: -15.44% (3.7437 => 3.1658, std.dev.: 0.0626)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -12.10% (4.0181 => 3.5319, std.dev.: 0.0080)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.70% (20.8247 => 18.5961, std.dev.: 0.0610)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.10% (3.4956 => 3.1774, std.dev.: 0.0068)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.52% (8.1346 => 7.6039, std.dev.: 0.0518)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.62% (0.7474 => 0.7129, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.85% (3.9552 => 3.8031, std.dev.: 0.0067)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.36% (4.3592 => 4.2129, std.dev.: 0.0472)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.23% (1.4898 => 1.4417, std.dev.: 0.0130)
  MultiSource/Applications/SPASS/SPASS: -3.02% (8.2311 => 7.9826, std.dev.: 0.0624)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.66% (17.1431 => 16.6873, std.dev.: 0.0469)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.58% (3.7874 => 3.6896, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (2.5938 => 2.5339, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.78% (36.8417 => 36.1856, std.dev.: 0.2462)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.36% (2.4471 => 2.4138, std.dev.: 0.0049)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.85% (0.1348 => 0.1373, std.dev.: 0.0011)

Report Time: 2.12s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131102/43f01e87/attachment.html>


More information about the llvm-testresults mailing list