[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Oct 24 23:17:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16655?compare_to=16652&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16655, Order: 193391, Start Time: 2013-10-25 04:38:46, End Time: 2013-10-25 06:21:10
      To: 16652, Order: 193388, Start Time: 2013-10-25 02:23:24, End Time: 2013-10-25 04:16:55
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 19 (80 on baseline)
Performance Improvements: 15 (33 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1073 (994 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.6971 => 0.7105, std.dev.: 0.0044)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 37.97% (2.8617 => 3.9483, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/em3d/em3d: 19.55% (4.5606 => 5.4524, std.dev.: 0.0017)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.10% (0.4209 => 0.4634, std.dev.: 0.0001)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.67% (1.1078 => 1.2038, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.03% (0.8425 => 0.8933, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.07% (0.4617 => 0.4851, std.dev.: 0.0012)
  SingleSource/Benchmarks/McGill/misr: 4.37% (0.3937 => 0.4109, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.83% (5.0590 => 5.2529, std.dev.: 0.0117)
  SingleSource/Benchmarks/Shootout/lists: 3.18% (7.2173 => 7.4469, std.dev.: 0.0292)
  MultiSource/Applications/spiff/spiff: 3.11% (2.8875 => 2.9773, std.dev.: 0.0114)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.97% (1.4475 => 1.4905, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/fp-convert: 2.94% (7.5438 => 7.7658, std.dev.: 0.0465)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.78% (3.6200 => 3.7205, std.dev.: 0.0269)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.16% (3.5577 => 3.6345, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.00% (5.8997 => 6.0179, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.69% (6.5318 => 6.6422, std.dev.: 0.0383)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.29% (3.1468 => 3.1874, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.15% (1.0534 => 1.0655, std.dev.: 0.0002)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.32% (0.1850 => 0.1659, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/power/power: -9.30% (0.1591 => 0.1443, std.dev.: 0.0006)
  MultiSource/Applications/spiff/spiff: -8.53% (0.9808 => 0.8971, std.dev.: 0.0151)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -8.38% (0.2863 => 0.2623, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.89% (0.1466 => 0.1365, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.15% (0.9477 => 0.8894, std.dev.: 0.0016)
  SingleSource/UnitTests/Vector/constpool: -3.35% (9.4528 => 9.1357, std.dev.: 0.0499)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.55% (1.3588 => 1.3241, std.dev.: 0.0086)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -11.82% (0.2648 => 0.2335, std.dev.: 0.0023)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -5.24% (0.8033 => 0.7612, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.19% (5.3720 => 5.0933, std.dev.: 0.0885)
  MultiSource/Applications/lua/lua: -4.14% (30.1480 => 28.9011, std.dev.: 0.0953)
  MultiSource/Benchmarks/BitBench/five11/five11: -4.04% (5.7093 => 5.4784, std.dev.: 0.0321)
  MultiSource/Benchmarks/Olden/bisort/bisort: -3.56% (0.6996 => 0.6747, std.dev.: 0.0011)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.19% (0.9828 => 0.9711, std.dev.: 0.0029)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.37% (0.1368 => 0.1363, std.dev.: 0.0002)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.37% (4.0397 => 4.3373, std.dev.: 0.0169)
  MultiSource/Benchmarks/McCat/08-main/main: 5.92% (0.2870 => 0.3040, std.dev.: 0.0052)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.65% (0.3096 => 0.3271, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.26% (0.4624 => 0.4867, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.10% (2.6492 => 2.7842, std.dev.: 0.0098)
  MultiSource/Applications/JM/lencod/lencod: 4.97% (16.5902 => 17.4154, std.dev.: 0.0953)
  MultiSource/Benchmarks/McCat/09-vor/vor: 4.83% (0.3480 => 0.3648, std.dev.: 0.0026)
  MultiSource/Applications/JM/ldecod/ldecod: 4.56% (7.4026 => 7.7398, std.dev.: 0.0509)
  MultiSource/Applications/lemon/lemon: 4.06% (1.1862 => 1.2344, std.dev.: 0.0036)
  MultiSource/Applications/d/make_dparser: 3.98% (3.4962 => 3.6355, std.dev.: 0.0404)
  MultiSource/Applications/Burg/burg: 3.49% (1.3994 => 1.4483, std.dev.: 0.0185)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.33% (0.9494 => 0.9810, std.dev.: 0.0094)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.24% (0.3822 => 0.3946, std.dev.: 0.0010)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.21% (1.5333 => 1.5825, std.dev.: 0.0057)
  MultiSource/Applications/sgefa/sgefa: 3.17% (0.3848 => 0.3970, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (14.4764 => 14.9245, std.dev.: 0.0968)
  MultiSource/Applications/kimwitu++/kc: 3.09% (18.3608 => 18.9288, std.dev.: 0.0620)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.09% (0.5705 => 0.5881, std.dev.: 0.0044)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.95% (1.2728 => 1.3104, std.dev.: 0.0069)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.93% (0.9828 => 1.0116, std.dev.: 0.0043)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.88% (1.9476 => 2.0036, std.dev.: 0.0081)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.78% (24.6139 => 25.2993, std.dev.: 0.2123)
  SingleSource/UnitTests/Vector/constpool: 2.74% (8.8921 => 9.1357, std.dev.: 0.0499)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.5185 => 0.5326, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.8667 => 0.8894, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.59% (0.5609 => 0.5754, std.dev.: 0.0007)
  MultiSource/Applications/oggenc/oggenc: 2.57% (5.3339 => 5.4709, std.dev.: 0.0485)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.51% (1.3365 => 1.3700, std.dev.: 0.0129)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.44% (7.2661 => 7.4435, std.dev.: 0.0255)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (1.0935 => 1.1198, std.dev.: 0.0010)
  MultiSource/Applications/ClamAV/clamscan: 2.40% (16.5398 => 16.9371, std.dev.: 0.0248)
  MultiSource/Applications/treecc/treecc: 2.26% (2.2516 => 2.3024, std.dev.: 0.0137)
  MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.0276 => 1.0480, std.dev.: 0.0040)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.95% (4.5883 => 4.6776, std.dev.: 0.0268)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.8775 => 1.9139, std.dev.: 0.0089)
  MultiSource/Benchmarks/nbench/nbench: 1.79% (1.2484 => 1.2707, std.dev.: 0.0052)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.78% (1.0952 => 1.1147, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.72% (1.2086 => 1.2294, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.63% (1.2695 => 1.2902, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (1.4304 => 1.4525, std.dev.: 0.0071)
  MultiSource/Applications/obsequi/Obsequi: 1.54% (1.1551 => 1.1729, std.dev.: 0.0054)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.44% (5.5014 => 5.5806, std.dev.: 0.0099)
  MultiSource/Applications/lua/lua: 1.42% (4.2242 => 4.2840, std.dev.: 0.0136)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (4.9105 => 4.9770, std.dev.: 0.0122)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.30% (4.9293 => 4.9936, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.27% (1.4599 => 1.4785, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.12% (1.2639 => 1.2781, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.06% (1.3249 => 1.3390, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.00% (7.6426 => 12.4578, std.dev.: 0.0972)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.27% (2.8554 => 3.9483, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 30.21% (1.1431 => 1.4884, std.dev.: 0.0103)
  MultiSource/Applications/lemon/lemon: 17.12% (0.8526 => 0.9986, std.dev.: 0.0226)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.31% (1.1013 => 1.2038, std.dev.: 0.0014)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.03% (2.4753 => 2.6989, std.dev.: 0.0171)
  SingleSource/Benchmarks/McGill/misr: 8.96% (0.3771 => 0.4109, std.dev.: 0.0022)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 8.93% (23.4704 => 25.5668, std.dev.: 0.1991)
  MultiSource/Benchmarks/Olden/em3d/em3d: 8.42% (5.0288 => 5.4524, std.dev.: 0.0017)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.07% (1.2516 => 1.3526, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.98% (0.8273 => 0.8933, std.dev.: 0.0090)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.61% (3.1730 => 3.3509, std.dev.: 0.0431)
  MultiSource/Applications/spiff/spiff: 5.60% (2.8194 => 2.9773, std.dev.: 0.0114)
  MultiSource/Applications/aha/aha: 5.20% (3.5731 => 3.7588, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.39% (3.5642 => 3.7205, std.dev.: 0.0269)
  MultiSource/Applications/hexxagon/hexxagon: 4.00% (14.7810 => 15.3726, std.dev.: 0.1908)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.83% (0.3836 => 0.3983, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.67% (6.5990 => 6.8413, std.dev.: 0.0106)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.63% (2.5368 => 2.6289, std.dev.: 0.0180)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.09% (89.7126 => 92.4816, std.dev.: 0.4585)
  SingleSource/Benchmarks/Misc/fp-convert: 2.35% (7.5877 => 7.7658, std.dev.: 0.0465)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.04% (1.7652 => 1.8012, std.dev.: 0.0072)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.99% (5.3716 => 5.4784, std.dev.: 0.0321)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.86% (3.5683 => 3.6345, std.dev.: 0.0091)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.70% (1.0477 => 1.0655, std.dev.: 0.0002)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (2.4920 => 2.5314, std.dev.: 0.0014)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (8.1346 => 8.2585, std.dev.: 0.0275)
  MultiSource/Benchmarks/Olden/bisort/bisort: 1.50% (0.6647 => 0.6747, std.dev.: 0.0011)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.37% (16.7972 => 17.0279, std.dev.: 0.0754)
  SingleSource/Benchmarks/Shootout/methcall: 1.15% (8.5434 => 8.6420, std.dev.: 0.0171)
  SingleSource/Benchmarks/Shootout/lists: 1.04% (7.3703 => 7.4469, std.dev.: 0.0292)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.57% (0.1483 => 0.1178, std.dev.: 0.0032)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.04% (0.1195 => 0.1087, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.08% (0.2571 => 0.2389, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.37% (0.1956 => 0.1851, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.14% (1.2499 => 1.2231, std.dev.: 0.0064)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.32% (0.5226 => 0.2335, std.dev.: 0.0023)
  MultiSource/Applications/sgefa/sgefa: -42.82% (1.5790 => 0.9029, std.dev.: 0.0075)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.50% (0.0400 => 0.0250, std.dev.: 0.0000)
  SingleSource/Benchmarks/Linpack/linpack-pc: -20.90% (57.2347 => 45.2743, std.dev.: 2.3453)
  MultiSource/Benchmarks/FreeBench/mason/mason: -17.77% (0.3304 => 0.2717, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout/heapsort: -17.63% (3.5900 => 2.9571, std.dev.: 0.1368)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.48% (15.9508 => 13.1632, std.dev.: 0.0815)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -14.67% (1.7197 => 1.4675, std.dev.: 0.0969)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.51% (50.0284 => 43.2677, std.dev.: 0.7151)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -12.15% (20.8247 => 18.2946, std.dev.: 0.2156)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -10.94% (4.0006 => 3.5628, std.dev.: 0.1437)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.20% (1.0695 => 0.9711, std.dev.: 0.0029)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.82% (3.4956 => 3.1874, std.dev.: 0.0010)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.94% (3.7437 => 3.5213, std.dev.: 0.0512)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.37% (30.1838 => 28.5641, std.dev.: 0.5375)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.16% (0.7474 => 0.7088, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.38% (0.3462 => 0.3345, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.97% (17.1431 => 16.6345, std.dev.: 0.1056)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.92% (3.7874 => 3.6768, std.dev.: 0.0110)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.65% (4.5344 => 4.4144, std.dev.: 0.0279)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.64% (2.5938 => 2.5254, std.dev.: 0.0043)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.42% (4.3592 => 4.2535, std.dev.: 0.0224)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.28% (36.8417 => 36.0022, std.dev.: 0.0606)
  SingleSource/Benchmarks/Misc/oourafft: -2.19% (3.7484 => 3.6662, std.dev.: 0.0183)
  MultiSource/Applications/lua/lua: -2.10% (29.5202 => 28.9011, std.dev.: 0.0953)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.78% (2.4471 => 2.4035, std.dev.: 0.0104)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.48% (4.9022 => 4.8298, std.dev.: 0.0254)
  SingleSource/Benchmarks/Misc/whetstone: -1.01% (3.6303 => 3.5935, std.dev.: 0.0090)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1348 => 0.1363, std.dev.: 0.0002)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131025/197bc3d9/attachment.html>


More information about the llvm-testresults mailing list