[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 18 11:24:49 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16449?compare_to=16445&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16449, Order: 192982, Start Time: 2013-10-18 16:38:27, End Time: 2013-10-18 18:28:02
      To: 16445, Order: 192969, Start Time: 2013-10-18 14:21:20, End Time: 2013-10-18 16:15:20
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 15 (27 on baseline)
Performance Improvements: 56 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1036 (1060 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 16.46% (1.4834 => 1.7275, std.dev.: 0.0895)
  SingleSource/Benchmarks/Misc/flops: 11.40% (8.3220 => 9.2706, std.dev.: 0.1865)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 9.93% (0.4593 => 0.5049, std.dev.: 0.0010)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.49% (1.2705 => 1.3530, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.18% (0.8279 => 0.8708, std.dev.: 0.0118)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.09% (2.4779 => 2.5545, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.55% (4.5052 => 4.6202, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.03% (6.7088 => 6.8450, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.94% (3.9264 => 4.0024, std.dev.: 0.0013)
  MultiSource/Applications/sgefa/sgefa: 1.92% (0.9008 => 0.9181, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.85% (4.2118 => 4.2897, std.dev.: 0.0105)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (23.4076 => 23.8131, std.dev.: 0.0124)
  SingleSource/Benchmarks/Shootout/fib2: 1.61% (3.5966 => 3.6544, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.55% (1.0481 => 1.0643, std.dev.: 0.0056)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.00% (1.7963 => 1.8143, std.dev.: 0.0026)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2007-03-02-VaCopy: -45.20% (0.0281 => 0.0154, std.dev.: 0.0010)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -39.14% (0.0419 => 0.0255, std.dev.: 0.0010)
  SingleSource/UnitTests/2003-05-26-Shorts: -38.59% (0.0368 => 0.0226, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: -38.35% (0.0704 => 0.0434, std.dev.: 0.0097)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -29.13% (0.1222 => 0.0866, std.dev.: 0.0082)
  MultiSource/Applications/Burg/burg: -26.20% (1.9396 => 1.4314, std.dev.: 0.0120)
  MultiSource/Applications/viterbi/viterbi: -25.83% (0.2741 => 0.2033, std.dev.: 0.0206)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.71% (0.3897 => 0.2973, std.dev.: 0.0341)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.82% (0.0973 => 0.0751, std.dev.: 0.0037)
  MultiSource/Applications/sgefa/sgefa: -20.23% (0.4913 => 0.3919, std.dev.: 0.0262)
  MultiSource/Applications/hbd/hbd: -18.49% (1.9445 => 1.5850, std.dev.: 0.0951)
  MultiSource/Applications/aha/aha: -17.72% (0.1535 => 0.1263, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -15.80% (0.4462 => 0.3757, std.dev.: 0.0200)
  MultiSource/Applications/ClamAV/clamscan: -14.24% (19.9160 => 17.0809, std.dev.: 0.9334)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -13.96% (1.5791 => 1.3587, std.dev.: 0.0827)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -13.69% (1.0374 => 0.8954, std.dev.: 0.0171)
  MultiSource/Applications/siod/siod: -12.67% (2.8835 => 2.5182, std.dev.: 0.0286)
  MultiSource/Applications/JM/ldecod/ldecod: -12.65% (8.8369 => 7.7189, std.dev.: 0.0732)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -12.44% (1.5629 => 1.3685, std.dev.: 0.0191)
  MultiSource/Applications/SPASS/SPASS: -11.94% (18.6632 => 16.4353, std.dev.: 0.7542)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -11.91% (0.2209 => 0.1946, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -11.34% (1.4360 => 1.2731, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -11.06% (1.3839 => 1.2308, std.dev.: 0.0521)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -10.97% (1.3814 => 1.2298, std.dev.: 0.0318)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.92% (1.6391 => 1.4601, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -10.23% (1.3857 => 1.2439, std.dev.: 0.0280)
  MultiSource/Applications/oggenc/oggenc: -10.21% (6.0677 => 5.4479, std.dev.: 0.0757)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -10.21% (0.2146 => 0.1927, std.dev.: 0.0046)
  SingleSource/Benchmarks/Shootout-C++/objinst: -10.14% (0.2347 => 0.2109, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/hash: -10.03% (0.4467 => 0.4019, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -9.86% (1.4601 => 1.3161, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -9.53% (1.4253 => 1.2894, std.dev.: 0.0447)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -9.43% (1.4089 => 1.2760, std.dev.: 0.0242)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -9.41% (0.3698 => 0.3350, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.18% (1.5988 => 1.4521, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -8.94% (1.5281 => 1.3915, std.dev.: 0.0117)
  SingleSource/Benchmarks/Shootout-C++/strcat: -8.44% (0.2215 => 0.2028, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -8.40% (1.4326 => 1.3123, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.30% (1.3440 => 1.2324, std.dev.: 0.0279)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.71% (0.2284 => 0.2108, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.04% (0.3514 => 0.3337, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc-C++/bigfib: -4.10% (0.6829 => 0.6549, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.24% (1.2964 => 1.2674, std.dev.: 0.0074)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: -40.07% (0.0277 => 0.0166, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -31.88% (6.7238 => 4.5800, std.dev.: 0.2370)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -20.48% (4.4307 => 3.5234, std.dev.: 0.2988)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -18.91% (0.1682 => 0.1364, std.dev.: 0.0112)
  MultiSource/Applications/SPASS/SPASS: -11.20% (9.0876 => 8.0695, std.dev.: 0.1434)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -11.09% (0.1542 => 0.1371, std.dev.: 0.0012)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -4.70% (41.3924 => 39.4476, std.dev.: 0.6710)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.07% (1.6571 => 1.5897, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.82% (5.2419 => 5.0942, std.dev.: 0.0490)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (9.0692 => 8.8974, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.88% (5.1415 => 5.0446, std.dev.: 0.0334)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.33% (3.6594 => 3.6109, std.dev.: 0.0187)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.18% (35.5902 => 35.1691, std.dev.: 0.1410)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.32% (0.1364 => 0.1346, std.dev.: 0.0030)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 4.27% (7.4026 => 7.7189, std.dev.: 0.0732)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.08% (1.3499 => 1.3915, std.dev.: 0.0117)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.45% (0.5705 => 0.5845, std.dev.: 0.0036)
  MultiSource/Applications/Burg/burg: 2.29% (1.3994 => 1.4314, std.dev.: 0.0120)
  SingleSource/Benchmarks/Misc-C++/bigfib: 1.71% (0.6439 => 0.6549, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.52% (1.4304 => 1.4521, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.09% (1.2981 => 1.3123, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.52% (7.6426 => 12.5738, std.dev.: 0.0382)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.81% (1.1431 => 1.3810, std.dev.: 0.0599)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 16.49% (1.4830 => 1.7275, std.dev.: 0.0895)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.10% (1.2516 => 1.3530, std.dev.: 0.0068)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.66% (3.1730 => 3.3525, std.dev.: 0.0224)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.26% (0.8273 => 0.8708, std.dev.: 0.0118)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.96% (5.3716 => 5.6379, std.dev.: 0.0158)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.85% (2.5368 => 2.6344, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.37% (4.4696 => 4.6202, std.dev.: 0.0044)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.10% (89.7126 => 92.4938, std.dev.: 0.1043)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.78% (1.7652 => 1.8143, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/power/power: 2.35% (1.2170 => 1.2456, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/fib2: 1.61% (3.5966 => 3.6544, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.58% (1.0477 => 1.0643, std.dev.: 0.0056)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (2.4920 => 2.5314, std.dev.: 0.0148)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.51% (6.7429 => 6.8450, std.dev.: 0.0009)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.46% (23.4704 => 23.8131, std.dev.: 0.0124)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.32% (16.7972 => 17.0181, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.19% (3.9552 => 4.0024, std.dev.: 0.0013)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.29% (0.1195 => 0.1084, std.dev.: 0.0010)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.36% (0.5226 => 0.2333, std.dev.: 0.0444)
  MultiSource/Applications/sgefa/sgefa: -41.86% (1.5790 => 0.9181, std.dev.: 0.0008)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.25% (0.0400 => 0.0263, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/em3d/em3d: -29.24% (5.0288 => 3.5585, std.dev.: 0.0198)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.77% (57.2347 => 43.6303, std.dev.: 4.0334)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.41% (15.9508 => 12.8550, std.dev.: 0.3002)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.38% (50.0284 => 40.8308, std.dev.: 2.7765)
  MultiSource/Benchmarks/FreeBench/mason/mason: -10.77% (0.3304 => 0.2948, std.dev.: 0.0013)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.47% (20.8247 => 18.6447, std.dev.: 0.1004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.23% (3.4956 => 3.1731, std.dev.: 0.0075)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.37% (0.6563 => 0.6276, std.dev.: 0.0111)
  MultiSource/Applications/lua/lua: -4.15% (29.5202 => 28.2942, std.dev.: 0.4389)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.55% (3.7437 => 3.6109, std.dev.: 0.0187)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.39% (0.7474 => 0.7221, std.dev.: 0.0049)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.30% (2.5938 => 2.5083, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.92% (17.1431 => 16.6417, std.dev.: 0.1011)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.34% (3.7874 => 3.6986, std.dev.: 0.0007)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.03% (2.4471 => 2.3974, std.dev.: 0.0130)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.59% (4.3592 => 4.2897, std.dev.: 0.0105)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.15% (0.1348 => 0.1346, std.dev.: 0.0030)

Report Time: 0.92s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131018/e3f377a0/attachment.html>


More information about the llvm-testresults mailing list