[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Oct 24 03:19:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16631?compare_to=16626&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16631, Order: 193313, Start Time: 2013-10-24 08:24:07, End Time: 2013-10-24 10:22:45
      To: 16626, Order: 193303, Start Time: 2013-10-24 06:06:12, End Time: 2013-10-24 07:58:27
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 29 (39 on baseline)
Performance Improvements: 5 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1073 (1052 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 80.05% (0.0842 => 0.1516, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 23.04% (1.2297 => 1.5130, std.dev.: 0.0555)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.41% (1.3654 => 1.6441, std.dev.: 0.0279)
  SingleSource/Benchmarks/Misc-C++/bigfib: 19.71% (0.6589 => 0.7888, std.dev.: 0.0252)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 18.20% (2.7868 => 3.2940, std.dev.: 0.1164)
  MultiSource/Benchmarks/Bullet/bullet: 17.61% (33.6225 => 39.5449, std.dev.: 2.2822)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.22% (1.2857 => 1.4942, std.dev.: 0.0339)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.98% (1.2529 => 1.4531, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 15.14% (1.2527 => 1.4423, std.dev.: 0.0478)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.10% (2.0138 => 2.3179, std.dev.: 0.0356)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.09% (4.3394 => 4.9942, std.dev.: 0.0700)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.64% (0.8937 => 1.0245, std.dev.: 0.0428)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.29% (0.5957 => 0.6153, std.dev.: 0.0074)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 58.14% (4.6003 => 7.2750, std.dev.: 0.4116)
  SingleSource/Benchmarks/Stanford/Bubblesort: 36.07% (0.0341 => 0.0464, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 24.03% (21.4925 => 26.6579, std.dev.: 1.3778)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 23.26% (59.6009 => 73.4653, std.dev.: 1.6438)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.26% (2.1110 => 2.4121, std.dev.: 0.0071)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 10.10% (2.3054 => 2.5383, std.dev.: 0.0426)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 9.94% (2.6526 => 2.9163, std.dev.: 0.0195)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.60% (0.4265 => 0.4632, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.32% (6.0783 => 6.5235, std.dev.: 0.0440)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.81% (5.8997 => 6.1836, std.dev.: 0.0996)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.67% (5.0942 => 5.2813, std.dev.: 0.0612)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.78% (5.7042 => 5.8627, std.dev.: 0.0450)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 2.61% (1.4119 => 1.4487, std.dev.: 0.0120)
  SingleSource/Benchmarks/Shootout/fib2: 1.83% (3.5885 => 3.6542, std.dev.: 0.0035)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.63% (18.4808 => 18.7827, std.dev.: 0.0547)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.33% (2.5538 => 2.5877, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/JM/lencod/lencod: -12.30% (8.2419 => 7.2280, std.dev.: 0.1855)
  MultiSource/Applications/spiff/spiff: -2.03% (2.9465 => 2.8867, std.dev.: 0.0157)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.02% (3.1870 => 3.1227, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/oourafft: -1.34% (3.7025 => 3.6528, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.06% (5.3605 => 5.3035, std.dev.: 0.0065)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.22% (0.1367 => 0.1364, std.dev.: 0.0072)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 84.88% (0.0820 => 0.1516, std.dev.: 0.0032)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 24.34% (2.6492 => 3.2940, std.dev.: 0.1164)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.01% (1.2201 => 1.5130, std.dev.: 0.0555)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.63% (4.0397 => 4.9942, std.dev.: 0.0700)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.02% (1.3365 => 1.6441, std.dev.: 0.0279)
  SingleSource/Benchmarks/Misc-C++/bigfib: 22.50% (0.6439 => 0.7888, std.dev.: 0.0252)
  MultiSource/Benchmarks/Bullet/bullet: 20.73% (32.7552 => 39.5449, std.dev.: 2.2822)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.32% (1.2523 => 1.4942, std.dev.: 0.0339)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 19.01% (1.9476 => 2.3179, std.dev.: 0.0356)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.39% (0.8802 => 1.0245, std.dev.: 0.0428)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.30% (1.2494 => 1.4531, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 15.68% (1.2468 => 1.4423, std.dev.: 0.0478)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.85% (0.5705 => 0.6153, std.dev.: 0.0074)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.41% (1.5333 => 1.6009, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.67% (1.2550 => 1.2885, std.dev.: 0.0104)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Bubblesort: 66.31% (0.0279 => 0.0464, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.82% (7.6426 => 12.5204, std.dev.: 0.1351)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 59.96% (4.5479 => 7.2750, std.dev.: 0.4116)
  SingleSource/Benchmarks/Misc/pi: 32.79% (1.6574 => 2.2009, std.dev.: 0.1936)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 23.87% (21.5217 => 26.6579, std.dev.: 1.3778)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 21.01% (60.7119 => 73.4653, std.dev.: 1.6438)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.26% (2.1111 => 2.4121, std.dev.: 0.0071)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 10.85% (23.4704 => 26.0171, std.dev.: 0.0403)
  SingleSource/Benchmarks/McGill/misr: 10.40% (0.3771 => 0.4163, std.dev.: 0.0134)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 9.72% (2.6579 => 2.9163, std.dev.: 0.0195)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 8.64% (2.3365 => 2.5383, std.dev.: 0.0426)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.79% (6.1088 => 6.5235, std.dev.: 0.0440)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0048)
  MultiSource/Benchmarks/BitBench/five11/five11: 6.26% (5.3716 => 5.7079, std.dev.: 0.0386)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.76% (3.1730 => 3.3558, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.70% (5.9061 => 6.1836, std.dev.: 0.0996)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.60% (5.0980 => 5.2813, std.dev.: 0.0612)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.08% (89.7126 => 92.4784, std.dev.: 0.2132)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.94% (5.6951 => 5.8627, std.dev.: 0.0450)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 2.45% (1.4140 => 1.4487, std.dev.: 0.0120)
  MultiSource/Applications/spiff/spiff: 2.39% (2.8194 => 2.8867, std.dev.: 0.0157)
  SingleSource/Benchmarks/Shootout/fib2: 1.60% (3.5966 => 3.6542, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.43% (2.5513 => 2.5877, std.dev.: 0.0035)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.34% (16.7972 => 17.0215, std.dev.: 0.0235)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.19% (0.5226 => 0.2394, std.dev.: 0.0274)
  MultiSource/Applications/sgefa/sgefa: -42.25% (1.5790 => 0.9119, std.dev.: 0.0035)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.27% (50.0284 => 43.3920, std.dev.: 0.0286)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -13.11% (1.0695 => 0.9293, std.dev.: 0.0223)
  MultiSource/Applications/JM/lencod/lencod: -11.62% (8.1785 => 7.2280, std.dev.: 0.1855)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.67% (3.4956 => 3.1227, std.dev.: 0.0037)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.3304 => 0.2977, std.dev.: 0.0091)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.81% (20.8247 => 18.7827, std.dev.: 0.0547)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.65% (3.7437 => 3.5323, std.dev.: 0.0558)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.00% (2.5938 => 2.4900, std.dev.: 0.0181)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.77% (3.7874 => 3.6826, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.64% (5.4473 => 5.3035, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc/oourafft: -2.55% (3.7484 => 3.6528, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.37% (17.1431 => 16.7360, std.dev.: 0.1299)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.99% (4.3592 => 4.2724, std.dev.: 0.0026)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.99% (2.4471 => 2.3985, std.dev.: 0.0140)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1348 => 0.1364, std.dev.: 0.0072)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131024/34692b5d/attachment.html>


More information about the llvm-testresults mailing list