[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Dec 8 10:06:25 PST 2013


http://llvm.org/perf/db_default/v4/nts/18151?compare_to=18146&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18151, Order: 196724, Start Time: 2013-12-08 16:26:12, End Time: 2013-12-08 18:10:36
      To: 18146, Order: 196719, Start Time: 2013-12-08 14:16:56, End Time: 2013-12-08 16:00:35
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 32 (29 on baseline)
Performance Improvements: 3 (27 on baseline)
Unchanged Tests: 1075 (1054 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 65.29% (0.0654 => 0.1081, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.91% (5.4347 => 5.9189, std.dev.: 0.0390)
  MultiSource/Applications/ClamAV/clamscan: 7.66% (16.6970 => 17.9758, std.dev.: 0.3223)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.76% (1.9696 => 2.0830, std.dev.: 0.0269)
  MultiSource/Benchmarks/McCat/05-eks/eks: 4.26% (0.5116 => 0.5334, std.dev.: 0.0019)
  MultiSource/Applications/oggenc/oggenc: 1.55% (5.4699 => 5.5546, std.dev.: 0.0252)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.25% (0.8241 => 0.8344, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.19% (1.2654 => 1.2804, std.dev.: 0.0039)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 26.44% (2.9274 => 3.7013, std.dev.: 0.1520)
  SingleSource/Benchmarks/Shootout/matrix: 15.51% (1.8276 => 2.1111, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout/sieve: 14.14% (6.8833 => 7.8564, std.dev.: 0.1336)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.83% (2.1029 => 2.3937, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.16% (3.1640 => 3.5487, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 11.57% (35.7868 => 39.9284, std.dev.: 0.8338)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.34% (0.8326 => 0.9020, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.57% (3.5836 => 3.8549, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.99% (3.9645 => 4.2416, std.dev.: 0.0481)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.91% (2.9367 => 3.1396, std.dev.: 0.0303)
  MultiSource/Applications/siod/siod: 4.09% (3.4796 => 3.6218, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.87% (3.4851 => 3.6198, std.dev.: 0.0471)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.77% (2.7160 => 2.8184, std.dev.: 0.0321)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.70% (0.4789 => 0.4966, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.31% (5.8047 => 5.9970, std.dev.: 0.0263)
  MultiSource/Applications/lua/lua: 3.16% (28.6649 => 29.5698, std.dev.: 0.3377)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.74% (1.6484 => 1.6935, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.50% (5.9397 => 6.0880, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.23% (11.8098 => 12.0727, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.08% (11.8859 => 12.1329, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.96% (5.8116 => 5.9253, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.90% (3.1534 => 3.2133, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout/fib2: 1.32% (3.6043 => 3.6519, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/mandel: 1.05% (1.0556 => 1.0667, std.dev.: 0.0007)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.44% (0.2411 => 0.2304, std.dev.: 0.0011)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -5.69% (1.3758 => 1.2975, std.dev.: 0.0127)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.28% (2.4867 => 2.4300, std.dev.: 0.0216)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 57.58% (0.0686 => 0.1081, std.dev.: 0.0033)
  MultiSource/Applications/ClamAV/clamscan: 5.95% (16.9661 => 17.9758, std.dev.: 0.3223)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.02% (1.9834 => 2.0830, std.dev.: 0.0269)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Bubblesort: 39.71% (0.0272 => 0.0380, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/matrix: 29.38% (2.8607 => 3.7013, std.dev.: 0.1520)
  SingleSource/Benchmarks/Shootout/matrix: 17.54% (1.7960 => 2.1111, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout/sieve: 16.47% (6.7454 => 7.8564, std.dev.: 0.1336)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.88% (2.1020 => 2.3937, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.35% (3.1585 => 3.5487, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 11.01% (35.9684 => 39.9284, std.dev.: 0.8338)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.49% (2.8940 => 3.1396, std.dev.: 0.0303)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.32% (1.1019 => 1.1936, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.77% (3.5771 => 3.8549, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.01% (4.0012 => 4.2416, std.dev.: 0.0481)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.72% (2.6658 => 2.8184, std.dev.: 0.0321)
  MultiSource/Applications/siod/siod: 5.72% (3.4258 => 3.6218, std.dev.: 0.0095)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.45% (0.8636 => 0.9020, std.dev.: 0.0120)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.93% (1.2278 => 1.2760, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.81% (5.0601 => 5.2531, std.dev.: 0.0292)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.48% (5.7952 => 5.9970, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.97% (5.9126 => 6.0882, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.40% (11.7894 => 12.0727, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.40% (5.9456 => 6.0880, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.04% (11.8902 => 12.1329, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.86% (3.1547 => 3.2133, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout/fib2: 1.55% (3.5960 => 3.6519, std.dev.: 0.0052)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (1.6699 => 1.6935, std.dev.: 0.0023)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.12% (4.1840 => 4.2308, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc/flops-8: 1.00% (2.5116 => 2.5368, std.dev.: 0.0005)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.60% (0.0688 => 0.0505, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -10.07% (0.3247 => 0.2920, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -7.82% (1.3676 => 1.2606, std.dev.: 0.0108)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.25% (0.6882 => 0.6383, std.dev.: 0.0076)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.1774 => 0.1673, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.38% (1.3505 => 1.2778, std.dev.: 0.0075)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.81% (1.1409 => 1.0860, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.74% (1.3146 => 1.2523, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.67% (1.3460 => 1.2831, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.63% (1.4113 => 1.3459, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.25% (1.3660 => 1.3080, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.16% (1.2914 => 1.2377, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.08% (1.3127 => 1.2591, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.06% (1.4125 => 1.3551, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.95% (1.3024 => 1.2510, std.dev.: 0.0111)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.91% (0.2810 => 0.2700, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.47% (1.3264 => 1.2804, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.39% (1.3918 => 1.3446, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.84% (1.3182 => 1.2807, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.63% (1.2583 => 1.2252, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.29% (1.3510 => 1.3200, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.88% (1.2670 => 1.2432, std.dev.: 0.0087)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -9.49% (1.4335 => 1.2975, std.dev.: 0.0127)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.93% (2.5559 => 2.4300, std.dev.: 0.0216)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.25% (3.6583 => 3.5395, std.dev.: 0.0378)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.12% (6.0535 => 5.9253, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.10% (4.1462 => 4.1007, std.dev.: 0.0017)

Report Time: 0.79s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131208/7f6df317/attachment.html>


More information about the llvm-testresults mailing list