[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 17 10:15:14 PST 2013


http://llvm.org/perf/db_default/v4/nts/18530?compare_to=18525&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18530, Order: 197503, Start Time: 2013-12-17 16:31:31, End Time: 2013-12-17 18:19:33
      To: 18525, Order: 197495, Start Time: 2013-12-17 14:17:03, End Time: 2013-12-17 16:04:31
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 29 (37 on baseline)
Performance Improvements: 12 (13 on baseline)
Unchanged Tests: 1069 (1060 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/mason/mason: 68.07% (0.0667 => 0.1121, std.dev.: 0.0039)
  MultiSource/Benchmarks/MallocBench/gs/gs: 27.35% (4.8141 => 6.1307, std.dev.: 0.2406)
  MultiSource/Benchmarks/Olden/mst/mst: 21.84% (0.1346 => 0.1640, std.dev.: 0.0023)
  MultiSource/Benchmarks/McCat/18-imp/imp: 15.06% (0.4005 => 0.4608, std.dev.: 0.0145)
  MultiSource/Benchmarks/Prolangs-C/football/football: 12.92% (1.0147 => 1.1458, std.dev.: 0.0125)
  MultiSource/Benchmarks/nbench/nbench: 10.78% (1.2629 => 1.3990, std.dev.: 0.0387)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.24% (5.4203 => 5.8126, std.dev.: 0.0576)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.49% (2.7627 => 2.9419, std.dev.: 0.0560)
  SingleSource/Benchmarks/Shootout-C++/matrix: 5.33% (0.2402 => 0.2530, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.35% (0.8893 => 0.9280, std.dev.: 0.0116)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3868 => 0.3986, std.dev.: 0.0028)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 61.99% (0.7925 => 1.2838, std.dev.: 0.0296)
  MultiSource/Benchmarks/Olden/mst/mst: 45.40% (0.1586 => 0.2306, std.dev.: 0.0152)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 39.72% (0.1410 => 0.1970, std.dev.: 0.0216)
  SingleSource/Benchmarks/Shootout/ary3: 35.48% (4.3366 => 5.8752, std.dev.: 0.5069)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.87% (0.0310 => 0.0415, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.25% (4.5723 => 5.7267, std.dev.: 0.1739)
  SingleSource/Benchmarks/Shootout/matrix: 17.37% (1.7961 => 2.1080, std.dev.: 0.0029)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.71% (2.0950 => 2.3823, std.dev.: 0.0199)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.69% (46.6786 => 49.8001, std.dev.: 0.2277)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.13% (40.8292 => 42.9228, std.dev.: 0.4148)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.88% (60.6657 => 63.6283, std.dev.: 0.7709)
  SingleSource/Benchmarks/Shootout-C++/hash: 4.32% (0.7243 => 0.7556, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/flops: 3.86% (9.2677 => 9.6251, std.dev.: 0.1092)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.96% (3.1592 => 3.2210, std.dev.: 0.0199)
  SingleSource/Benchmarks/Misc/fp-convert: 1.86% (7.4041 => 7.5421, std.dev.: 0.0206)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.75% (39.4352 => 40.1245, std.dev.: 0.0701)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.39% (5.9268 => 6.0094, std.dev.: 0.0028)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.29% (8.7994 => 8.9131, std.dev.: 0.0100)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/hbd/hbd: -18.92% (1.9917 => 1.6149, std.dev.: 0.0473)
  MultiSource/Applications/minisat/minisat: -14.10% (0.8984 => 0.7717, std.dev.: 0.0399)
  MultiSource/Applications/lambda-0_1_3/lambda: -9.88% (0.9343 => 0.8420, std.dev.: 0.0047)
  MultiSource/Applications/sqlite3/sqlite3: -3.56% (23.5926 => 22.7530, std.dev.: 0.2075)
  MultiSource/Applications/oggenc/oggenc: -3.20% (6.0152 => 5.8229, std.dev.: 0.0586)
  MultiSource/Applications/lemon/lemon: -2.92% (1.3918 => 1.3511, std.dev.: 0.0082)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/minisat/minisat: -16.07% (8.2367 => 6.9132, std.dev.: 0.4393)
  MultiSource/Applications/lemon/lemon: -9.53% (0.9802 => 0.8868, std.dev.: 0.0354)
  SingleSource/Benchmarks/McGill/misr: -6.95% (0.4017 => 0.3738, std.dev.: 0.0085)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.23% (41.2075 => 38.6388, std.dev.: 0.7058)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -4.06% (0.3742 => 0.3590, std.dev.: 0.0015)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.14% (2.5367 => 2.4823, std.dev.: 0.0019)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/mason/mason: 63.41% (0.0686 => 0.1121, std.dev.: 0.0039)
  MultiSource/Applications/sqlite3/sqlite3: 44.54% (15.7419 => 22.7530, std.dev.: 0.2075)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 44.16% (0.3859 => 0.5563, std.dev.: 0.0306)
  MultiSource/Benchmarks/MallocBench/gs/gs: 30.83% (4.6860 => 6.1307, std.dev.: 0.2406)
  MultiSource/Benchmarks/Olden/mst/mst: 19.80% (0.1369 => 0.1640, std.dev.: 0.0023)
  MultiSource/Benchmarks/McCat/18-imp/imp: 16.01% (0.3972 => 0.4608, std.dev.: 0.0145)
  MultiSource/Benchmarks/Prolangs-C/football/football: 15.56% (0.9915 => 1.1458, std.dev.: 0.0125)
  MultiSource/Applications/lemon/lemon: 10.75% (1.2200 => 1.3511, std.dev.: 0.0082)
  MultiSource/Benchmarks/nbench/nbench: 10.62% (1.2647 => 1.3990, std.dev.: 0.0387)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.70% (2.7572 => 2.9419, std.dev.: 0.0560)
  MultiSource/Applications/oggenc/oggenc: 5.93% (5.4968 => 5.8229, std.dev.: 0.0586)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.61% (0.8787 => 0.9280, std.dev.: 0.0116)
  SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.2400 => 0.2530, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3825 => 0.3986, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.6322 => 0.6562, std.dev.: 0.0039)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 71.45% (0.1345 => 0.2306, std.dev.: 0.0152)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 67.38% (0.7670 => 1.2838, std.dev.: 0.0296)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 50.36% (0.0276 => 0.0415, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/bisort/bisort: 30.10% (0.6732 => 0.8758, std.dev.: 0.0753)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.12% (4.5769 => 5.7267, std.dev.: 0.1739)
  SingleSource/Benchmarks/Shootout/matrix: 17.37% (1.7960 => 2.1080, std.dev.: 0.0029)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.06% (1.2278 => 1.4373, std.dev.: 0.0548)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.69% (5.9583 => 6.9529, std.dev.: 0.1705)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.33% (2.1020 => 2.3823, std.dev.: 0.0199)
  MultiSource/Applications/obsequi/Obsequi: 7.79% (2.3061 => 2.4857, std.dev.: 0.0420)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.42% (35.9684 => 38.6388, std.dev.: 0.7058)
  MultiSource/Applications/SIBsim4/SIBsim4: 6.14% (3.4043 => 3.6134, std.dev.: 0.0486)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.84% (40.5530 => 42.9228, std.dev.: 0.4148)
  MultiSource/Applications/lua/lua: 4.73% (29.1357 => 30.5150, std.dev.: 0.1346)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.17% (61.0792 => 63.6283, std.dev.: 0.7709)
  SingleSource/Benchmarks/Misc/flops: 3.86% (9.2673 => 9.6251, std.dev.: 0.1092)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.87% (1.2463 => 1.2821, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.13% (11.7894 => 12.0402, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (3.1547 => 3.2210, std.dev.: 0.0199)
  SingleSource/Benchmarks/Misc/fp-convert: 2.07% (7.3892 => 7.5421, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.97% (5.8933 => 6.0094, std.dev.: 0.0028)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.20% (8.8073 => 8.9131, std.dev.: 0.0100)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.89% (0.0688 => 0.0503, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -13.00% (0.1938 => 0.1686, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.94% (0.3402 => 0.3132, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.93% (1.2824 => 1.2063, std.dev.: 0.0291)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.73% (0.6882 => 0.6488, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.56% (1.2724 => 1.2016, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.88% (1.3819 => 1.3144, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.58% (1.3505 => 1.2887, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.95% (1.5305 => 1.4700, std.dev.: 0.0233)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.61% (1.2914 => 1.2448, std.dev.: 0.0110)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -7.88% (0.3970 => 0.3657, std.dev.: 0.0116)
  SingleSource/Benchmarks/McGill/misr: -7.22% (0.4029 => 0.3738, std.dev.: 0.0085)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.29% (50.9650 => 49.8001, std.dev.: 0.2277)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131217/274cfd62/attachment.html>


More information about the llvm-testresults mailing list