[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Dec 28 17:21:48 PST 2013


http://llvm.org/perf/db_default/v4/nts/19210?compare_to=19198&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19210, Order: 198131, Start Time: 2013-12-28 23:23:04, End Time: 2013-12-29 01:26:13
      To: 19198, Order: 198118, Start Time: 2013-12-28 21:11:28, End Time: 2013-12-28 22:56:38
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 35 (38 on baseline)
Performance Improvements: 4 (7 on baseline)
Unchanged Tests: 1071 (1065 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-31-CastToBool: 61.54% (0.0260 => 0.0420, std.dev.: 0.0017)
  SingleSource/Benchmarks/Stanford/RealMM: 60.05% (0.0443 => 0.0709, std.dev.: 0.0017)
  SingleSource/Benchmarks/Stanford/Quicksort: 59.70% (0.0397 => 0.0634, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout/methcall: 47.89% (0.0355 => 0.0525, std.dev.: 0.0053)
  MultiSource/Benchmarks/MallocBench/gs/gs: 33.38% (4.6593 => 6.2145, std.dev.: 0.3826)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.98% (5.5063 => 6.4961, std.dev.: 0.2545)
  MultiSource/Applications/lua/lua: 16.56% (4.2874 => 4.9973, std.dev.: 0.2308)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.31% (45.0681 => 51.9684, std.dev.: 2.1190)
  MultiSource/Applications/SIBsim4/SIBsim4: 13.96% (1.5664 => 1.7850, std.dev.: 0.0135)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.83% (5.4498 => 5.8767, std.dev.: 0.1119)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.15% (0.2618 => 0.2779, std.dev.: 0.0058)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.60% (27.5889 => 29.1336, std.dev.: 0.4591)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.64% (1.2368 => 1.2694, std.dev.: 0.0094)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 48.73% (2.8006 => 4.1652, std.dev.: 0.1782)
  SingleSource/Benchmarks/Stanford/Bubblesort: 44.94% (0.0267 => 0.0387, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.89% (4.5460 => 6.0413, std.dev.: 0.0444)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 29.79% (1.4488 => 1.8804, std.dev.: 0.1289)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.92% (1.4798 => 1.8633, std.dev.: 0.0084)
  MultiSource/Applications/minisat/minisat: 16.27% (6.3321 => 7.3626, std.dev.: 0.3562)
  SingleSource/Benchmarks/Shootout/ary3: 14.29% (4.5753 => 5.2290, std.dev.: 0.0939)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.33% (14.0954 => 15.4110, std.dev.: 0.3823)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.97% (1.3777 => 1.5013, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 8.01% (0.3645 => 0.3937, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.03% (3.9494 => 4.2272, std.dev.: 0.0456)
  MultiSource/Benchmarks/Bullet/bullet: 5.21% (7.0210 => 7.3870, std.dev.: 0.1226)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.01% (4.1008 => 4.3064, std.dev.: 0.0085)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.46% (1.2576 => 1.3137, std.dev.: 0.0178)
  SingleSource/Benchmarks/Misc/flops: 3.72% (9.2702 => 9.6147, std.dev.: 0.0272)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.09% (60.8424 => 62.7237, std.dev.: 0.1102)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.16% (5.0909 => 5.2010, std.dev.: 0.0173)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (3.7363 => 3.8169, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.10% (4.0443 => 4.1291, std.dev.: 0.0244)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.07% (3.4830 => 3.5551, std.dev.: 0.0168)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.03% (1.4679 => 1.4977, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/oourafft: 1.13% (3.6615 => 3.7028, std.dev.: 0.0113)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.75% (5.1401 => 5.0504, std.dev.: 0.0263)
  SingleSource/Benchmarks/Shootout/lists: -1.69% (7.2387 => 7.1161, std.dev.: 0.0140)
  MultiSource/Applications/hexxagon/hexxagon: -1.30% (15.1660 => 14.9687, std.dev.: 0.0393)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.27% (5.9769 => 5.9009, std.dev.: 0.0073)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-31-CastToBool: 60.31% (0.0262 => 0.0420, std.dev.: 0.0017)
  SingleSource/Benchmarks/Stanford/Quicksort: 55.39% (0.0408 => 0.0634, std.dev.: 0.0042)
  SingleSource/Benchmarks/Stanford/RealMM: 55.14% (0.0457 => 0.0709, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout/methcall: 47.47% (0.0356 => 0.0525, std.dev.: 0.0053)
  MultiSource/Applications/sqlite3/sqlite3: 39.56% (15.7419 => 21.9693, std.dev.: 1.2484)
  MultiSource/Benchmarks/MallocBench/gs/gs: 32.62% (4.6860 => 6.2145, std.dev.: 0.3826)
  MultiSource/Applications/SIBsim4/SIBsim4: 17.45% (1.5198 => 1.7850, std.dev.: 0.0135)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.19% (5.5433 => 6.4961, std.dev.: 0.2545)
  MultiSource/Applications/lua/lua: 16.93% (4.2737 => 4.9973, std.dev.: 0.2308)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.69% (44.9186 => 51.9684, std.dev.: 2.1190)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.20% (25.9661 => 29.1336, std.dev.: 0.4591)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.92% (0.6412 => 0.6856, std.dev.: 0.0164)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Bubblesort: 42.28% (0.0272 => 0.0387, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 39.10% (2.9945 => 4.1652, std.dev.: 0.1782)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.00% (4.5769 => 6.0413, std.dev.: 0.0444)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 27.78% (1.4716 => 1.8804, std.dev.: 0.1289)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.94% (1.4795 => 1.8633, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.81% (5.9583 => 6.9598, std.dev.: 0.0280)
  MultiSource/Applications/minisat/minisat: 15.25% (6.3881 => 7.3626, std.dev.: 0.3562)
  SingleSource/Benchmarks/Shootout/ary3: 13.73% (4.5977 => 5.2290, std.dev.: 0.0939)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.49% (1.3838 => 1.5013, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.15% (3.3810 => 3.6565, std.dev.: 0.0762)
  SingleSource/Benchmarks/Shootout/strcat: 7.76% (0.1417 => 0.1527, std.dev.: 0.0028)
  MultiSource/Applications/lua/lua: 6.65% (29.1357 => 31.0726, std.dev.: 0.7474)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.65% (4.0012 => 4.2272, std.dev.: 0.0456)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.63% (1.2556 => 1.3137, std.dev.: 0.0178)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.43% (3.4043 => 3.5551, std.dev.: 0.0168)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.25% (1.4366 => 1.4977, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.86% (4.1462 => 4.3064, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc/flops: 3.75% (9.2673 => 9.6147, std.dev.: 0.0272)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.01% (5.9126 => 6.0908, std.dev.: 0.0598)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.69% (61.0792 => 62.7237, std.dev.: 0.1102)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.29% (3.7315 => 3.8169, std.dev.: 0.0086)
  SingleSource/Benchmarks/Shootout/lists: 1.76% (6.9930 => 7.1161, std.dev.: 0.0140)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.72% (4.0593 => 4.1291, std.dev.: 0.0244)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (2.4894 => 2.5272, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/oourafft: 1.44% (3.6501 => 3.7028, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.44% (11.7894 => 11.9593, std.dev.: 0.0273)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.45% (0.0688 => 0.0506, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.49% (1.1409 => 1.0897, std.dev.: 0.0139)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.93% (0.2824 => 0.2713, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.18% (1.5305 => 1.4818, std.dev.: 0.0099)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.21% (5.9456 => 5.5766, std.dev.: 0.1357)
  MultiSource/Benchmarks/sim/sim: -4.21% (4.0134 => 3.8446, std.dev.: 0.0197)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.01% (5.4994 => 5.4441, std.dev.: 0.0193)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131228/dafc63fc/attachment.html>


More information about the llvm-testresults mailing list