[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jan 6 21:58:47 PST 2014


http://llvm.org/perf/db_default/v4/nts/19897?compare_to=19891&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19897, Order: 198671, Start Time: 2014-01-07 04:17:08, End Time: 2014-01-07 06:03:29
      To: 19891, Order: 198654, Start Time: 2014-01-07 01:50:57, End Time: 2014-01-07 03:51:12
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 17 (24 on baseline)
Performance Improvements: 15 (49 on baseline)
Unchanged Tests: 1078 (1037 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.63% (1.2609 => 1.2815, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.61% (1.2650 => 1.2854, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.43% (1.3277 => 1.3467, std.dev.: 0.0027)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (10.1212 => 10.2552, std.dev.: 0.0262)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 32.50% (0.1483 => 0.1965, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.56% (3.5797 => 3.8502, std.dev.: 0.0071)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.28% (1.2674 => 1.3470, std.dev.: 0.0012)
  MultiSource/Benchmarks/mafft/pairlocalalign: 5.69% (48.0784 => 50.8118, std.dev.: 0.8378)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.37% (2.8985 => 3.0541, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.71% (0.4181 => 0.4378, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.16% (5.0428 => 5.2526, std.dev.: 0.0164)
  MultiSource/Applications/sgefa/sgefa: 4.04% (0.8746 => 0.9099, std.dev.: 0.0030)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 2.99% (9.2838 => 9.5610, std.dev.: 0.0849)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.07% (3.1490 => 3.2141, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.92% (1.6015 => 1.6323, std.dev.: 0.0088)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.41% (2.3839 => 2.4175, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.37% (5.5471 => 5.6229, std.dev.: 0.0010)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/dt: -25.53% (0.0427 => 0.0318, std.dev.: 0.0024)
  MultiSource/Benchmarks/McCat/15-trie/trie: -15.62% (0.0794 => 0.0670, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.26% (1.3268 => 1.2835, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.18% (1.2412 => 1.2141, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.98% (1.3853 => 1.3579, std.dev.: 0.0013)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.88% (2.5844 => 2.5357, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.84% (1.3393 => 1.3146, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.82% (1.4753 => 1.4484, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.67% (1.3317 => 1.3094, std.dev.: 0.0015)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (7.4384 => 7.3505, std.dev.: 0.0233)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: -31.55% (6.2736 => 4.2942, std.dev.: 0.3869)
  MultiSource/Benchmarks/nbench/nbench: -16.47% (25.4761 => 21.2806, std.dev.: 1.2239)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.41% (7.0410 => 6.5192, std.dev.: 0.1913)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.70% (0.3325 => 0.3202, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.39% (4.5530 => 4.4443, std.dev.: 0.0216)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 40.54% (15.7419 => 22.1238, std.dev.: 0.7911)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 28.04% (0.3859 => 0.4941, std.dev.: 0.0367)
  MultiSource/Applications/lemon/lemon: 10.24% (1.2200 => 1.3449, std.dev.: 0.0422)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.71% (25.9661 => 27.7075, std.dev.: 0.1322)
  MultiSource/Applications/oggenc/oggenc: 3.67% (5.4968 => 5.6987, std.dev.: 0.0453)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.04% (1.2845 => 1.2978, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.17% (5.9583 => 6.9219, std.dev.: 0.1461)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.34% (82.2592 => 92.4095, std.dev.: 0.3531)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.30% (3.3810 => 3.6955, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.63% (3.5771 => 3.8502, std.dev.: 0.0071)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2556 => 1.3470, std.dev.: 0.0012)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.91% (2.8568 => 3.0541, std.dev.: 0.0019)
  MultiSource/Applications/siod/siod: 5.09% (3.4258 => 3.6001, std.dev.: 0.0430)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.99% (0.6939 => 0.7285, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout/lists: 4.21% (6.9930 => 7.2874, std.dev.: 0.0915)
  MultiSource/Applications/sgefa/sgefa: 4.05% (0.8745 => 0.9099, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.80% (5.0601 => 5.2526, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.18% (5.5032 => 5.6229, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.11% (1.5986 => 1.6323, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.88% (3.1547 => 3.2141, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.79% (2.5025 => 2.5473, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.63% (11.7894 => 11.9812, std.dev.: 0.0562)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.23% (2.3882 => 2.4175, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.11% (4.9365 => 4.9914, std.dev.: 0.0001)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -27.62% (0.0688 => 0.0498, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.81% (0.1938 => 0.1651, std.dev.: 0.0012)
  MultiSource/Benchmarks/Bullet/bullet: -8.96% (36.6274 => 33.3460, std.dev.: 0.0104)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.98% (0.3247 => 0.2988, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.88% (0.3402 => 0.3168, std.dev.: 0.0024)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.73% (0.2824 => 0.2634, std.dev.: 0.0036)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -6.55% (1.0197 => 0.9529, std.dev.: 0.0154)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.19% (0.6882 => 0.6456, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.01% (1.3676 => 1.2854, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.42% (2.0207 => 1.9112, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.41% (1.3505 => 1.2775, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.36% (1.5305 => 1.4484, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.33% (1.2824 => 1.2141, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.25% (1.3819 => 1.3094, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.95% (1.4277 => 1.3570, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.81% (1.3146 => 1.2514, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.80% (1.4113 => 1.3435, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.77% (0.2810 => 0.2676, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.65% (1.2544 => 1.1961, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.64% (1.3460 => 1.2835, std.dev.: 0.0105)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.22% (1.1409 => 1.0927, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.14% (1.3127 => 1.2583, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.14% (1.3660 => 1.3094, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.10% (1.2914 => 1.2385, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.01% (1.3157 => 1.2630, std.dev.: 0.0020)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.99% (0.2758 => 0.2648, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.88% (15.4053 => 14.8081, std.dev.: 0.0847)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.87% (1.4125 => 1.3579, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.84% (1.2583 => 1.2100, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.51% (1.2724 => 1.2277, std.dev.: 0.0007)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.51% (0.2906 => 0.2804, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.39% (1.3264 => 1.2815, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.36% (1.2785 => 1.2356, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.24% (1.3918 => 1.3467, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.99% (1.3551 => 1.3146, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.86% (1.3024 => 1.2652, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.83% (1.2952 => 1.2586, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.61% (1.3702 => 1.3345, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.16% (7.5124 => 7.3505, std.dev.: 0.0233)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.89% (1.2670 => 1.2431, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.75% (1.3068 => 1.2839, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.51% (4.7807 => 4.7084, std.dev.: 0.0083)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.61% (15.5356 => 12.6450, std.dev.: 0.2773)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.53% (2.8850 => 2.3794, std.dev.: 0.0170)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.91% (2.5559 => 2.3792, std.dev.: 0.0522)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.33% (5.9456 => 5.6287, std.dev.: 0.1083)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -4.60% (10.0217 => 9.5610, std.dev.: 0.0849)
  MultiSource/Benchmarks/Bullet/bullet: -4.08% (7.4226 => 7.1197, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.29% (3.5813 => 3.5351, std.dev.: 0.0120)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140106/77f8ebf2/attachment.html>


More information about the llvm-testresults mailing list