[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Nov 2 07:40:12 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16932?compare_to=16929&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16932, Order: 193924, Start Time: 2013-11-02 12:55:25, End Time: 2013-11-02 14:43:42
      To: 16929, Order: 193918, Start Time: 2013-11-02 10:28:40, End Time: 2013-11-02 12:27:40
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 21 (36 on baseline)
Performance Improvements: 35 (19 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1051 (1052 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.0358 => 1.0538, std.dev.: 0.0068)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops: 19.32% (7.7713 => 9.2728, std.dev.: 0.1673)
  SingleSource/Benchmarks/Shootout/sieve: 18.75% (6.8469 => 8.1310, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.53% (3.2252 => 3.5325, std.dev.: 0.0138)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.54% (4.9741 => 5.3492, std.dev.: 0.0658)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.90% (5.8724 => 6.2187, std.dev.: 0.0150)
  MultiSource/Benchmarks/sim/sim: 5.06% (3.8693 => 4.0651, std.dev.: 0.0057)
  MultiSource/Applications/obsequi/Obsequi: 3.98% (2.2454 => 2.3348, std.dev.: 0.0198)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.89% (1.2493 => 1.2979, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.55% (5.7925 => 5.9981, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.39% (6.7105 => 6.9383, std.dev.: 0.0770)
  SingleSource/Benchmarks/Shootout/lists: 3.19% (7.2781 => 7.5102, std.dev.: 0.0096)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.10% (0.7127 => 0.7348, std.dev.: 0.0009)
  MultiSource/Applications/viterbi/viterbi: 2.12% (2.6249 => 2.6805, std.dev.: 0.0183)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.58% (1.3315 => 1.3526, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/ffbench: 1.54% (1.3820 => 1.4033, std.dev.: 0.0054)
  MultiSource/Applications/lua/lua: 1.54% (29.2904 => 29.7417, std.dev.: 0.1680)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.46% (3.5350 => 3.5865, std.dev.: 0.0090)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.38% (4.5037 => 4.5659, std.dev.: 0.0217)
  SingleSource/Benchmarks/Shootout/methcall: 1.36% (8.4981 => 8.6133, std.dev.: 0.0367)
  MultiSource/Applications/spiff/spiff: 1.06% (2.9508 => 2.9820, std.dev.: 0.0070)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -49.28% (0.1043 => 0.0529, std.dev.: 0.0088)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -39.82% (0.1700 => 0.1023, std.dev.: 0.0218)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -38.67% (0.0799 => 0.0490, std.dev.: 0.0029)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -35.47% (0.0764 => 0.0493, std.dev.: 0.0095)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -35.43% (0.8972 => 0.5793, std.dev.: 0.0498)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -32.95% (0.1205 => 0.0808, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -31.47% (1.9842 => 1.3597, std.dev.: 0.1598)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -31.30% (2.0142 => 1.3838, std.dev.: 0.0060)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -29.30% (0.1737 => 0.1228, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -28.72% (1.7447 => 1.2437, std.dev.: 0.0963)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -28.52% (0.0526 => 0.0376, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -28.21% (1.8369 => 1.3187, std.dev.: 0.1556)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -27.56% (1.8638 => 1.3501, std.dev.: 0.0115)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -25.94% (0.2992 => 0.2216, std.dev.: 0.0068)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -25.04% (0.0683 => 0.0512, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -21.98% (1.5924 => 1.2424, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -21.87% (1.6765 => 1.3098, std.dev.: 0.0600)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -20.20% (1.6244 => 1.2963, std.dev.: 0.0135)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.83% (0.1307 => 0.1074, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (1.3604 => 1.2815, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.55% (1.3325 => 1.2852, std.dev.: 0.0089)
  MultiSource/Applications/treecc/treecc: -1.14% (2.3033 => 2.2771, std.dev.: 0.0100)
  MultiSource/Applications/spiff/spiff: -1.14% (0.9151 => 0.9047, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.37% (14.5142 => 12.7193, std.dev.: 0.4169)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -8.03% (4.4593 => 4.1013, std.dev.: 0.1052)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.38% (3.3795 => 3.1976, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -4.57% (0.7521 => 0.7177, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.39% (5.3053 => 5.1255, std.dev.: 0.0599)
  SingleSource/Benchmarks/Misc/oourafft: -3.32% (3.7879 => 3.6621, std.dev.: 0.0376)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.06% (2.7994 => 2.7138, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.23% (4.6774 => 4.5729, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.06% (3.1870 => 3.1214, std.dev.: 0.0230)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.86% (6.8601 => 6.7327, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.73% (5.1998 => 5.1099, std.dev.: 0.0210)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.00% (3.6910 => 3.6540, std.dev.: 0.0131)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.73% (0.1365 => 0.1355, std.dev.: 0.0010)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/oourafft: 11.20% (0.2294 => 0.2551, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.54% (1.3365 => 1.3838, std.dev.: 0.0060)
  MultiSource/Applications/oggenc/oggenc: 3.20% (5.3339 => 5.5045, std.dev.: 0.0110)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.18% (0.8014 => 0.8269, std.dev.: 0.0086)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.95% (0.5185 => 0.5338, std.dev.: 0.0051)
  MultiSource/Applications/lemon/lemon: 2.64% (1.1862 => 1.2175, std.dev.: 0.0121)
  MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.0276 => 1.0538, std.dev.: 0.0068)
  MultiSource/Applications/d/make_dparser: 1.58% (3.4962 => 3.5514, std.dev.: 0.0167)
  MultiSource/Applications/spiff/spiff: 1.53% (0.8911 => 0.9047, std.dev.: 0.0020)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.46% (7.6426 => 12.3401, std.dev.: 0.0265)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 55.59% (4.4696 => 6.9543, std.dev.: 0.2396)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 46.70% (4.2391 => 6.2187, std.dev.: 0.0150)
  SingleSource/Benchmarks/Shootout-C++/matrix: 45.95% (2.8554 => 4.1675, std.dev.: 0.0561)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 31.92% (1.1431 => 1.5080, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout/sieve: 12.53% (7.2254 => 8.1310, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.22% (4.9428 => 5.3492, std.dev.: 0.0658)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.07% (1.2516 => 1.3526, std.dev.: 0.0024)
  MultiSource/Applications/oggenc/oggenc: 7.53% (0.1699 => 0.1827, std.dev.: 0.0000)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.98% (2.5368 => 2.7138, std.dev.: 0.0125)
  MultiSource/Applications/obsequi/Obsequi: 6.69% (2.1884 => 2.3348, std.dev.: 0.0198)
  SingleSource/UnitTests/Vector/multiplies: 6.58% (0.5561 => 0.5927, std.dev.: 0.0114)
  MultiSource/Benchmarks/sim/sim: 6.11% (3.8312 => 4.0651, std.dev.: 0.0057)
  MultiSource/Applications/spiff/spiff: 5.77% (2.8194 => 2.9820, std.dev.: 0.0070)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.64% (5.3716 => 5.6743, std.dev.: 0.0293)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (3.1730 => 3.3488, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.14% (6.5990 => 6.9383, std.dev.: 0.0770)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.85% (5.7757 => 5.9981, std.dev.: 0.0064)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.13% (89.7126 => 92.5231, std.dev.: 0.4687)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.40% (5.4925 => 5.6245, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.09% (1.0477 => 1.0696, std.dev.: 0.0029)
  SingleSource/Regression/C/uint64_to_float: 1.99% (1.4528 => 1.4817, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/lists: 1.90% (7.3703 => 7.5102, std.dev.: 0.0096)
  SingleSource/Benchmarks/Shootout/fib2: 1.65% (3.5966 => 3.6559, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.59% (11.7654 => 11.9524, std.dev.: 0.0633)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.50% (3.1569 => 3.2042, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (6.1088 => 6.1797, std.dev.: 0.0024)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: -14.74% (0.1194 => 0.1018, std.dev.: 0.0019)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.96% (0.1195 => 0.1076, std.dev.: 0.0017)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.69% (0.5226 => 0.2368, std.dev.: 0.0284)
  MultiSource/Applications/sgefa/sgefa: -42.97% (1.5790 => 0.9005, std.dev.: 0.0063)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.26% (15.9508 => 12.7193, std.dev.: 0.4169)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.01% (0.3304 => 0.2709, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/ary3: -16.13% (5.0002 => 4.1939, std.dev.: 0.0790)
  SingleSource/Benchmarks/Shootout-C++/moments: -15.72% (0.1285 => 0.1083, std.dev.: 0.0057)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.91% (57.2347 => 48.6997, std.dev.: 0.7917)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -13.99% (20.8247 => 17.9107, std.dev.: 0.2846)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -12.09% (4.0181 => 3.5325, std.dev.: 0.0138)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.70% (3.4956 => 3.1214, std.dev.: 0.0230)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.37% (8.1346 => 7.6164, std.dev.: 0.0253)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.52% (3.7874 => 3.6540, std.dev.: 0.0131)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.44% (4.3592 => 4.2093, std.dev.: 0.0314)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.05% (2.5938 => 2.5146, std.dev.: 0.0087)
  MultiSource/Benchmarks/Olden/power/power: -2.70% (1.2170 => 1.1841, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.19% (17.1431 => 16.7669, std.dev.: 0.0454)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.69% (0.7474 => 0.7348, std.dev.: 0.0009)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.52% (0.1348 => 0.1355, std.dev.: 0.0010)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131102/bbe30eac/attachment.html>


More information about the llvm-testresults mailing list