[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 5 14:32:27 PST 2013


http://llvm.org/perf/db_default/v4/nts/18026?compare_to=18020&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18026, Order: 196528, Start Time: 2013-12-05 20:45:10, End Time: 2013-12-05 22:36:35
      To: 18020, Order: 196511, Start Time: 2013-12-05 18:23:02, End Time: 2013-12-05 20:09:34
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 46 (44 on baseline)
Performance Improvements: 3 (4 on baseline)
Unchanged Tests: 1061 (1062 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/DuffsDevice: 81.75% (0.0252 => 0.0458, std.dev.: 0.0009)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 80.00% (0.0195 => 0.0351, std.dev.: 0.0021)
  SingleSource/Regression/C++/EH/inlined_cleanup: 73.40% (0.0188 => 0.0326, std.dev.: 0.0010)
  SingleSource/Regression/C++/EH/simple_throw: 69.54% (0.0174 => 0.0295, std.dev.: 0.0019)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 66.47% (0.0167 => 0.0278, std.dev.: 0.0015)
  SingleSource/UnitTests/2005-05-12-Int64ToFP: 66.26% (0.0163 => 0.0271, std.dev.: 0.0017)
  SingleSource/UnitTests/byval-alignment: 57.39% (0.0176 => 0.0277, std.dev.: 0.0005)
  SingleSource/UnitTests/SignlessTypes/cast2: 57.30% (0.0178 => 0.0280, std.dev.: 0.0022)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 56.23% (0.0795 => 0.1242, std.dev.: 0.0076)
  SingleSource/Regression/C/testtrace: 55.97% (0.0243 => 0.0379, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/tsp/tsp: 54.55% (0.1406 => 0.2173, std.dev.: 0.0090)
  SingleSource/Regression/C++/pointer_method: 53.23% (0.0201 => 0.0308, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 51.81% (0.0940 => 0.1427, std.dev.: 0.0106)
  SingleSource/Regression/C/compare: 48.02% (0.0227 => 0.0336, std.dev.: 0.0015)
  SingleSource/Regression/C++/global_ctor: 48.00% (0.0250 => 0.0370, std.dev.: 0.0042)
  SingleSource/Regression/C/sumarray2d: 47.20% (0.0322 => 0.0474, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 34.45% (0.7372 => 0.9912, std.dev.: 0.0908)
  MultiSource/Benchmarks/McCat/05-eks/eks: 30.37% (0.5302 => 0.6912, std.dev.: 0.0591)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.10% (1.7290 => 2.2148, std.dev.: 0.0432)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.18% (1.3984 => 1.6946, std.dev.: 0.0483)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.67% (0.0948 => 0.1125, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/mst/mst: 18.53% (0.1705 => 0.2021, std.dev.: 0.0102)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.06% (1.8970 => 2.2396, std.dev.: 0.1312)
  MultiSource/Applications/ClamAV/clamscan: 14.82% (17.4974 => 20.0907, std.dev.: 0.3976)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.47% (44.2253 => 48.4143, std.dev.: 1.3944)
  MultiSource/Applications/minisat/minisat: 7.55% (0.8028 => 0.8634, std.dev.: 0.0196)
  MultiSource/Applications/JM/lencod/lencod: 7.31% (18.0648 => 19.3851, std.dev.: 0.1983)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.97% (1.2276 => 1.3132, std.dev.: 0.0187)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.64% (4.2807 => 4.5648, std.dev.: 0.0397)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.18% (1.9831 => 2.0858, std.dev.: 0.0247)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.63% (1.2731 => 1.3320, std.dev.: 0.0217)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.07% (0.2824 => 0.2939, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 62.22% (2.8620 => 4.6427, std.dev.: 0.0389)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 57.01% (0.0221 => 0.0347, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/bisort/bisort: 33.59% (0.6866 => 0.9172, std.dev.: 0.0621)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 26.11% (0.0858 => 0.1082, std.dev.: 0.0079)
  MultiSource/Applications/SPASS/SPASS: 22.00% (8.4612 => 10.3226, std.dev.: 0.5403)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.77% (1.2555 => 1.4410, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc/salsa20: 6.99% (7.5989 => 8.1304, std.dev.: 0.0386)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.71% (4.1007 => 4.2939, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.48% (4.5713 => 4.7762, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/random: 3.71% (2.3824 => 2.4707, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.28% (6.5457 => 6.7603, std.dev.: 0.0677)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.77% (4.0676 => 4.1803, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.06% (5.0921 => 5.1972, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.29% (3.1713 => 3.2123, std.dev.: 0.0078)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.50% (1.3545 => 1.2529, std.dev.: 0.0158)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.82% (8.9708 => 8.5380, std.dev.: 0.0937)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -3.52% (0.4969 => 0.4794, std.dev.: 0.0054)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/ctor_dtor_count: 79.08% (0.0196 => 0.0351, std.dev.: 0.0021)
  SingleSource/Regression/C++/EH/simple_throw: 71.51% (0.0172 => 0.0295, std.dev.: 0.0019)
  SingleSource/Regression/C/DuffsDevice: 67.77% (0.0273 => 0.0458, std.dev.: 0.0009)
  SingleSource/UnitTests/2005-05-12-Int64ToFP: 66.26% (0.0163 => 0.0271, std.dev.: 0.0017)
  SingleSource/Regression/C++/EH/inlined_cleanup: 62.19% (0.0201 => 0.0326, std.dev.: 0.0010)
  SingleSource/Regression/C++/global_ctor: 59.48% (0.0232 => 0.0370, std.dev.: 0.0042)
  SingleSource/UnitTests/SignlessTypes/cast2: 58.19% (0.0177 => 0.0280, std.dev.: 0.0022)
  MultiSource/Benchmarks/Olden/tsp/tsp: 57.58% (0.1379 => 0.2173, std.dev.: 0.0090)
  SingleSource/Regression/C/testtrace: 54.07% (0.0246 => 0.0379, std.dev.: 0.0045)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 53.52% (0.0809 => 0.1242, std.dev.: 0.0076)
  SingleSource/Regression/C++/BuiltinTypeInfo: 50.00% (0.0206 => 0.0309, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 49.74% (0.0953 => 0.1427, std.dev.: 0.0106)
  SingleSource/Regression/C/sumarray2d: 48.12% (0.0320 => 0.0474, std.dev.: 0.0036)
  SingleSource/Regression/C/compare: 48.02% (0.0227 => 0.0336, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/mst/mst: 47.63% (0.1369 => 0.2021, std.dev.: 0.0102)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 34.40% (0.7375 => 0.9912, std.dev.: 0.0908)
  MultiSource/Benchmarks/McCat/05-eks/eks: 29.88% (0.5322 => 0.6912, std.dev.: 0.0591)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 29.87% (1.7054 => 2.2148, std.dev.: 0.0432)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 21.49% (0.0926 => 0.1125, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/power/power: 21.12% (0.1406 => 0.1703, std.dev.: 0.0029)
  MultiSource/Applications/ClamAV/clamscan: 18.42% (16.9661 => 20.0907, std.dev.: 0.3976)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.28% (1.4449 => 1.6946, std.dev.: 0.0483)
  MultiSource/Applications/minisat/minisat: 14.62% (0.7533 => 0.8634, std.dev.: 0.0196)
  MultiSource/Applications/JM/lencod/lencod: 12.07% (17.2968 => 19.3851, std.dev.: 0.1983)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (4.2717 => 4.5648, std.dev.: 0.0397)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.16% (1.9834 => 2.0858, std.dev.: 0.0247)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 93.38% (0.1345 => 0.2601, std.dev.: 0.0387)
  SingleSource/Benchmarks/Shootout/heapsort: 57.42% (2.9492 => 4.6427, std.dev.: 0.0389)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 47.03% (0.0236 => 0.0347, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/bisort/bisort: 36.24% (0.6732 => 0.9172, std.dev.: 0.0621)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 26.40% (0.0856 => 0.1082, std.dev.: 0.0079)
  MultiSource/Applications/minisat/minisat: 25.85% (6.3881 => 8.0393, std.dev.: 0.2564)
  MultiSource/Applications/SPASS/SPASS: 20.93% (8.5363 => 10.3226, std.dev.: 0.5403)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.36% (1.2278 => 1.4410, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc/salsa20: 7.05% (7.5947 => 8.1304, std.dev.: 0.0386)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.10% (4.5883 => 4.7762, std.dev.: 0.0088)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.04% (1.5425 => 1.6048, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.56% (4.1462 => 4.2939, std.dev.: 0.0166)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (4.0593 => 4.1803, std.dev.: 0.0068)
  MultiSource/Benchmarks/Olden/power/power: 2.28% (1.1796 => 1.2065, std.dev.: 0.0087)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.18% (15.5356 => 15.8738, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.70% (3.1585 => 3.2123, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.58% (5.9126 => 6.0058, std.dev.: 0.0266)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.54% (5.9583 => 6.0499, std.dev.: 0.0223)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except: -3.87% (0.4987 => 0.4794, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.44% (3.6583 => 3.5692, std.dev.: 0.0334)
  SingleSource/Benchmarks/Shootout/methcall: -1.94% (8.6669 => 8.4988, std.dev.: 0.0557)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.36% (7.9597 => 7.8516, std.dev.: 0.0235)

Report Time: 0.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131205/28ee24dd/attachment.html>


More information about the llvm-testresults mailing list