[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 6 18:49:18 PST 2013


http://llvm.org/perf/db_default/v4/nts/18083?compare_to=18079&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18083, Order: 196627, Start Time: 2013-12-07 01:06:40, End Time: 2013-12-07 02:53:26
      To: 18079, Order: 196615, Start Time: 2013-12-06 22:54:16, End Time: 2013-12-07 00:41:30
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 36 (33 on baseline)
Performance Improvements: 12 (12 on baseline)
Unchanged Tests: 1062 (1065 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 87.62% (0.0202 => 0.0379, std.dev.: 0.0004)
  SingleSource/Regression/C++/EH/exception_spec_test: 75.80% (0.0343 => 0.0603, std.dev.: 0.0021)
  SingleSource/Regression/C/2004-02-03-AggregateCopy: 74.48% (0.0145 => 0.0253, std.dev.: 0.0011)
  SingleSource/Regression/C++/EH/simple_throw: 72.09% (0.0172 => 0.0296, std.dev.: 0.0022)
  SingleSource/Regression/C++/pointer_method: 66.00% (0.0200 => 0.0332, std.dev.: 0.0019)
  SingleSource/Regression/C++/EH/recursive-throw: 54.51% (0.0255 => 0.0394, std.dev.: 0.0027)
  SingleSource/Regression/C++/EH/ConditionalExpr: 54.20% (0.0238 => 0.0367, std.dev.: 0.0036)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 46.59% (0.2275 => 0.3335, std.dev.: 0.0307)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 42.25% (0.5777 => 0.8218, std.dev.: 0.0618)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 26.60% (0.3572 => 0.4522, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 6.89% (1.3269 => 1.4183, std.dev.: 0.0085)
  MultiSource/Applications/siod/siod: 6.82% (2.5216 => 2.6935, std.dev.: 0.0417)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.2486 => 0.2614, std.dev.: 0.0020)
  MultiSource/Benchmarks/Bullet/bullet: 4.13% (32.9340 => 34.2954, std.dev.: 0.2776)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.91% (1.2198 => 1.2675, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 84.92% (0.0126 => 0.0233, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 49.19% (2.8411 => 4.2387, std.dev.: 0.1070)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 43.10% (1.4764 => 2.1128, std.dev.: 0.0318)
  MultiSource/Applications/SPASS/SPASS: 18.81% (8.3052 => 9.8670, std.dev.: 0.1386)
  SingleSource/Benchmarks/Shootout-C++/moments: 16.80% (0.1101 => 0.1286, std.dev.: 0.0046)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 15.71% (4.0562 => 4.6935, std.dev.: 0.0902)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.00% (2.4131 => 2.7750, std.dev.: 0.1345)
  SingleSource/Benchmarks/Shootout-C++/ary3: 11.52% (4.7385 => 5.2846, std.dev.: 0.0558)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 8.01% (3.9966 => 4.3168, std.dev.: 0.0137)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.74% (0.4326 => 0.4661, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.65% (6.2561 => 6.7346, std.dev.: 0.0357)
  SingleSource/Benchmarks/McGill/misr: 5.65% (0.3860 => 0.4078, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.88% (3.9870 => 4.1816, std.dev.: 0.0430)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.89% (4.1443 => 4.3054, std.dev.: 0.0089)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.39% (0.6281 => 0.6494, std.dev.: 0.0008)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.83% (1.6481 => 1.6948, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.37% (3.9852 => 4.0795, std.dev.: 0.0071)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.09% (97.1506 => 99.1828, std.dev.: 0.3873)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.71% (5.8986 => 5.9994, std.dev.: 0.0137)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (2.4864 => 2.5269, std.dev.: 0.0110)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.18% (21.5603 => 21.8150, std.dev.: 0.0107)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -15.91% (5.5996 => 4.7087, std.dev.: 0.0156)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -9.64% (6.1265 => 5.5362, std.dev.: 0.0270)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -8.61% (0.2914 => 0.2663, std.dev.: 0.0073)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.96% (0.2915 => 0.2712, std.dev.: 0.0070)
  MultiSource/Applications/kimwitu++/kc: -4.85% (19.4772 => 18.5326, std.dev.: 0.2229)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.16% (0.9846 => 0.9436, std.dev.: 0.0119)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.76% (5.2482 => 5.1036, std.dev.: 0.0284)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -26.98% (0.5971 => 0.4360, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.63% (3.5369 => 3.3733, std.dev.: 0.0587)
  SingleSource/Benchmarks/Shootout/lists: -1.88% (7.2503 => 7.1137, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.61% (5.3976 => 5.3106, std.dev.: 0.0337)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.29% (4.9927 => 4.9285, std.dev.: 0.0147)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 85.78% (0.0204 => 0.0379, std.dev.: 0.0004)
  SingleSource/Regression/C/2004-02-03-AggregateCopy: 73.29% (0.0146 => 0.0253, std.dev.: 0.0011)
  SingleSource/Regression/C++/EH/exception_spec_test: 73.28% (0.0348 => 0.0603, std.dev.: 0.0021)
  SingleSource/Regression/C++/EH/simple_throw: 72.09% (0.0172 => 0.0296, std.dev.: 0.0022)
  SingleSource/Regression/C++/EH/ConditionalExpr: 60.26% (0.0229 => 0.0367, std.dev.: 0.0036)
  SingleSource/Regression/C++/pointer_method: 56.60% (0.0212 => 0.0332, std.dev.: 0.0019)
  SingleSource/Regression/C++/EH/recursive-throw: 52.71% (0.0258 => 0.0394, std.dev.: 0.0027)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 48.09% (0.2252 => 0.3335, std.dev.: 0.0307)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 39.79% (0.5879 => 0.8218, std.dev.: 0.0618)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 26.24% (0.3582 => 0.4522, std.dev.: 0.0262)
  MultiSource/Applications/siod/siod: 5.66% (2.5491 => 2.6935, std.dev.: 0.0417)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.32% (0.2482 => 0.2614, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.58% (1.2356 => 1.2675, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 140.21% (0.0097 => 0.0233, std.dev.: 0.0009)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 43.57% (1.4716 => 2.1128, std.dev.: 0.0318)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 41.55% (2.9945 => 4.2387, std.dev.: 0.1070)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 15.70% (4.0567 => 4.6935, std.dev.: 0.0902)
  MultiSource/Applications/SPASS/SPASS: 15.59% (8.5363 => 9.8670, std.dev.: 0.1386)
  SingleSource/Benchmarks/Shootout-C++/moments: 15.23% (0.1116 => 0.1286, std.dev.: 0.0046)
  SingleSource/Benchmarks/Shootout-C++/ary3: 12.93% (4.6797 => 5.2846, std.dev.: 0.0558)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 11.02% (3.8883 => 4.3168, std.dev.: 0.0137)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.40% (1.2278 => 1.2941, std.dev.: 0.0088)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.51% (4.0012 => 4.1816, std.dev.: 0.0430)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.47% (4.5883 => 4.7935, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.84% (4.1462 => 4.3054, std.dev.: 0.0089)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.72% (0.6261 => 0.6494, std.dev.: 0.0008)
  MultiSource/Benchmarks/FreeBench/neural/neural: 3.32% (0.4220 => 0.4360, std.dev.: 0.0044)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.98% (0.4526 => 0.4661, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.62% (3.9755 => 4.0795, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.80% (5.8933 => 5.9994, std.dev.: 0.0137)
  SingleSource/Benchmarks/Shootout/lists: 1.73% (6.9930 => 7.1137, std.dev.: 0.0227)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.49% (1.6699 => 1.6948, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.01% (21.5962 => 21.8150, std.dev.: 0.0107)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -12.07% (0.1938 => 0.1704, std.dev.: 0.0048)
  MultiSource/Benchmarks/Bullet/bullet: -6.37% (36.6274 => 34.2954, std.dev.: 0.2776)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.99% (1.3819 => 1.3130, std.dev.: 0.0261)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.96% (1.4113 => 1.3413, std.dev.: 0.0226)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.64% (1.1409 => 1.0880, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.55% (1.3676 => 1.3190, std.dev.: 0.0153)
  MultiSource/Applications/obsequi/Obsequi: -3.05% (1.1905 => 1.1542, std.dev.: 0.0092)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3714 => 0.3602, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (1.3264 => 1.2890, std.dev.: 0.0141)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.90% (6.0535 => 5.8777, std.dev.: 0.0311)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.15% (6.8826 => 6.7346, std.dev.: 0.0357)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (7.9597 => 7.8365, std.dev.: 0.0367)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131206/271df262/attachment.html>


More information about the llvm-testresults mailing list