[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 10 16:04:15 PST 2013


http://llvm.org/perf/db_default/v4/nts/18262?compare_to=18259&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18262, Order: 196971, Start Time: 2013-12-10 22:19:12, End Time: 2013-12-11 00:08:27
      To: 18259, Order: 196950, Start Time: 2013-12-10 20:02:03, End Time: 2013-12-10 21:49:55
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 42 (46 on baseline)
Performance Improvements: 6 (13 on baseline)
Unchanged Tests: 1062 (1051 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 63.45% (0.0197 => 0.0322, std.dev.: 0.0030)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 62.75% (0.0255 => 0.0415, std.dev.: 0.0038)
  SingleSource/UnitTests/2003-05-14-AtExit: 54.63% (0.0216 => 0.0334, std.dev.: 0.0020)
  SingleSource/UnitTests/FloatPrecision: 54.36% (0.0195 => 0.0301, std.dev.: 0.0006)
  SingleSource/Regression/C/callargs: 53.96% (0.0202 => 0.0311, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 48.31% (0.0708 => 0.1050, std.dev.: 0.0093)
  SingleSource/Regression/C++/EH/recursive-throw: 45.73% (0.0293 => 0.0427, std.dev.: 0.0031)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 43.23% (0.1705 => 0.2442, std.dev.: 0.0048)
  SingleSource/Regression/C++/EH/function_try_block: 42.32% (0.0345 => 0.0491, std.dev.: 0.0053)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 39.45% (0.0256 => 0.0357, std.dev.: 0.0025)
  MultiSource/Applications/Burg/burg: 35.67% (1.4335 => 1.9448, std.dev.: 0.1157)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 34.84% (0.0310 => 0.0418, std.dev.: 0.0022)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 29.61% (0.2327 => 0.3016, std.dev.: 0.0116)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.34% (0.9728 => 1.2485, std.dev.: 0.0817)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.84% (4.9585 => 6.0413, std.dev.: 0.2103)
  MultiSource/Benchmarks/Olden/power/power: 18.27% (0.1396 => 0.1651, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.75% (0.6893 => 0.7910, std.dev.: 0.0310)
  MultiSource/Applications/SPASS/SPASS: 13.44% (16.5795 => 18.8072, std.dev.: 0.2079)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.25% (0.2934 => 0.3264, std.dev.: 0.0113)
  MultiSource/Applications/treecc/treecc: 10.76% (2.2970 => 2.5442, std.dev.: 0.0614)
  MultiSource/Benchmarks/McCat/09-vor/vor: 9.67% (0.3609 => 0.3958, std.dev.: 0.0069)
  MultiSource/Benchmarks/McCat/18-imp/imp: 9.42% (0.3917 => 0.4286, std.dev.: 0.0105)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.58% (4.8393 => 5.2060, std.dev.: 0.1330)
  MultiSource/Applications/d/make_dparser: 6.91% (3.5824 => 3.8300, std.dev.: 0.0717)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.19% (1.2971 => 1.3774, std.dev.: 0.0216)
  MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (10.3264 => 10.9430, std.dev.: 0.1593)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.64% (4.3044 => 4.4609, std.dev.: 0.0334)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.57% (1.2844 => 1.3303, std.dev.: 0.0119)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.08% (0.5189 => 0.5349, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.21% (1.2310 => 1.2582, std.dev.: 0.0015)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 53.08% (0.7655 => 1.1718, std.dev.: 0.0631)
  MultiSource/Benchmarks/Olden/bisort/bisort: 33.53% (0.7197 => 0.9610, std.dev.: 0.0281)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 23.34% (1.2994 => 1.6027, std.dev.: 0.1005)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.20% (2.4306 => 2.8487, std.dev.: 0.0462)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.71% (1.2966 => 1.4225, std.dev.: 0.0411)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.55% (0.8272 => 0.9062, std.dev.: 0.0272)
  MultiSource/Applications/sgefa/sgefa: 3.52% (0.8755 => 0.9063, std.dev.: 0.0056)
  MultiSource/Benchmarks/Bullet/bullet: 3.06% (7.1909 => 7.4110, std.dev.: 0.0198)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.52% (1.6848 => 1.7273, std.dev.: 0.0161)
  SingleSource/Benchmarks/Misc/ffbench: 1.85% (1.4026 => 1.4286, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.16% (6.6338 => 6.7109, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.13% (11.7357 => 11.8678, std.dev.: 0.0412)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -34.56% (0.1056 => 0.0691, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/simple: -34.12% (0.0340 => 0.0224, std.dev.: 0.0026)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -23.64% (0.1358 => 0.1037, std.dev.: 0.0110)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: -13.71% (4.3048 => 3.7147, std.dev.: 0.0820)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.35% (5.2695 => 5.0930, std.dev.: 0.0648)
  MultiSource/Applications/sqlite3/sqlite3: -1.28% (4.2770 => 4.2221, std.dev.: 0.0174)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-08-02-CastTest2: 93.58% (0.0109 => 0.0211, std.dev.: 0.0016)
  SingleSource/UnitTests/FloatPrecision: 85.80% (0.0162 => 0.0301, std.dev.: 0.0006)
  SingleSource/UnitTests/2006-02-04-DivRem: 82.08% (0.0173 => 0.0315, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 80.90% (0.0178 => 0.0322, std.dev.: 0.0030)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 79.27% (0.0193 => 0.0346, std.dev.: 0.0010)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 77.35% (0.0234 => 0.0415, std.dev.: 0.0038)
  SingleSource/Regression/C++/EH/recursive-throw: 65.50% (0.0258 => 0.0427, std.dev.: 0.0031)
  SingleSource/UnitTests/2003-05-14-AtExit: 63.73% (0.0204 => 0.0334, std.dev.: 0.0020)
  SingleSource/Regression/C/callargs: 61.14% (0.0193 => 0.0311, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 59.57% (0.0658 => 0.1050, std.dev.: 0.0093)
  SingleSource/UnitTests/2003-05-31-CastToBool: 59.16% (0.0262 => 0.0417, std.dev.: 0.0046)
  SingleSource/Regression/C++/EH/function_try_block: 54.89% (0.0317 => 0.0491, std.dev.: 0.0053)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 50.63% (0.0237 => 0.0357, std.dev.: 0.0025)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 46.15% (0.0286 => 0.0418, std.dev.: 0.0022)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 42.14% (0.1718 => 0.2442, std.dev.: 0.0048)
  MultiSource/Applications/Burg/burg: 36.33% (1.4265 => 1.9448, std.dev.: 0.1157)
  SingleSource/Regression/C/uint64_to_float: 35.32% (0.0402 => 0.0544, std.dev.: 0.0049)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 32.22% (0.2281 => 0.3016, std.dev.: 0.0116)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.44% (1.0197 => 1.2485, std.dev.: 0.0817)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.87% (5.0823 => 6.0413, std.dev.: 0.2103)
  MultiSource/Benchmarks/Olden/power/power: 17.43% (0.1406 => 0.1651, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.29% (0.2831 => 0.3264, std.dev.: 0.0113)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.08% (0.6995 => 0.7910, std.dev.: 0.0310)
  MultiSource/Applications/SPASS/SPASS: 12.50% (16.7177 => 18.8072, std.dev.: 0.2079)
  MultiSource/Applications/treecc/treecc: 11.68% (2.2781 => 2.5442, std.dev.: 0.0614)
  MultiSource/Benchmarks/McCat/09-vor/vor: 10.07% (0.3596 => 0.3958, std.dev.: 0.0069)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.90% (4.7807 => 5.2060, std.dev.: 0.1330)
  MultiSource/Benchmarks/McCat/18-imp/imp: 7.91% (0.3972 => 0.4286, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.23% (1.2845 => 1.3774, std.dev.: 0.0216)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.14% (10.3096 => 10.9430, std.dev.: 0.1593)
  MultiSource/Applications/siod/siod: 5.82% (2.5491 => 2.6974, std.dev.: 0.0458)
  MultiSource/Applications/d/make_dparser: 5.14% (3.6428 => 3.8300, std.dev.: 0.0717)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.43% (4.2717 => 4.4609, std.dev.: 0.0334)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.19% (0.5134 => 0.5349, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.90% (0.3758 => 0.3867, std.dev.: 0.0021)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 52.78% (0.7670 => 1.1718, std.dev.: 0.0631)
  MultiSource/Benchmarks/Olden/bisort/bisort: 42.75% (0.6732 => 0.9610, std.dev.: 0.0281)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 25.75% (1.4716 => 1.8506, std.dev.: 0.1300)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.86% (1.2278 => 1.4225, std.dev.: 0.0411)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.46% (2.5559 => 2.8487, std.dev.: 0.0462)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.73% (35.9684 => 38.7493, std.dev.: 1.0262)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.94% (1.1019 => 1.1674, std.dev.: 0.0198)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.67% (61.0792 => 63.3199, std.dev.: 0.8653)
  MultiSource/Applications/sgefa/sgefa: 3.64% (0.8745 => 0.9063, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.78% (6.5291 => 6.7109, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.12% (5.9126 => 6.0379, std.dev.: 0.0302)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.60% (0.6882 => 0.6428, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.46% (1.4277 => 1.3497, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.81% (1.3819 => 1.3154, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.59% (1.3157 => 1.2685, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.52% (1.2824 => 1.2372, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.31% (1.3127 => 1.2692, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.25% (1.5305 => 1.4808, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.45% (1.3660 => 1.3326, std.dev.: 0.0099)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -16.22% (23.4696 => 19.6637, std.dev.: 0.6618)
  MultiSource/Benchmarks/sim/sim: -4.52% (4.0134 => 3.8319, std.dev.: 0.0300)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.73% (6.0535 => 5.8882, std.dev.: 0.0277)
  MultiSource/Applications/sqlite3/sqlite3: -1.76% (4.2978 => 4.2221, std.dev.: 0.0174)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.62% (1.6699 => 1.6428, std.dev.: 0.0026)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131210/9870dfe8/attachment.html>


More information about the llvm-testresults mailing list