[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 19 06:39:00 PST 2013


http://llvm.org/perf/db_default/v4/nts/18636?compare_to=18631&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18636, Order: 197674, Start Time: 2013-12-19 12:58:35, End Time: 2013-12-19 14:43:24
      To: 18631, Order: 197664, Start Time: 2013-12-19 10:48:13, End Time: 2013-12-19 12:36:24
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 19 (25 on baseline)
Performance Improvements: 33 (21 on baseline)
Unchanged Tests: 1058 (1064 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.89% (1.2633 => 1.2872, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.82% (1.2065 => 1.2284, std.dev.: 0.0037)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 57.60% (1.6527 => 2.6046, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout/sieve: 17.27% (6.7313 => 7.8940, std.dev.: 0.1163)
  SingleSource/Benchmarks/Shootout/matrix: 15.04% (1.8355 => 2.1115, std.dev.: 0.0009)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.31% (0.4324 => 0.4640, std.dev.: 0.0084)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 4.84% (1.1125 => 1.1664, std.dev.: 0.0141)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.28% (1.8200 => 1.8979, std.dev.: 0.0011)
  MultiSource/Benchmarks/sim/sim: 3.72% (3.8112 => 3.9528, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.56% (5.0708 => 5.2514, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.48% (5.7953 => 5.9967, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.43% (0.4814 => 0.4979, std.dev.: 0.0017)
  MultiSource/Applications/aha/aha: 3.41% (3.5685 => 3.6902, std.dev.: 0.0373)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.92% (2.4784 => 2.5508, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.27% (3.1495 => 3.2210, std.dev.: 0.0015)
  MultiSource/Applications/sgefa/sgefa: 2.21% (0.8866 => 0.9062, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.94% (11.9064 => 12.1372, std.dev.: 0.0074)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.64% (5.5581 => 5.6495, std.dev.: 0.0237)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.20% (1.4912 => 1.5091, std.dev.: 0.0012)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -28.71% (0.3954 => 0.2819, std.dev.: 0.0299)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -25.33% (0.4650 => 0.3472, std.dev.: 0.0116)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -22.78% (0.7347 => 0.5673, std.dev.: 0.0279)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -21.14% (0.2053 => 0.1619, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -18.74% (1.3434 => 1.0917, std.dev.: 0.0102)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -18.25% (1.0837 => 0.8859, std.dev.: 0.0174)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -17.42% (0.8339 => 0.6886, std.dev.: 0.0327)
  MultiSource/Benchmarks/Olden/em3d/em3d: -17.12% (0.2337 => 0.1937, std.dev.: 0.0142)
  MultiSource/Applications/lua/lua: -14.09% (4.9353 => 4.2399, std.dev.: 0.0812)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -13.71% (0.7652 => 0.6603, std.dev.: 0.0099)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -13.71% (11.3282 => 9.7754, std.dev.: 0.1843)
  SingleSource/UnitTests/Vector/Altivec/casts: -9.04% (0.1317 => 0.1198, std.dev.: 0.0018)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -8.53% (0.4070 => 0.3723, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.91% (1.1865 => 1.0927, std.dev.: 0.0229)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.01% (1.2311 => 1.1448, std.dev.: 0.0332)
  MultiSource/Applications/lemon/lemon: -6.27% (1.4144 => 1.3257, std.dev.: 0.0180)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.17% (1.7960 => 1.7031, std.dev.: 0.0334)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.32% (0.8751 => 0.8373, std.dev.: 0.0071)
  MultiSource/Applications/sqlite3/sqlite3: -4.24% (22.7972 => 21.8314, std.dev.: 0.3162)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.86% (1.4102 => 1.3557, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.78% (1.3449 => 1.2940, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.50% (1.3540 => 1.3202, std.dev.: 0.0092)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.31% (0.4898 => 0.4785, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.27% (0.5854 => 0.5721, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.41% (1.3135 => 1.2950, std.dev.: 0.0071)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -26.56% (0.5946 => 0.4367, std.dev.: 0.0566)
  MultiSource/Applications/lemon/lemon: -19.04% (1.0562 => 0.8551, std.dev.: 0.0066)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -7.56% (0.4601 => 0.4253, std.dev.: 0.0087)
  MultiSource/Benchmarks/nbench/nbench: -4.47% (22.3525 => 21.3525, std.dev.: 0.2848)
  MultiSource/Benchmarks/Olden/bh/bh: -2.07% (2.4403 => 2.3897, std.dev.: 0.0074)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.05% (3.6242 => 3.5499, std.dev.: 0.0072)
  MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.2355 => 4.1695, std.dev.: 0.0172)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.18% (23.6684 => 23.3883, std.dev.: 0.1008)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 38.68% (15.7419 => 21.8314, std.dev.: 0.3162)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.87% (0.3859 => 0.4896, std.dev.: 0.0097)
  MultiSource/Applications/lemon/lemon: 8.66% (1.2200 => 1.3257, std.dev.: 0.0180)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.86% (25.9661 => 27.7480, std.dev.: 0.3783)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.10% (1.6685 => 2.6046, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout/matrix: 17.57% (1.7960 => 2.1115, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout/sieve: 17.03% (6.7454 => 7.8940, std.dev.: 0.1163)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.95% (5.9583 => 6.9682, std.dev.: 0.1414)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.18% (3.3810 => 3.6575, std.dev.: 0.0449)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.95% (0.3534 => 0.3815, std.dev.: 0.0022)
  SingleSource/Benchmarks/Stanford/Puzzle: 7.61% (0.1668 => 0.1795, std.dev.: 0.0029)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.85% (1.1019 => 1.1664, std.dev.: 0.0141)
  MultiSource/Applications/siod/siod: 4.45% (3.4258 => 3.5782, std.dev.: 0.0190)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.28% (3.4043 => 3.5499, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.78% (5.0601 => 5.2514, std.dev.: 0.0026)
  MultiSource/Applications/sgefa/sgefa: 3.62% (0.8745 => 0.9062, std.dev.: 0.0065)
  MultiSource/Applications/aha/aha: 3.53% (3.5645 => 3.6902, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.48% (5.7952 => 5.9967, std.dev.: 0.0011)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.10% (1.8409 => 1.8979, std.dev.: 0.0011)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.73% (5.4994 => 5.6495, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (3.1547 => 3.2210, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.08% (11.8902 => 12.1372, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.05% (5.9126 => 6.0340, std.dev.: 0.0378)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.93% (2.5025 => 2.5508, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.79% (11.7894 => 11.9999, std.dev.: 0.0384)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.30% (0.3247 => 0.3010, std.dev.: 0.0004)
  MultiSource/Benchmarks/Bullet/bullet: -6.58% (36.6274 => 34.2189, std.dev.: 0.4878)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.52% (1.3505 => 1.2624, std.dev.: 0.0290)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.1774 => 0.1659, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.29% (1.3819 => 1.2950, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.23% (1.3157 => 1.2469, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.09% (1.4277 => 1.3551, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.13% (1.2824 => 1.2294, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.02% (1.4125 => 1.3557, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.86% (1.3460 => 1.2940, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.65% (1.3702 => 1.3202, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.41% (1.2544 => 1.2116, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.21% (1.3024 => 1.2606, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.77% (1.3182 => 1.2817, std.dev.: 0.0138)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.69% (0.5879 => 0.5721, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.62% (1.2583 => 1.2253, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.50% (1.3068 => 1.2872, std.dev.: 0.0048)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -9.02% (23.4696 => 21.3525, std.dev.: 0.2848)
  MultiSource/Benchmarks/Bullet/bullet: -6.24% (7.4226 => 6.9591, std.dev.: 0.1177)
  MultiSource/Applications/sqlite3/sqlite3: -2.99% (4.2978 => 4.1695, std.dev.: 0.0172)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.73% (6.0535 => 5.8881, std.dev.: 0.0158)

Report Time: 1.85s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131219/148e565a/attachment.html>


More information about the llvm-testresults mailing list