[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 17 16:53:34 PST 2013


http://llvm.org/perf/db_default/v4/nts/18541?compare_to=18537&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18541, Order: 197531, Start Time: 2013-12-17 23:10:50, End Time: 2013-12-18 00:57:54
      To: 18537, Order: 197518, Start Time: 2013-12-17 20:54:02, End Time: 2013-12-17 22:43:46
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 7 (18 on baseline)
Performance Improvements: 50 (20 on baseline)
Unchanged Tests: 1053 (1072 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 35.34% (0.1398 => 0.1892, std.dev.: 0.0051)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.02% (0.0915 => 0.1025, std.dev.: 0.0005)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.09% (40.5004 => 41.7505, std.dev.: 0.4435)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.61% (3.7321 => 3.8294, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout/random: 2.08% (2.4226 => 2.4730, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.82% (5.9026 => 6.0101, std.dev.: 0.0062)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.06% (7.8513 => 7.9342, std.dev.: 0.0311)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -42.90% (0.1387 => 0.0792, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -38.57% (0.1439 => 0.0884, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -38.09% (0.1394 => 0.0863, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/flops-2: -38.03% (0.0497 => 0.0308, std.dev.: 0.0030)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -31.79% (0.1507 => 0.1028, std.dev.: 0.0098)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -28.86% (0.1424 => 0.1013, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -25.85% (1.2026 => 0.8917, std.dev.: 0.0067)
  MultiSource/Benchmarks/McCat/09-vor/vor: -25.77% (0.4943 => 0.3669, std.dev.: 0.0222)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -24.83% (0.1309 => 0.0984, std.dev.: 0.0090)
  MultiSource/Benchmarks/Olden/mst/mst: -22.93% (0.1714 => 0.1321, std.dev.: 0.0077)
  MultiSource/Benchmarks/BitBench/five11/five11: -21.33% (0.0783 => 0.0616, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -19.02% (0.8309 => 0.6729, std.dev.: 0.0078)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -14.58% (1.0789 => 0.9216, std.dev.: 0.0448)
  MultiSource/Benchmarks/Olden/power/power: -14.05% (0.1608 => 0.1382, std.dev.: 0.0066)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -13.95% (0.1928 => 0.1659, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -12.37% (1.2867 => 1.1275, std.dev.: 0.0185)
  MultiSource/Benchmarks/McCat/08-main/main: -11.14% (0.3501 => 0.3111, std.dev.: 0.0093)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -10.84% (6.2830 => 5.6020, std.dev.: 0.1169)
  MultiSource/Benchmarks/Olden/tsp/tsp: -9.39% (0.1480 => 0.1341, std.dev.: 0.0025)
  MultiSource/Benchmarks/Olden/health/health: -7.08% (0.1652 => 0.1535, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/sieve: -6.78% (0.3052 => 0.2845, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.67% (0.3402 => 0.3175, std.dev.: 0.0068)
  SingleSource/Benchmarks/Shootout-C++/ary3: -6.54% (0.2707 => 0.2530, std.dev.: 0.0058)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.34% (2.7382 => 2.5645, std.dev.: 0.0524)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -5.91% (0.3757 => 0.3535, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.68% (1.3013 => 1.2404, std.dev.: 0.0043)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.59% (0.2809 => 0.2680, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.29% (1.2729 => 1.2183, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.18% (1.2908 => 1.2369, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.66% (1.2962 => 1.2487, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.03% (1.2608 => 1.2226, std.dev.: 0.0115)
  SingleSource/Benchmarks/Misc-C++/bigfib: -2.95% (0.6888 => 0.6685, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.74% (1.3886 => 1.3506, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.67% (1.4849 => 1.4452, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.48% (1.2873 => 1.2554, std.dev.: 0.0061)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.34% (0.6636 => 0.6481, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -51.13% (0.2556 => 0.1249, std.dev.: 0.0332)
  SingleSource/Benchmarks/Stanford/Towers: -44.74% (0.0371 => 0.0205, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/bisort/bisort: -23.45% (0.8805 => 0.6740, std.dev.: 0.0119)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -22.27% (5.9396 => 4.6166, std.dev.: 0.4057)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -10.31% (2.3436 => 2.1019, std.dev.: 0.0073)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.46% (0.3330 => 0.3115, std.dev.: 0.0029)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (0.5436 => 0.5103, std.dev.: 0.0074)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.11% (1.6416 => 1.5413, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.13% (6.2188 => 5.8999, std.dev.: 0.0067)
  MultiSource/Benchmarks/Olden/health/health: -4.71% (0.3460 => 0.3297, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.04% (3.7880 => 3.6350, std.dev.: 0.0387)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.51% (1.8135 => 1.7680, std.dev.: 0.0101)
  MultiSource/Applications/viterbi/viterbi: -2.35% (2.6861 => 2.6231, std.dev.: 0.0130)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.29% (2.9538 => 2.9156, std.dev.: 0.0044)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 38.84% (15.7419 => 21.8553, std.dev.: 1.1598)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.91% (0.1145 => 0.1247, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.26% (0.6412 => 0.6685, std.dev.: 0.0031)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.52% (0.6322 => 0.6481, std.dev.: 0.0033)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.57% (5.9583 => 7.0051, std.dev.: 0.3456)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.44% (3.3810 => 3.6663, std.dev.: 0.0383)
  MultiSource/Applications/siod/siod: 5.61% (3.4258 => 3.6179, std.dev.: 0.0139)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.53% (0.3534 => 0.3694, std.dev.: 0.0056)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.22% (3.4043 => 3.5481, std.dev.: 0.0397)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.29% (40.4190 => 41.7505, std.dev.: 0.4435)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.78% (4.4509 => 4.5748, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.78% (6.5291 => 6.7108, std.dev.: 0.0494)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.62% (3.7315 => 3.8294, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.60% (1.5797 => 1.6207, std.dev.: 0.0124)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.01% (4.8243 => 4.9214, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.98% (5.8933 => 6.0101, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.91% (11.7894 => 12.0141, std.dev.: 0.0521)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.56% (1.7409 => 1.7680, std.dev.: 0.0101)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -27.33% (0.0688 => 0.0500, std.dev.: 0.0023)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -19.69% (0.1280 => 0.1028, std.dev.: 0.0098)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.39% (0.1088 => 0.0975, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.57% (1.5305 => 1.4452, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (1.3819 => 1.3067, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.40% (1.4277 => 1.3506, std.dev.: 0.0118)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.10% (0.2824 => 0.2680, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.04% (1.3505 => 1.2825, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.01% (1.3146 => 1.2487, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.37% (1.3127 => 1.2554, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.22% (1.2914 => 1.2369, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.21% (1.4125 => 1.3530, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.02% (1.3264 => 1.2731, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.64% (1.2544 => 1.2087, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.42% (1.3460 => 1.2999, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.18% (1.2583 => 1.2183, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3714 => 0.3599, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.10% (1.2670 => 1.2404, std.dev.: 0.0043)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: -6.21% (10.0217 => 9.3994, std.dev.: 0.1584)
  MultiSource/Benchmarks/Bullet/bullet: -5.86% (7.4226 => 6.9879, std.dev.: 0.0613)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131217/0372f3f7/attachment.html>


More information about the llvm-testresults mailing list