[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 29 23:49:11 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16825?compare_to=16821&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16825, Order: 193675, Start Time: 2013-10-30 05:06:12, End Time: 2013-10-30 06:52:36
      To: 16821, Order: 193671, Start Time: 2013-10-30 02:52:49, End Time: 2013-10-30 04:45:03
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 27 (55 on baseline)
Performance Improvements: 26 (31 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1054 (1021 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 62.37% (1.6064 => 2.6083, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout/matrix: 14.46% (1.8449 => 2.1117, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 9.35% (0.1818 => 0.1988, std.dev.: 0.0001)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 7.93% (0.4590 => 0.4954, std.dev.: 0.0053)
  MultiSource/Applications/spiff/spiff: 5.62% (2.8426 => 3.0023, std.dev.: 0.0573)
  MultiSource/Applications/aha/aha: 5.55% (3.5768 => 3.7752, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.31% (3.5900 => 3.7808, std.dev.: 0.0396)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.15% (1.0240 => 1.0767, std.dev.: 0.0011)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.14% (0.3622 => 0.3808, std.dev.: 0.0006)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.01% (1.2363 => 1.2982, std.dev.: 0.0043)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.44% (3.2774 => 3.4230, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout/lists: 3.40% (7.2612 => 7.5082, std.dev.: 0.0082)
  MultiSource/Applications/sqlite3/sqlite3: 3.15% (4.2577 => 4.3919, std.dev.: 0.0049)
  MultiSource/Applications/hexxagon/hexxagon: 3.07% (15.2960 => 15.7657, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.04% (11.6897 => 12.0453, std.dev.: 0.0250)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.46% (0.4548 => 0.4660, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.44% (1.5828 => 1.6214, std.dev.: 0.0111)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.32% (1.5932 => 1.6301, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.24% (15.8221 => 16.1767, std.dev.: 0.0358)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.17% (3.9029 => 3.9877, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.13% (3.5872 => 3.6637, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.88% (11.9152 => 12.1397, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.56% (3.1628 => 3.2122, std.dev.: 0.0137)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.43% (6.7521 => 6.8486, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout/fib2: 1.39% (3.6018 => 3.6520, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.14% (4.0483 => 4.0943, std.dev.: 0.0119)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.04% (3.7980 => 3.8374, std.dev.: 0.0003)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.86% (0.2266 => 0.1952, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -10.97% (0.0930 => 0.0828, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -9.92% (0.1048 => 0.0944, std.dev.: 0.0008)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -9.72% (0.1060 => 0.0957, std.dev.: 0.0034)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.16% (0.6902 => 0.6615, std.dev.: 0.0056)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -3.58% (1.1997 => 1.1568, std.dev.: 0.0135)
  MultiSource/Applications/minisat/minisat: -2.75% (0.7775 => 0.7561, std.dev.: 0.0006)
  MultiSource/Applications/oggenc/oggenc: -2.60% (5.5039 => 5.3606, std.dev.: 0.0352)
  MultiSource/Applications/spiff/spiff: -1.75% (0.9297 => 0.9134, std.dev.: 0.0006)
  MultiSource/Applications/ClamAV/clamscan: -1.61% (16.9958 => 16.7218, std.dev.: 0.0325)
  MultiSource/Applications/SPASS/SPASS: -1.61% (16.6221 => 16.3545, std.dev.: 0.0613)
  MultiSource/Applications/obsequi/Obsequi: -1.42% (1.1864 => 1.1695, std.dev.: 0.0054)
  MultiSource/Applications/JM/ldecod/ldecod: -1.26% (7.7154 => 7.6183, std.dev.: 0.0266)
  MultiSource/Applications/d/make_dparser: -1.18% (3.6095 => 3.5670, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -15.33% (0.3920 => 0.3319, std.dev.: 0.0012)
  MultiSource/Applications/lemon/lemon: -9.25% (0.9402 => 0.8532, std.dev.: 0.0240)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.49% (36.8712 => 35.5840, std.dev.: 0.2574)
  MultiSource/Applications/minisat/minisat: -3.10% (6.4992 => 6.2980, std.dev.: 0.0643)
  MultiSource/Applications/obsequi/Obsequi: -2.77% (2.3539 => 2.2886, std.dev.: 0.0232)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.71% (3.0374 => 2.9552, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.58% (5.9937 => 5.8389, std.dev.: 0.0376)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.01% (4.9448 => 4.8454, std.dev.: 0.0184)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.77% (0.7215 => 0.7087, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.64% (2.6854 => 2.6414, std.dev.: 0.0097)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.27% (2.1294 => 2.1024, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.07% (61.2678 => 60.6122, std.dev.: 0.1142)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.69% (0.1417 => 0.1393, std.dev.: 0.0041)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.19% (1.6047 => 1.7040, std.dev.: 0.0195)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.02% (2.6492 => 2.7821, std.dev.: 0.0278)
  MultiSource/Applications/JM/lencod/lencod: 4.80% (16.5902 => 17.3859, std.dev.: 0.0735)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.8014 => 0.8321, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.72% (0.3822 => 0.3964, std.dev.: 0.0029)
  MultiSource/Applications/siod/siod: 3.58% (2.4480 => 2.5356, std.dev.: 0.0055)
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.56% (0.3480 => 0.3604, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.32% (0.5609 => 0.5795, std.dev.: 0.0048)
  MultiSource/Applications/JM/ldecod/ldecod: 2.91% (7.4026 => 7.6183, std.dev.: 0.0266)
  MultiSource/Applications/sgefa/sgefa: 2.75% (0.3848 => 0.3954, std.dev.: 0.0008)
  MultiSource/Applications/lemon/lemon: 2.68% (1.1862 => 1.2180, std.dev.: 0.0000)
  MultiSource/Applications/kimwitu++/kc: 2.58% (18.3608 => 18.8352, std.dev.: 0.1187)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (1.9476 => 1.9970, std.dev.: 0.0034)
  MultiSource/Applications/spiff/spiff: 2.50% (0.8911 => 0.9134, std.dev.: 0.0006)
  MultiSource/Applications/Burg/burg: 2.32% (1.3994 => 1.4318, std.dev.: 0.0041)
  MultiSource/Applications/treecc/treecc: 2.09% (2.2516 => 2.2987, std.dev.: 0.0126)
  MultiSource/Applications/d/make_dparser: 2.03% (3.4962 => 3.5670, std.dev.: 0.0042)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.93% (1.1393 => 1.1613, std.dev.: 0.0073)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.85% (9.7354 => 9.9158, std.dev.: 0.0529)
  MultiSource/Applications/minisat/minisat: 1.64% (0.7439 => 0.7561, std.dev.: 0.0006)
  MultiSource/Applications/lua/lua: 1.39% (4.2242 => 4.2829, std.dev.: 0.0114)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.2728 => 1.2903, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0284 => 6.1042, std.dev.: 0.0247)
  MultiSource/Applications/obsequi/Obsequi: 1.25% (1.1551 => 1.1695, std.dev.: 0.0054)
  MultiSource/Applications/SPASS/SPASS: 1.17% (16.1646 => 16.3545, std.dev.: 0.0613)
  MultiSource/Applications/ClamAV/clamscan: 1.10% (16.5398 => 16.7218, std.dev.: 0.0325)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.79% (7.6426 => 12.2883, std.dev.: 0.0543)
  SingleSource/Benchmarks/Misc/pi: 57.37% (1.6574 => 2.6083, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/matrix: 50.29% (2.8554 => 4.2914, std.dev.: 0.0003)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.16% (1.1431 => 1.3735, std.dev.: 0.0634)
  SingleSource/Benchmarks/Shootout/matrix: 18.57% (1.7809 => 2.1117, std.dev.: 0.0027)
  SingleSource/Benchmarks/McGill/misr: 9.63% (0.3771 => 0.4134, std.dev.: 0.0012)
  MultiSource/Benchmarks/PAQ8p/paq8p: 7.17% (96.7834 => 103.7272, std.dev.: 2.0423)
  MultiSource/Applications/hexxagon/hexxagon: 6.66% (14.7810 => 15.7657, std.dev.: 0.0054)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0044)
  MultiSource/Applications/spiff/spiff: 6.49% (2.8194 => 3.0023, std.dev.: 0.0573)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.35% (3.5550 => 3.7808, std.dev.: 0.0396)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 6.25% (0.1871 => 0.1988, std.dev.: 0.0001)
  MultiSource/Applications/aha/aha: 5.66% (3.5731 => 3.7752, std.dev.: 0.0058)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 5.11% (2.5368 => 2.6665, std.dev.: 0.0153)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.07% (1.1013 => 1.1571, std.dev.: 0.0050)
  MultiSource/Applications/obsequi/Obsequi: 4.58% (2.1884 => 2.2886, std.dev.: 0.0232)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.78% (0.3836 => 0.3981, std.dev.: 0.0003)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.38% (89.7126 => 92.7431, std.dev.: 0.3385)
  MultiSource/Applications/sqlite3/sqlite3: 2.78% (4.2733 => 4.3919, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.67% (3.5683 => 3.6637, std.dev.: 0.0044)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.44% (0.4549 => 0.4660, std.dev.: 0.0004)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.40% (1.8519 => 1.8964, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.38% (11.7654 => 12.0453, std.dev.: 0.0250)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.08% (1.0477 => 1.0695, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/lists: 1.87% (7.3703 => 7.5082, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.77% (11.9288 => 12.1397, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.75% (3.1569 => 3.2122, std.dev.: 0.0137)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.57% (6.7429 => 6.8486, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout/fib2: 1.54% (3.5966 => 3.6520, std.dev.: 0.0032)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: -13.74% (0.1194 => 0.1030, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/matrix: -8.44% (0.2571 => 0.2354, std.dev.: 0.0013)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.47% (0.2883 => 0.2783, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.76% (0.7184 => 0.6986, std.dev.: 0.0043)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.65% (0.5226 => 0.2422, std.dev.: 0.0047)
  MultiSource/Applications/sgefa/sgefa: -42.64% (1.5790 => 0.9057, std.dev.: 0.0045)
  SingleSource/Benchmarks/Linpack/linpack-pc: -21.93% (57.2347 => 44.6856, std.dev.: 1.1941)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.49% (15.9508 => 12.8420, std.dev.: 0.6391)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.07% (0.3304 => 0.2707, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/moments: -16.11% (0.1285 => 0.1078, std.dev.: 0.0007)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.08% (20.8247 => 18.5177, std.dev.: 0.1342)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.52% (50.0284 => 44.7652, std.dev.: 0.6845)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.31% (3.4956 => 3.1703, std.dev.: 0.0082)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.57% (3.7437 => 3.4230, std.dev.: 0.0062)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.40% (8.1346 => 7.6140, std.dev.: 0.0142)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.18% (0.7474 => 0.7087, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.62% (1.4898 => 1.4210, std.dev.: 0.0233)
  SingleSource/Benchmarks/Shootout-C++/ary3: -4.48% (5.0002 => 4.7760, std.dev.: 0.0668)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -4.13% (0.3462 => 0.3319, std.dev.: 0.0012)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.43% (3.7874 => 3.6576, std.dev.: 0.0158)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.41% (36.8417 => 35.5840, std.dev.: 0.2574)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.80% (2.4471 => 2.3786, std.dev.: 0.0218)
  MultiSource/Benchmarks/Olden/power/power: -2.67% (1.2170 => 1.1845, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.55% (17.1431 => 16.7051, std.dev.: 0.0268)
  SingleSource/Benchmarks/Misc/oourafft: -2.37% (3.7484 => 3.6595, std.dev.: 0.0315)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.33% (2.5938 => 2.5334, std.dev.: 0.0008)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.31% (1.1075 => 1.0819, std.dev.: 0.0081)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.55% (4.3592 => 4.2915, std.dev.: 0.0092)
  MultiSource/Applications/lua/lua: -1.24% (29.5202 => 29.1534, std.dev.: 0.0667)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.16% (4.9022 => 4.8454, std.dev.: 0.0184)
  SingleSource/Benchmarks/Misc/whetstone: -1.07% (3.6303 => 3.5916, std.dev.: 0.0080)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.34% (0.1348 => 0.1393, std.dev.: 0.0041)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131030/d25a73bb/attachment.html>


More information about the llvm-testresults mailing list