[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 13 17:14:55 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14381?compare_to=14377&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14381, Order: 188316, Start Time: 2013-08-13 22:20:49, End Time: 2013-08-14 00:16:54
      To: 14377, Order: 188309, Start Time: 2013-08-13 20:03:03, End Time: 2013-08-13 21:56:11
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 45 (60 on baseline)
Performance Improvements: 5 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1057 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 54.31% (0.1020 => 0.1574, std.dev.: 0.0115)
  SingleSource/UnitTests/Vector/constpool: 46.28% (8.6302 => 12.6244, std.dev.: 0.2485)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 46.13% (0.1409 => 0.2059, std.dev.: 0.0178)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 42.66% (1.6563 => 2.3629, std.dev.: 0.1116)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 40.58% (0.3551 => 0.4992, std.dev.: 0.0554)
  MultiSource/Benchmarks/MallocBench/gs/gs: 40.45% (4.7552 => 6.6787, std.dev.: 0.2669)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 39.63% (0.0752 => 0.1050, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.40% (0.1065 => 0.1474, std.dev.: 0.0127)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.47% (0.7085 => 0.9669, std.dev.: 0.0524)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 35.77% (1.1351 => 1.5411, std.dev.: 0.0468)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 34.77% (0.7251 => 0.9772, std.dev.: 0.0825)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 31.64% (10.0563 => 13.2386, std.dev.: 0.6074)
  MultiSource/Benchmarks/Prolangs-C/football/football: 20.45% (1.0252 => 1.2349, std.dev.: 0.0163)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.16% (15.3399 => 18.4320, std.dev.: 0.3359)
  MultiSource/Applications/sqlite3/sqlite3: 16.01% (17.3743 => 20.1558, std.dev.: 0.2022)
  MultiSource/Applications/lambda-0_1_3/lambda: 15.41% (0.8411 => 0.9707, std.dev.: 0.0364)
  MultiSource/Applications/ClamAV/clamscan: 14.93% (17.2322 => 19.8056, std.dev.: 0.7981)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.72% (1.3716 => 1.5186, std.dev.: 0.0206)
  MultiSource/Applications/kimwitu++/kc: 9.54% (19.6123 => 21.4838, std.dev.: 0.3131)
  SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1877 => 0.2046, std.dev.: 0.0065)
  MultiSource/Benchmarks/FreeBench/distray/distray: 8.95% (0.1195 => 0.1302, std.dev.: 0.0006)
  MultiSource/Applications/lemon/lemon: 8.00% (1.2365 => 1.3354, std.dev.: 0.0291)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.87% (1.4738 => 1.5898, std.dev.: 0.0302)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.95% (0.3728 => 0.3987, std.dev.: 0.0018)
  MultiSource/Applications/oggenc/oggenc: 3.47% (5.7409 => 5.9401, std.dev.: 0.0262)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 58.86% (0.0474 => 0.0753, std.dev.: 0.0077)
  SingleSource/Benchmarks/Shootout/ary3: 45.51% (6.2914 => 9.1549, std.dev.: 0.3569)
  SingleSource/Benchmarks/Shootout-C++/ary2: 34.08% (0.0311 => 0.0417, std.dev.: 0.0011)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 31.16% (0.0857 => 0.1124, std.dev.: 0.0045)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 29.24% (1.2307 => 1.5905, std.dev.: 0.0165)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 27.27% (0.3352 => 0.4266, std.dev.: 0.0178)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.94% (0.1476 => 0.1726, std.dev.: 0.0068)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.71% (29.4204 => 33.4545, std.dev.: 1.3879)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (4.1408 => 4.5599, std.dev.: 0.1325)
  SingleSource/Benchmarks/Shootout-C++/hash: 7.24% (0.7283 => 0.7810, std.dev.: 0.0192)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 3.94% (1.6151 => 1.6788, std.dev.: 0.0134)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.55% (40.5943 => 42.0353, std.dev.: 0.0857)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.01% (5.5647 => 5.7320, std.dev.: 0.0155)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.44% (1.2642 => 1.2950, std.dev.: 0.0087)
  MultiSource/Applications/obsequi/Obsequi: 1.66% (2.1159 => 2.1510, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.59% (3.4879 => 3.5433, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.53% (5.0299 => 5.1069, std.dev.: 0.0166)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.49% (51.5232 => 52.2906, std.dev.: 0.0638)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.27% (5.9586 => 6.0343, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/fp-convert: 1.26% (7.9734 => 8.0741, std.dev.: 0.0101)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -14.95% (1.7039 => 1.4491, std.dev.: 0.0663)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -11.69% (1.6853 => 1.4883, std.dev.: 0.0579)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.41% (1.4910 => 1.4401, std.dev.: 0.0170)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.81% (5.4800 => 5.3809, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.67% (6.0676 => 5.9663, std.dev.: 0.0214)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 19.01% (0.1310 => 0.1559, std.dev.: 0.0042)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 55.07% (0.1015 => 0.1574, std.dev.: 0.0115)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 48.02% (0.1391 => 0.2059, std.dev.: 0.0178)
  SingleSource/UnitTests/Vector/constpool: 42.44% (8.8630 => 12.6244, std.dev.: 0.2485)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 42.30% (0.3508 => 0.4992, std.dev.: 0.0554)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 42.20% (1.6617 => 2.3629, std.dev.: 0.1116)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 42.04% (0.0245 => 0.0348, std.dev.: 0.0025)
  SingleSource/Regression/C/bigstack: 41.85% (0.0466 => 0.0661, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 37.93% (0.7010 => 0.9669, std.dev.: 0.0524)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 36.54% (0.0769 => 0.1050, std.dev.: 0.0080)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 36.54% (1.1287 => 1.5411, std.dev.: 0.0468)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.48% (0.1080 => 0.1474, std.dev.: 0.0127)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 35.84% (0.7194 => 0.9772, std.dev.: 0.0825)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 28.49% (10.3031 => 13.2386, std.dev.: 0.6074)
  MultiSource/Benchmarks/FreeBench/distray/distray: 26.04% (0.1033 => 0.1302, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C/football/football: 19.21% (1.0359 => 1.2349, std.dev.: 0.0163)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.54% (15.5498 => 18.4320, std.dev.: 0.3359)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.77% (49.1253 => 55.3987, std.dev.: 1.8329)
  SingleSource/Benchmarks/McGill/chomp: 9.41% (0.1870 => 0.2046, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.95% (1.4333 => 1.5186, std.dev.: 0.0206)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.50% (0.3779 => 0.3987, std.dev.: 0.0018)
  MultiSource/Applications/sqlite3/sqlite3: 5.18% (19.1635 => 20.1558, std.dev.: 0.2022)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.62% (1.3630 => 1.3851, std.dev.: 0.0075)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 70.75% (0.0441 => 0.0753, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.53% (3.7285 => 6.2465, std.dev.: 0.1274)
  SingleSource/Benchmarks/Shootout/ary3: 57.41% (5.8158 => 9.1549, std.dev.: 0.3569)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.29% (2.8867 => 4.2808, std.dev.: 0.0266)
  MultiSource/Benchmarks/FreeBench/neural/neural: 41.94% (0.3171 => 0.4501, std.dev.: 0.0300)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 31.31% (0.0856 => 0.1124, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/hash: 29.11% (4.1846 => 5.4029, std.dev.: 0.1798)
  SingleSource/Benchmarks/Misc/pi: 26.07% (1.9835 => 2.5005, std.dev.: 0.0190)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.03% (1.5030 => 1.8943, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/hash: 24.07% (0.6295 => 0.7810, std.dev.: 0.0192)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.97% (1.3148 => 1.5905, std.dev.: 0.0165)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.91% (0.3649 => 0.4266, std.dev.: 0.0178)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.84% (9.1355 => 10.4908, std.dev.: 0.3990)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.21% (29.8131 => 33.4545, std.dev.: 1.3879)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.93% (0.1542 => 0.1726, std.dev.: 0.0068)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.13% (7.0762 => 7.8637, std.dev.: 0.0330)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.93% (14.9584 => 16.4433, std.dev.: 0.5494)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.89% (5.4910 => 6.0343, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.46% (5.5008 => 6.0214, std.dev.: 0.0473)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.20% (48.3256 => 52.2906, std.dev.: 0.0638)
  MultiSource/Applications/JM/lencod/lencod: 8.17% (7.1799 => 7.7668, std.dev.: 0.1992)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.99% (3.2027 => 3.4267, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.15% (5.3042 => 5.6303, std.dev.: 0.0416)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.86% (3.4085 => 3.6083, std.dev.: 0.0314)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 5.21% (1.5957 => 1.6788, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.80% (3.3384 => 3.4985, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.78% (4.8739 => 5.1069, std.dev.: 0.0166)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.59% (3.3877 => 3.5433, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.54% (5.1471 => 5.3809, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.53% (4.3151 => 4.5107, std.dev.: 0.0163)
  SingleSource/Benchmarks/Misc/whetstone: 3.85% (3.4559 => 3.5890, std.dev.: 0.0127)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.29% (25.0200 => 25.8437, std.dev.: 0.0956)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.91% (1.3104 => 1.3485, std.dev.: 0.0107)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.47% (41.0210 => 42.0353, std.dev.: 0.0857)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.46% (1.2639 => 1.2950, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.31% (4.9040 => 4.9681, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.16% (9.7023 => 9.8149, std.dev.: 0.0154)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.13% (5.6678 => 5.7320, std.dev.: 0.0155)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/obsequi/Obsequi: -18.10% (1.4685 => 1.2027, std.dev.: 0.0212)
  MultiSource/Applications/JM/ldecod/ldecod: -10.12% (8.6720 => 7.7945, std.dev.: 0.1395)
  MultiSource/Applications/oggenc/oggenc: -2.81% (6.1121 => 5.9401, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.28% (1.5629 => 1.5273, std.dev.: 0.0063)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.05% (2.1022 => 1.4285, std.dev.: 0.1809)
  MultiSource/Applications/viterbi/viterbi: -26.01% (3.4923 => 2.5841, std.dev.: 0.3085)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.29% (6.9552 => 5.2655, std.dev.: 0.3177)
  SingleSource/Benchmarks/Misc/perlin: -21.32% (4.5989 => 3.6183, std.dev.: 0.0053)
  MultiSource/Applications/obsequi/Obsequi: -17.53% (2.6081 => 2.1510, std.dev.: 0.0090)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.01% (47.2250 => 44.3853, std.dev.: 0.1947)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.54% (3.8119 => 3.6388, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/fbench: -4.37% (4.9602 => 4.7434, std.dev.: 0.0433)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.96% (6.1482 => 5.9663, std.dev.: 0.0214)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.82% (0.7806 => 0.7586, std.dev.: 0.0040)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.71% (1.7207 => 1.6741, std.dev.: 0.0123)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.35% (8.6172 => 8.4150, std.dev.: 0.0233)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.62% (34.8438 => 34.2796, std.dev.: 0.0720)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.35% (4.9231 => 4.8566, std.dev.: 0.0063)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 13.13% (0.1378 => 0.1559, std.dev.: 0.0042)

Report Time: 1.16s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130813/0da54cca/attachment.html>


More information about the llvm-testresults mailing list