[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 31 07:35:49 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13957?compare_to=13953&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13957, Order: 187493, Start Time: 2013-07-31 12:51:05, End Time: 2013-07-31 14:37:33
      To: 13953, Order: 187486, Start Time: 2013-07-31 10:32:49, End Time: 2013-07-31 12:25:55
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 3 (24 on baseline)
Performance Improvements: 51 (54 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1053 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.66% (1.4313 => 1.4550, std.dev.: 0.0067)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.25% (4.4225 => 4.4776, std.dev.: 0.0048)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.12% (51.5992 => 52.1796, std.dev.: 0.0503)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -38.20% (0.1534 => 0.0948, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/simple: -33.14% (0.0341 => 0.0228, std.dev.: 0.0006)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -31.68% (1.4239 => 0.9728, std.dev.: 0.1123)
  SingleSource/UnitTests/Vector/constpool: -30.55% (13.1638 => 9.1423, std.dev.: 0.1988)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -20.36% (0.0663 => 0.0528, std.dev.: 0.0006)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -20.08% (0.2864 => 0.2289, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.38% (1.7747 => 1.4485, std.dev.: 0.0156)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.50% (0.8398 => 0.6928, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -17.20% (1.9993 => 1.6554, std.dev.: 0.0104)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -15.39% (0.0838 => 0.0709, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -15.06% (0.8686 => 0.7378, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.82% (0.1120 => 0.0954, std.dev.: 0.0007)
  MultiSource/Applications/SPASS/SPASS: -14.40% (19.9363 => 17.0659, std.dev.: 1.0063)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -14.29% (1.8464 => 1.5825, std.dev.: 0.0998)
  MultiSource/Applications/d/make_dparser: -13.23% (4.2730 => 3.7075, std.dev.: 0.2018)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -12.99% (1.7518 => 1.5243, std.dev.: 0.0112)
  MultiSource/Applications/oggenc/oggenc: -12.64% (6.5282 => 5.7029, std.dev.: 0.2827)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -11.59% (1.6485 => 1.4574, std.dev.: 0.0741)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.48% (0.1655 => 0.1465, std.dev.: 0.0013)
  MultiSource/Applications/aha/aha: -10.45% (0.1464 => 0.1311, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -10.04% (1.5410 => 1.3863, std.dev.: 0.0415)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.27% (11.0780 => 10.0516, std.dev.: 0.0291)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.25% (0.1621 => 0.1471, std.dev.: 0.0008)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -8.38% (0.6244 => 0.5721, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -8.05% (0.5232 => 0.4811, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.67% (0.4238 => 0.3913, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -7.54% (0.7418 => 0.6859, std.dev.: 0.0168)
  MultiSource/Benchmarks/nbench/nbench: -7.33% (1.4185 => 1.3145, std.dev.: 0.0104)
  SingleSource/UnitTests/Vector/Altivec/test1: -7.18% (0.1476 => 0.1370, std.dev.: 0.0026)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.89% (0.2902 => 0.2702, std.dev.: 0.0077)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.99% (1.7402 => 1.6360, std.dev.: 0.0170)
  MultiSource/Benchmarks/Bullet/bullet: -5.09% (37.7485 => 35.8265, std.dev.: 0.1328)
  MultiSource/Benchmarks/Prolangs-C/football/football: -4.03% (1.0765 => 1.0331, std.dev.: 0.0055)
  MultiSource/Benchmarks/MallocBench/gs/gs: -1.87% (4.8381 => 4.7474, std.dev.: 0.0177)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -32.76% (0.0693 => 0.0466, std.dev.: 0.0003)
  MultiSource/Applications/SPASS/SPASS: -27.34% (11.3844 => 8.2722, std.dev.: 1.1854)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.54% (0.1084 => 0.0883, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -12.86% (0.3818 => 0.3327, std.dev.: 0.0181)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -12.82% (10.8076 => 9.4222, std.dev.: 0.2638)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.71% (3.1551 => 2.9117, std.dev.: 0.0914)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.05% (2.5234 => 2.3707, std.dev.: 0.0168)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -5.38% (42.1872 => 39.9194, std.dev.: 0.5044)
  MultiSource/Applications/siod/siod: -3.65% (3.9809 => 3.8357, std.dev.: 0.0479)
  MultiSource/Benchmarks/Bullet/bullet: -3.01% (7.1401 => 6.9254, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.03% (5.1788 => 5.0739, std.dev.: 0.0121)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.01% (2.6546 => 2.6013, std.dev.: 0.0204)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.97% (1.6382 => 1.6060, std.dev.: 0.0123)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.84% (21.4333 => 21.0384, std.dev.: 0.0986)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.50% (5.8676 => 5.7797, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.39% (4.5619 => 4.4985, std.dev.: 0.0245)
  MultiSource/Applications/viterbi/viterbi: -1.18% (2.5669 => 2.5366, std.dev.: 0.0114)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -15.64% (0.1650 => 0.1392, std.dev.: 0.0088)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.53% (2.8867 => 4.2875, std.dev.: 0.1624)
  MultiSource/Benchmarks/FreeBench/neural/neural: 44.94% (0.3171 => 0.4596, std.dev.: 0.0336)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 21.42% (2.9428 => 3.5732, std.dev.: 0.1434)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.39% (0.6295 => 0.7264, std.dev.: 0.0368)
  MultiSource/Applications/siod/siod: 13.61% (3.3761 => 3.8357, std.dev.: 0.0479)
  MultiSource/Applications/lambda-0_1_3/lambda: 13.10% (7.0762 => 8.0031, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.33% (5.4910 => 5.9482, std.dev.: 0.0248)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.98% (48.3256 => 52.1796, std.dev.: 0.0503)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (1.2557 => 1.3555, std.dev.: 0.0059)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.68% (14.9584 => 16.1068, std.dev.: 0.1813)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.91% (3.2027 => 3.4239, std.dev.: 0.0313)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.43% (0.2799 => 0.2979, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.85% (3.3877 => 3.5859, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.82% (5.3042 => 5.6127, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.61% (3.4085 => 3.5998, std.dev.: 0.0558)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.45% (5.5008 => 5.8007, std.dev.: 0.0602)
  SingleSource/Benchmarks/Misc/whetstone: 4.64% (3.4559 => 3.6162, std.dev.: 0.0442)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.25% (4.3151 => 4.4985, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.23% (5.1471 => 5.3648, std.dev.: 0.0731)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.72% (1.4398 => 1.4645, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/flops: 1.57% (9.7664 => 9.9202, std.dev.: 0.0254)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.56% (1.4327 => 1.4550, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.07% (4.9089 => 4.9613, std.dev.: 0.0119)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.03% (11.5371 => 11.6565, std.dev.: 0.0162)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -38.49% (0.2237 => 0.1376, std.dev.: 0.0088)
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.02% (0.1072 => 0.0718, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -30.43% (0.1114 => 0.0775, std.dev.: 0.0046)
  MultiSource/Benchmarks/Olden/tsp/tsp: -26.29% (0.1818 => 0.1340, std.dev.: 0.0053)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -23.41% (0.0675 => 0.0517, std.dev.: 0.0009)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.09% (6.0938 => 4.7474, std.dev.: 0.0177)
  MultiSource/Benchmarks/Olden/health/health: -21.22% (0.1993 => 0.1570, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -20.19% (0.3576 => 0.2854, std.dev.: 0.0031)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -19.88% (1.5228 => 1.2201, std.dev.: 0.1109)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.44% (0.1080 => 0.0924, std.dev.: 0.0047)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.52% (0.7091 => 0.6132, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -11.05% (0.3655 => 0.3251, std.dev.: 0.0062)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -8.37% (0.2498 => 0.2289, std.dev.: 0.0038)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.98% (6.1631 => 5.7947, std.dev.: 0.0841)
  MultiSource/Benchmarks/Bullet/bullet: -4.43% (37.4863 => 35.8265, std.dev.: 0.1328)
  MultiSource/Benchmarks/nbench/nbench: -3.89% (1.3677 => 1.3145, std.dev.: 0.0104)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.7189 => 0.6964, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.99% (1.4932 => 1.4485, std.dev.: 0.0156)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.44% (10.3031 => 10.0516, std.dev.: 0.0291)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.94% (1.5544 => 1.5243, std.dev.: 0.0112)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.93% (0.7523 => 0.7378, std.dev.: 0.0031)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -38.26% (1.4194 => 0.8763, std.dev.: 0.2060)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.31% (2.1022 => 1.4230, std.dev.: 0.0164)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.64% (0.0816 => 0.0566, std.dev.: 0.0005)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.38% (0.9545 => 0.6741, std.dev.: 0.0529)
  MultiSource/Applications/viterbi/viterbi: -27.37% (3.4923 => 2.5366, std.dev.: 0.0114)
  MultiSource/Benchmarks/MallocBench/gs/gs: -27.33% (0.1189 => 0.0864, std.dev.: 0.0003)
  MultiSource/Applications/JM/ldecod/ldecod: -25.73% (0.0859 => 0.0638, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.62% (6.9552 => 5.2428, std.dev.: 0.0168)
  SingleSource/Benchmarks/Misc/perlin: -21.36% (4.5989 => 3.6168, std.dev.: 0.0106)
  SingleSource/Benchmarks/Misc/mandel: -14.70% (1.1996 => 1.0232, std.dev.: 0.0357)
  MultiSource/Applications/sgefa/sgefa: -12.87% (1.4030 => 1.2224, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.66% (6.2627 => 5.4701, std.dev.: 0.1240)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.26% (0.3557 => 0.3121, std.dev.: 0.0068)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.36% (47.2250 => 41.8580, std.dev.: 1.4192)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.41% (0.5173 => 0.4686, std.dev.: 0.0018)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.49% (3.5791 => 3.2753, std.dev.: 0.0520)
  MultiSource/Applications/lua/lua: -8.31% (31.0707 => 28.4885, std.dev.: 0.7728)
  MultiSource/Benchmarks/Olden/health/health: -7.45% (0.3556 => 0.3291, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.46% (0.3773 => 0.3567, std.dev.: 0.0057)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.27% (1.7207 => 1.6301, std.dev.: 0.0135)
  MultiSource/Benchmarks/Bullet/bullet: -5.13% (7.2995 => 6.9254, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.79% (3.8119 => 3.6292, std.dev.: 0.0305)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.11% (0.3479 => 0.3336, std.dev.: 0.0011)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.83% (2.7049 => 2.6013, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9619, std.dev.: 0.0379)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.99% (21.6864 => 21.0384, std.dev.: 0.0986)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.83% (5.2218 => 5.0739, std.dev.: 0.0121)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.39% (8.6172 => 8.4113, std.dev.: 0.0641)
  SingleSource/Benchmarks/Misc/oourafft: -2.11% (3.7891 => 3.7093, std.dev.: 0.0261)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.94% (34.8438 => 34.1686, std.dev.: 0.0967)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.35% (4.9231 => 4.8567, std.dev.: 0.0080)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.32% (1.1024 => 1.0878, std.dev.: 0.0033)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.24% (1.3104 => 1.2942, std.dev.: 0.0019)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.02% (0.1378 => 0.1392, std.dev.: 0.0088)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130731/5d655fdf/attachment.html>


More information about the llvm-testresults mailing list