[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 14 02:41:55 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14396?compare_to=14392&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14396, Order: 188363, Start Time: 2013-08-14 07:57:26, End Time: 2013-08-14 09:43:54
      To: 14392, Order: 188353, Start Time: 2013-08-14 05:37:10, End Time: 2013-08-14 07:31:31
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 5 (28 on baseline)
Performance Improvements: 21 (67 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1081 (1012 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.79% (0.4924 => 0.5160, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.46% (6.2555 => 6.4717, std.dev.: 0.0561)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.25% (12.7670 => 13.1818, std.dev.: 0.0200)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.96% (1.6286 => 1.6768, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/fp-convert: 2.52% (7.8532 => 8.0513, std.dev.: 0.0166)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -35.08% (0.0533 => 0.0346, std.dev.: 0.0020)
  SingleSource/UnitTests/Vector/build2: -24.01% (0.0479 => 0.0364, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -21.55% (0.1327 => 0.1041, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -18.72% (0.1191 => 0.0968, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/oourafft: -17.75% (0.2890 => 0.2377, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -16.80% (0.2572 => 0.2140, std.dev.: 0.0075)
  SingleSource/Benchmarks/Shootout-C++/sieve: -14.54% (0.3721 => 0.3180, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/ReedSolomon: -12.85% (0.2670 => 0.2327, std.dev.: 0.0099)
  SingleSource/Benchmarks/Misc/whetstone: -10.00% (0.1050 => 0.0945, std.dev.: 0.0016)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.36% (0.2187 => 0.2026, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.10% (8.1332 => 7.6374, std.dev.: 0.0721)
  SingleSource/Benchmarks/Shootout-C++/ary: -4.71% (0.3012 => 0.2870, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.57% (1.6125 => 1.5550, std.dev.: 0.0095)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.72% (0.7135 => 0.6941, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.74% (1.3990 => 1.3746, std.dev.: 0.0061)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: -42.55% (5.0582 => 2.9060, std.dev.: 0.2424)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -10.22% (0.9334 => 0.8380, std.dev.: 0.0239)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.31% (0.3596 => 0.3333, std.dev.: 0.0031)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.81% (2.6614 => 2.5867, std.dev.: 0.0257)
  SingleSource/Benchmarks/Shootout-C++/sieve: -2.20% (3.5438 => 3.4660, std.dev.: 0.0145)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.38% (1.6701 => 1.6470, std.dev.: 0.0057)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.38% (0.1307 => 0.1325, std.dev.: 0.0016)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.04% (1.4932 => 1.5087, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.57% (3.7285 => 6.4717, std.dev.: 0.0561)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.54% (2.8867 => 4.2878, std.dev.: 0.0022)
  MultiSource/Benchmarks/FreeBench/neural/neural: 38.41% (0.3171 => 0.4389, std.dev.: 0.0383)
  SingleSource/Benchmarks/Shootout/hash: 24.61% (4.1846 => 5.2144, std.dev.: 0.2537)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 16.84% (2.9428 => 3.4383, std.dev.: 0.1429)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.45% (7.0762 => 7.8867, std.dev.: 0.0731)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9477, std.dev.: 0.0424)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.96% (48.3256 => 52.1744, std.dev.: 0.0617)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.91% (1.2557 => 1.3550, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.90% (3.2027 => 3.4236, std.dev.: 0.0045)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.54% (0.2799 => 0.2982, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6220, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.69% (3.4085 => 3.6026, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5008 => 5.8015, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 5.08% (1.5957 => 1.6768, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.27% (5.1471 => 5.3667, std.dev.: 0.0662)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.3151 => 4.4966, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/whetstone: 4.11% (3.4559 => 3.5979, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.68% (3.3384 => 3.4613, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (6.1245 => 6.3279, std.dev.: 0.0709)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.12% (3.3877 => 3.4934, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.99% (4.8739 => 5.0195, std.dev.: 0.0398)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.75% (1.3104 => 1.3464, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.48% (12.8625 => 13.1818, std.dev.: 0.0200)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.80% (3.3464 => 3.4068, std.dev.: 0.0004)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.61% (1.4398 => 1.4630, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.50% (5.0417 => 5.1171, std.dev.: 0.0016)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.80% (0.2237 => 0.1481, std.dev.: 0.0204)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.42% (1.5228 => 1.2118, std.dev.: 0.1168)
  MultiSource/Applications/hbd/hbd: -17.24% (2.0193 => 1.6712, std.dev.: 0.0296)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -15.68% (0.1518 => 0.1280, std.dev.: 0.0040)
  MultiSource/Applications/hexxagon/hexxagon: -15.27% (1.3285 => 1.1257, std.dev.: 0.0408)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -13.07% (0.0773 => 0.0672, std.dev.: 0.0032)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.93% (0.7091 => 0.6245, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.93% (0.1870 => 0.1647, std.dev.: 0.0023)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.35% (0.9461 => 0.8387, std.dev.: 0.0095)
  MultiSource/Applications/JM/ldecod/ldecod: -11.34% (8.6720 => 7.6887, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.42% (1.7797 => 1.5943, std.dev.: 0.0610)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.88% (0.3655 => 0.3294, std.dev.: 0.0018)
  MultiSource/Applications/sqlite3/sqlite3: -9.52% (19.1635 => 17.3400, std.dev.: 0.3629)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.21% (1.1012 => 0.9998, std.dev.: 0.0152)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.85% (0.2498 => 0.2302, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.10% (1.5144 => 1.4069, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.09% (1.5426 => 1.4333, std.dev.: 0.0231)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.98% (1.7461 => 1.6242, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.41% (1.4794 => 1.3845, std.dev.: 0.0125)
  MultiSource/Applications/JM/lencod/lencod: -6.11% (18.5029 => 17.3716, std.dev.: 0.1176)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.82% (1.4333 => 1.3499, std.dev.: 0.0264)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -5.61% (0.1784 => 0.1684, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.56% (1.5437 => 1.4578, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.44% (1.4853 => 1.4045, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.18% (1.5361 => 1.4565, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.10% (1.4940 => 1.4178, std.dev.: 0.0275)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.89% (1.4339 => 1.3638, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.47% (1.5629 => 1.4931, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.86% (1.4947 => 1.4370, std.dev.: 0.0126)
  MultiSource/Applications/lemon/lemon: -3.72% (1.2976 => 1.2493, std.dev.: 0.0120)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.45% (0.7189 => 0.6941, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.32% (1.5479 => 1.4965, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.18% (1.5416 => 1.5080, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.07% (1.4037 => 1.3746, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.60% (1.4179 => 1.3952, std.dev.: 0.0030)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -36.21% (1.4194 => 0.9055, std.dev.: 0.0450)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.23% (2.1022 => 1.4247, std.dev.: 0.0213)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.50% (0.0816 => 0.0559, std.dev.: 0.0008)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.10% (0.1189 => 0.0843, std.dev.: 0.0004)
  MultiSource/Applications/JM/ldecod/ldecod: -27.82% (0.0859 => 0.0620, std.dev.: 0.0014)
  MultiSource/Applications/viterbi/viterbi: -27.12% (3.4923 => 2.5451, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.64% (6.9552 => 5.2411, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/perlin: -21.42% (4.5989 => 3.6140, std.dev.: 0.0149)
  SingleSource/Benchmarks/Misc/mandel: -14.88% (1.1996 => 1.0211, std.dev.: 0.0280)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.55% (0.5173 => 0.4679, std.dev.: 0.0008)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.66% (0.3649 => 0.3333, std.dev.: 0.0031)
  MultiSource/Benchmarks/nbench/nbench: -7.20% (22.0083 => 20.4228, std.dev.: 0.1807)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.82% (3.8119 => 3.6282, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.72% (1.1024 => 1.0504, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc/fbench: -4.67% (4.9602 => 4.7284, std.dev.: 0.0181)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.37% (47.2250 => 45.1612, std.dev.: 0.6456)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.37% (2.7049 => 2.5867, std.dev.: 0.0257)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.28% (1.7207 => 1.6470, std.dev.: 0.0057)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.12% (21.6864 => 21.0098, std.dev.: 0.2406)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9612, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.83% (5.2218 => 5.0741, std.dev.: 0.0049)
  MultiSource/Applications/sqlite3/sqlite3: -2.69% (4.3833 => 4.2654, std.dev.: 0.0442)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.55% (0.7806 => 0.7607, std.dev.: 0.0051)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.44% (1.8144 => 1.7702, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc/oourafft: -2.27% (3.7891 => 3.7029, std.dev.: 0.0271)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.21% (2.6094 => 2.5517, std.dev.: 0.0199)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.01% (34.8438 => 34.1446, std.dev.: 0.0605)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.55% (5.0180 => 4.9400, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.47% (4.9231 => 4.8506, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.45% (5.8810 => 5.7958, std.dev.: 0.0157)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.27% (1.6737 => 1.6525, std.dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.24% (2.1343 => 2.1079, std.dev.: 0.0038)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.85% (0.1378 => 0.1325, std.dev.: 0.0016)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130814/e5b60d0e/attachment.html>


More information about the llvm-testresults mailing list