[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 7 16:50:31 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14193?compare_to=14189&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14193, Order: 187914, Start Time: 2013-08-07 21:57:37, End Time: 2013-08-07 23:52:22
      To: 14189, Order: 187899, Start Time: 2013-08-07 19:39:17, End Time: 2013-08-07 21:30:07
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 32 (60 on baseline)
Performance Improvements: 5 (25 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1068 (1020 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2004-02-03-AggregateCopy: 69.68% (0.0155 => 0.0263, std.dev.: 0.0008)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 61.71% (0.0525 => 0.0849, std.dev.: 0.0070)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 53.42% (0.0760 => 0.1166, std.dev.: 0.0075)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 48.91% (0.1736 => 0.2585, std.dev.: 0.0190)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 44.61% (0.0538 => 0.0778, std.dev.: 0.0085)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 40.36% (0.0882 => 0.1238, std.dev.: 0.0109)
  MultiSource/Applications/sgefa/sgefa: 30.20% (0.4165 => 0.5423, std.dev.: 0.0446)
  MultiSource/Applications/Burg/burg: 22.78% (1.4896 => 1.8290, std.dev.: 0.1103)
  MultiSource/Applications/JM/ldecod/ldecod: 17.89% (7.7206 => 9.1019, std.dev.: 0.2739)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.15% (26.6174 => 29.8505, std.dev.: 1.2013)
  MultiSource/Applications/oggenc/oggenc: 11.26% (5.8212 => 6.4768, std.dev.: 0.0440)
  MultiSource/Applications/kimwitu++/kc: 11.15% (19.7514 => 21.9541, std.dev.: 0.3613)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.37% (1.4840 => 1.6231, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.29% (1.3920 => 1.5213, std.dev.: 0.0435)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.72% (1.4021 => 1.5243, std.dev.: 0.0391)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.54% (1.4904 => 1.6028, std.dev.: 0.0137)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.58% (0.2628 => 0.2801, std.dev.: 0.0017)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (10.9783 => 11.0991, std.dev.: 0.0441)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: 38.10% (1.2549 => 1.7330, std.dev.: 0.0260)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.94% (0.0556 => 0.0678, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 20.24% (37.2942 => 44.8423, std.dev.: 1.2871)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 11.34% (2.9688 => 3.3054, std.dev.: 0.0199)
  MultiSource/Benchmarks/Olden/em3d/em3d: 9.76% (4.7133 => 5.1732, std.dev.: 0.0372)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.63% (2.9992 => 3.1681, std.dev.: 0.0398)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.40% (4.0600 => 4.2793, std.dev.: 0.0602)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.57% (3.2883 => 3.4387, std.dev.: 0.0103)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.23% (1.2922 => 1.3469, std.dev.: 0.0089)
  MultiSource/Applications/JM/lencod/lencod: 4.05% (7.6946 => 8.0065, std.dev.: 0.0600)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 3.82% (5.8259 => 6.0487, std.dev.: 0.0043)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.84% (1.6530 => 1.7000, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.64% (3.6134 => 3.6728, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.33% (5.0164 => 5.0832, std.dev.: 0.0236)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.52% (1.7107 => 1.6163, std.dev.: 0.0229)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -11.47% (0.0968 => 0.0857, std.dev.: 0.0038)
  MultiSource/Applications/obsequi/Obsequi: -6.30% (2.2727 => 2.1295, std.dev.: 0.0117)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -3.24% (4.3053 => 4.1656, std.dev.: 0.0458)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.57% (3.5906 => 3.4985, std.dev.: 0.0220)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: 2.86% (0.1329 => 0.1367, std.dev.: 0.0141)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.73% (0.2733 => 0.2753, std.dev.: 0.0297)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.41% (0.0272 => 0.0284, std.dev.: 0.0070)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.13% (0.2813 => 0.2753, std.dev.: 0.0297)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.68% (0.0345 => 0.0284, std.dev.: 0.0070)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2004-02-03-AggregateCopy: 75.33% (0.0150 => 0.0263, std.dev.: 0.0008)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 57.81% (0.0538 => 0.0849, std.dev.: 0.0070)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 49.34% (0.1731 => 0.2585, std.dev.: 0.0190)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 49.10% (0.0782 => 0.1166, std.dev.: 0.0075)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 41.16% (0.0877 => 0.1238, std.dev.: 0.0109)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 11.94% (0.0955 => 0.1069, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.61% (1.3630 => 1.5213, std.dev.: 0.0435)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.27% (1.4179 => 1.5777, std.dev.: 0.0546)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.84% (0.2527 => 0.2801, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.25% (1.3826 => 1.5243, std.dev.: 0.0391)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.71% (0.3604 => 0.3918, std.dev.: 0.0065)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 8.41% (0.2437 => 0.2642, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.23% (1.4947 => 1.6028, std.dev.: 0.0137)
  MultiSource/Applications/oggenc/oggenc: 5.97% (6.1121 => 6.4768, std.dev.: 0.0440)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.66% (1.5361 => 1.6231, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.70% (1.5437 => 1.6163, std.dev.: 0.0229)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.26% (10.8541 => 11.0991, std.dev.: 0.0441)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.26% (3.7285 => 6.4599, std.dev.: 0.0463)
  SingleSource/Benchmarks/Shootout-C++/matrix: 51.30% (2.8867 => 4.3677, std.dev.: 0.1485)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 38.00% (1.2558 => 1.7330, std.dev.: 0.0260)
  MultiSource/Benchmarks/FreeBench/neural/neural: 37.05% (0.3171 => 0.4346, std.dev.: 0.0341)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 28.90% (0.0526 => 0.0678, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.38% (1.5030 => 1.8995, std.dev.: 0.0070)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.93% (0.0686 => 0.0857, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout/hash: 24.80% (4.1846 => 5.2225, std.dev.: 0.3502)
  SingleSource/Benchmarks/Shootout-C++/hash: 23.05% (0.6295 => 0.7746, std.dev.: 0.0400)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.56% (36.8900 => 44.8423, std.dev.: 1.2871)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.10% (14.9584 => 16.7691, std.dev.: 0.1878)
  MultiSource/Applications/JM/lencod/lencod: 11.51% (7.1799 => 8.0065, std.dev.: 0.0600)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.18% (7.0762 => 7.8674, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.32% (2.9962 => 3.3054, std.dev.: 0.0199)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.88% (0.1678 => 0.1827, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.67% (5.4910 => 5.9668, std.dev.: 0.0350)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.30% (3.2027 => 3.4685, std.dev.: 0.0312)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.91% (48.3256 => 52.1492, std.dev.: 0.1139)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.75% (3.4085 => 3.6728, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.15% (2.9568 => 3.1681, std.dev.: 0.0398)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.06% (9.1355 => 9.7807, std.dev.: 0.2368)
  MultiSource/Applications/siod/siod: 6.89% (3.3761 => 3.6088, std.dev.: 0.0581)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.78% (4.0075 => 4.2793, std.dev.: 0.0602)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.20% (5.5008 => 5.8417, std.dev.: 0.0853)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.17% (5.3042 => 5.6317, std.dev.: 0.0403)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.15% (0.2799 => 0.2971, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.80% (3.3384 => 3.4985, std.dev.: 0.0220)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.71% (4.3151 => 4.5183, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.65% (5.1471 => 5.3862, std.dev.: 0.0261)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.61% (6.1245 => 6.3453, std.dev.: 0.0470)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 3.59% (5.8390 => 6.0487, std.dev.: 0.0043)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.48% (25.0200 => 25.8918, std.dev.: 0.0458)
  SingleSource/Benchmarks/Misc/whetstone: 3.35% (3.4559 => 3.5716, std.dev.: 0.0199)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.24% (3.5351 => 3.6496, std.dev.: 0.0281)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.13% (4.8739 => 5.0263, std.dev.: 0.0407)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.10% (1.5956 => 1.6450, std.dev.: 0.0109)
  MultiSource/Applications/spiff/spiff: 2.91% (2.7609 => 2.8412, std.dev.: 0.0176)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.79% (1.3104 => 1.3469, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.24% (3.0680 => 3.1368, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.19% (12.8625 => 13.1447, std.dev.: 0.0566)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.67% (4.9995 => 5.0832, std.dev.: 0.0236)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.57% (1.6737 => 1.7000, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.13% (11.5371 => 11.6678, std.dev.: 0.0236)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -30.04% (0.2237 => 0.1565, std.dev.: 0.0174)
  MultiSource/Applications/obsequi/Obsequi: -18.61% (1.4685 => 1.1952, std.dev.: 0.0110)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.85% (0.1518 => 0.1247, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -15.91% (0.3576 => 0.3007, std.dev.: 0.0194)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.04% (2.1022 => 1.4287, std.dev.: 0.0222)
  MultiSource/Applications/viterbi/viterbi: -26.73% (3.4923 => 2.5587, std.dev.: 0.1653)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -23.66% (6.9552 => 5.3099, std.dev.: 0.0642)
  SingleSource/Benchmarks/Misc/perlin: -21.36% (4.5989 => 3.6165, std.dev.: 0.0032)
  MultiSource/Applications/obsequi/Obsequi: -18.35% (2.6081 => 2.1295, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.79% (6.2627 => 5.3993, std.dev.: 0.2806)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.46% (0.0884 => 0.0765, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/mandel: -13.04% (1.1996 => 1.0432, std.dev.: 0.0099)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.07% (47.2250 => 44.8295, std.dev.: 0.2609)
  SingleSource/Benchmarks/Misc/fbench: -4.30% (4.9602 => 4.7470, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.06% (3.8119 => 3.6570, std.dev.: 0.0346)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.92% (3.5791 => 3.4387, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.41% (6.0444 => 5.8380, std.dev.: 0.0406)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.18% (1.7207 => 1.6659, std.dev.: 0.0137)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.16% (21.6864 => 21.0021, std.dev.: 0.2051)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.01% (0.4783 => 0.4639, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.99% (6.1482 => 5.9646, std.dev.: 0.0437)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.57% (34.8438 => 34.2984, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.51% (5.2218 => 5.1428, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.29% (4.9231 => 4.8594, std.dev.: 0.0115)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.01% (2.1343 => 2.1127, std.dev.: 0.0018)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.80% (0.1378 => 0.1367, std.dev.: 0.0141)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130807/e73d7889/attachment.html>


More information about the llvm-testresults mailing list