[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Aug 2 02:06:00 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14022?compare_to=14019&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14022, Order: 187644, Start Time: 2013-08-02 07:23:26, End Time: 2013-08-02 09:07:46
      To: 14019, Order: 187642, Start Time: 2013-08-02 05:18:02, End Time: 2013-08-02 07:02:09
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 5 (31 on baseline)
Performance Improvements: 3 (80 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1097 (994 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.39% (0.8346 => 0.9046, std.dev.: 0.0098)
  SingleSource/Regression/C/uint64_to_float: 4.59% (1.4581 => 1.5250, std.dev.: 0.0166)
  MultiSource/Applications/JM/lencod/lencod: 4.46% (8.3180 => 8.6891, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.33% (3.4008 => 3.5141, std.dev.: 0.0392)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.15% (4.9586 => 5.0154, std.dev.: 0.0106)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/McGill/misr: -4.40% (0.3887 => 0.3716, std.dev.: 0.0061)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.59% (2.4306 => 2.3676, std.dev.: 0.0162)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -2.42% (1.6363 => 1.5967, std.dev.: 0.0128)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: - (0.1393 => 0.1393, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.74% (0.2664 => 0.2737, std.dev.: 0.0620)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.17% (0.0183 => 0.0262, std.dev.: 0.0082)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.70% (0.2813 => 0.2737, std.dev.: 0.0620)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.06% (0.0345 => 0.0262, std.dev.: 0.0082)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.33% (0.1033 => 0.1212, std.dev.: 0.0003)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.16% (0.9941 => 1.0255, std.dev.: 0.0031)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.12% (3.7285 => 6.2310, std.dev.: 0.0941)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.53% (2.8867 => 4.2876, std.dev.: 0.0373)
  MultiSource/Benchmarks/FreeBench/neural/neural: 35.95% (0.3171 => 0.4311, std.dev.: 0.0396)
  SingleSource/Benchmarks/Shootout/hash: 23.92% (4.1846 => 5.1854, std.dev.: 0.3343)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 22.27% (0.0458 => 0.0560, std.dev.: 0.0022)
  MultiSource/Applications/JM/lencod/lencod: 21.02% (7.1799 => 8.6891, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/hash: 14.85% (0.6295 => 0.7230, std.dev.: 0.0349)
  MultiSource/Applications/siod/siod: 13.60% (3.3761 => 3.8352, std.dev.: 0.0306)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.92% (7.0762 => 7.9906, std.dev.: 0.0560)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.36% (0.1678 => 0.1835, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9478, std.dev.: 0.0199)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.92% (1.2557 => 1.3552, std.dev.: 0.0032)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.92% (48.3256 => 52.1518, std.dev.: 0.3481)
  SingleSource/Benchmarks/McGill/chomp: 7.75% (1.0051 => 1.0830, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.12% (3.2027 => 3.4308, std.dev.: 0.0037)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.29% (0.2799 => 0.2975, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.28% (5.5008 => 5.8461, std.dev.: 0.0859)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.89% (5.3042 => 5.6167, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.76% (3.4085 => 3.6047, std.dev.: 0.0297)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.75% (3.3877 => 3.5825, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.01% (3.3464 => 3.5141, std.dev.: 0.0392)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.44% (4.3151 => 4.5068, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3653, std.dev.: 0.0756)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.73% (3.3384 => 3.4630, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/whetstone: 3.72% (3.4559 => 3.5846, std.dev.: 0.0194)
  SingleSource/Benchmarks/Misc/ffbench: 3.69% (1.3679 => 1.4184, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.04% (4.8739 => 5.0220, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.27% (4.9040 => 5.0154, std.dev.: 0.0106)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.39% (1.1618 => 1.1779, std.dev.: 0.0003)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.82% (0.2237 => 0.1458, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/tsp/tsp: -25.80% (0.1818 => 0.1349, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -23.26% (0.0675 => 0.0518, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -22.78% (0.0439 => 0.0339, std.dev.: 0.0028)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.28% (6.0938 => 4.7364, std.dev.: 0.0152)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.17% (0.1114 => 0.0867, std.dev.: 0.0089)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.84% (1.5228 => 1.2055, std.dev.: 0.0013)
  MultiSource/Applications/obsequi/Obsequi: -20.52% (1.4685 => 1.1672, std.dev.: 0.0066)
  MultiSource/Applications/hbd/hbd: -17.43% (2.0193 => 1.6674, std.dev.: 0.0048)
  MultiSource/Applications/lua/lua: -17.41% (5.3200 => 4.3939, std.dev.: 0.0169)
  MultiSource/Applications/hexxagon/hexxagon: -16.03% (1.3285 => 1.1156, std.dev.: 0.0058)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -14.20% (1.3985 => 1.1999, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -13.97% (0.0773 => 0.0665, std.dev.: 0.0018)
  MultiSource/Applications/sgefa/sgefa: -13.20% (0.4809 => 0.4174, std.dev.: 0.0062)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.89% (0.9461 => 0.8336, std.dev.: 0.0050)
  MultiSource/Applications/ClamAV/clamscan: -11.68% (19.4145 => 17.1473, std.dev.: 0.0477)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -11.57% (0.1141 => 0.1009, std.dev.: 0.0022)
  MultiSource/Applications/JM/ldecod/ldecod: -11.24% (8.6720 => 7.6969, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.38% (1.7797 => 1.5949, std.dev.: 0.0221)
  MultiSource/Applications/sqlite3/sqlite3: -9.27% (19.1635 => 17.3869, std.dev.: 0.1027)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.45% (1.4514 => 1.3433, std.dev.: 0.0369)
  MultiSource/Applications/kimwitu++/kc: -7.43% (21.0770 => 19.5112, std.dev.: 0.3645)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.22% (1.5426 => 1.4313, std.dev.: 0.0241)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.88% (1.7461 => 1.6260, std.dev.: 0.0058)
  MultiSource/Applications/Burg/burg: -6.85% (1.5733 => 1.4656, std.dev.: 0.0124)
  MultiSource/Applications/siod/siod: -6.62% (2.7150 => 2.5353, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.50% (1.4794 => 1.3833, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.43% (1.5144 => 1.4170, std.dev.: 0.0272)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.25% (1.4333 => 1.3437, std.dev.: 0.0180)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.22% (6.1631 => 5.7795, std.dev.: 0.0301)
  MultiSource/Applications/JM/lencod/lencod: -5.78% (18.5029 => 17.4333, std.dev.: 0.0247)
  MultiSource/Applications/minisat/minisat: -5.75% (0.8278 => 0.7802, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.27% (1.5239 => 1.4436, std.dev.: 0.0093)
  MultiSource/Applications/oggenc/oggenc: -5.05% (6.1121 => 5.8035, std.dev.: 0.0022)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.02% (27.6418 => 26.2532, std.dev.: 0.5359)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.85% (1.4506 => 1.3803, std.dev.: 0.0158)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -4.61% (0.2432 => 0.2320, std.dev.: 0.0018)
  MultiSource/Applications/lemon/lemon: -4.58% (1.2976 => 1.2382, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.16% (1.4339 => 1.3743, std.dev.: 0.0112)
  MultiSource/Applications/SPASS/SPASS: -3.87% (17.9111 => 17.2177, std.dev.: 0.0383)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.59% (1.5629 => 1.5068, std.dev.: 0.0172)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.98% (1.3780 => 1.3370, std.dev.: 0.0136)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.72% (0.5634 => 0.5481, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.42% (10.3031 => 10.0540, std.dev.: 0.0870)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.84% (0.7487 => 0.7349, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.78% (1.5544 => 1.5267, std.dev.: 0.0032)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.95% (1.4194 => 0.8808, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.64% (0.0816 => 0.0517, std.dev.: 0.0042)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.86% (2.1022 => 1.4115, std.dev.: 0.0071)
  MultiSource/Benchmarks/MallocBench/gs/gs: -27.59% (0.1189 => 0.0861, std.dev.: 0.0002)
  MultiSource/Applications/viterbi/viterbi: -27.48% (3.4923 => 2.5325, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -23.98% (6.9552 => 5.2874, std.dev.: 0.3269)
  MultiSource/Applications/JM/ldecod/ldecod: -22.35% (0.0859 => 0.0667, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/perlin: -21.50% (4.5989 => 3.6101, std.dev.: 0.0022)
  MultiSource/Applications/minisat/minisat: -21.23% (8.0162 => 6.3143, std.dev.: 0.0425)
  MultiSource/Applications/obsequi/Obsequi: -15.84% (2.6081 => 2.1949, std.dev.: 0.0163)
  SingleSource/Benchmarks/Misc/mandel: -14.67% (1.1996 => 1.0236, std.dev.: 0.0165)
  MultiSource/Applications/sgefa/sgefa: -13.41% (1.4030 => 1.2149, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.68% (0.3557 => 0.3106, std.dev.: 0.0111)
  MultiSource/Benchmarks/mafft/pairlocalalign: -12.13% (47.2250 => 41.4956, std.dev.: 1.6436)
  MultiSource/Applications/SPASS/SPASS: -11.89% (9.2220 => 8.1252, std.dev.: 0.0947)
  MultiSource/Applications/SIBsim4/SIBsim4: -10.35% (3.5791 => 3.2086, std.dev.: 0.0673)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.17% (0.5173 => 0.4647, std.dev.: 0.0083)
  MultiSource/Applications/lua/lua: -8.66% (31.0707 => 28.3797, std.dev.: 0.5900)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.13% (1.7207 => 1.6325, std.dev.: 0.0273)
  SingleSource/Benchmarks/Misc/fbench: -4.63% (4.9602 => 4.7307, std.dev.: 0.0299)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.51% (0.7355 => 0.7023, std.dev.: 0.0016)
  MultiSource/Benchmarks/Bullet/bullet: -4.22% (7.2995 => 6.9917, std.dev.: 0.0468)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.08% (2.8052 => 2.6907, std.dev.: 0.0324)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.07% (2.7049 => 2.5948, std.dev.: 0.0357)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.84% (1.3148 => 1.2643, std.dev.: 0.0174)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.71% (1.1024 => 1.0615, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.49% (6.0444 => 5.8335, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.28% (5.2218 => 5.0506, std.dev.: 0.0120)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.12% (0.4783 => 0.4634, std.dev.: 0.0043)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.03% (21.6864 => 21.0290, std.dev.: 0.2117)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9621, std.dev.: 0.0257)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -2.51% (1.5112 => 1.4732, std.dev.: 0.0125)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.18% (0.5097 => 0.4986, std.dev.: 0.0029)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.91% (34.8438 => 34.1794, std.dev.: 0.0756)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.09% (0.1378 => 0.1393, std.dev.: 0.0034)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130802/18b34f78/attachment.html>


More information about the llvm-testresults mailing list