[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 26 23:10:44 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14828?compare_to=14824&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14828, Order: 189306, Start Time: 2013-08-27 04:16:36, End Time: 2013-08-27 06:12:57
      To: 14824, Order: 189303, Start Time: 2013-08-27 02:10:23, End Time: 2013-08-27 03:54:53
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 25 (54 on baseline)
Performance Improvements: 3 (21 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1079 (1032 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: 53.85% (0.0728 => 0.1120, std.dev.: 0.0064)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 46.07% (0.0853 => 0.1246, std.dev.: 0.0128)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 44.52% (0.1406 => 0.2032, std.dev.: 0.0099)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 39.36% (1.3372 => 1.8635, std.dev.: 0.0431)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 37.42% (0.2322 => 0.3191, std.dev.: 0.0110)
  MultiSource/Applications/lua/lua: 33.38% (4.4066 => 5.8776, std.dev.: 0.1371)
  MultiSource/Benchmarks/Olden/tsp/tsp: 33.36% (0.1391 => 0.1855, std.dev.: 0.0172)
  MultiSource/Applications/spiff/spiff: 23.42% (0.9560 => 1.1799, std.dev.: 0.0606)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 21.36% (1.5091 => 1.8315, std.dev.: 0.0868)
  MultiSource/Applications/siod/siod: 18.59% (2.5302 => 3.0006, std.dev.: 0.0943)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.38% (1.3339 => 1.5390, std.dev.: 0.0626)
  MultiSource/Applications/SPASS/SPASS: 12.47% (17.1874 => 19.3304, std.dev.: 0.6982)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.66% (0.1763 => 0.1951, std.dev.: 0.0012)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 86.77% (0.7738 => 1.4452, std.dev.: 0.1482)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.41% (0.3155 => 0.4146, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.25% (1.4788 => 1.8817, std.dev.: 0.0186)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.16% (4.1275 => 4.8356, std.dev.: 0.0123)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.02% (14.6462 => 16.8458, std.dev.: 0.1739)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.27% (1.1874 => 1.3212, std.dev.: 0.0243)
  SingleSource/Benchmarks/Misc/lowercase: 8.54% (0.7692 => 0.8349, std.dev.: 0.0101)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.65% (2.3325 => 2.4642, std.dev.: 0.0257)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.18% (3.4547 => 3.6337, std.dev.: 0.0115)
  MultiSource/Applications/siod/siod: 2.46% (3.5297 => 3.6166, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.03% (11.3986 => 11.6302, std.dev.: 0.0223)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.55% (3.5647 => 3.6198, std.dev.: 0.0105)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.66% (6.0206 => 5.4392, std.dev.: 0.0085)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.58% (1.6958 => 1.6521, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.38% (6.6669 => 6.5746, std.dev.: 0.0264)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.85% (0.1289 => 0.1300, std.dev.: 0.0344)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 37.39% (0.1479 => 0.2032, std.dev.: 0.0099)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 35.23% (1.3780 => 1.8635, std.dev.: 0.0431)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 31.21% (0.2432 => 0.3191, std.dev.: 0.0110)
  MultiSource/Applications/spiff/spiff: 23.19% (0.9578 => 1.1799, std.dev.: 0.0606)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.66% (1.4932 => 1.8315, std.dev.: 0.0868)
  MultiSource/Benchmarks/FreeBench/distray/distray: 20.33% (0.1033 => 0.1243, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/oourafft: 16.16% (0.2284 => 0.2653, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.76% (1.3649 => 1.5390, std.dev.: 0.0626)
  MultiSource/Applications/siod/siod: 10.52% (2.7150 => 3.0006, std.dev.: 0.0943)
  MultiSource/Applications/lua/lua: 10.48% (5.3200 => 5.8776, std.dev.: 0.1371)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.81% (0.1793 => 0.1951, std.dev.: 0.0012)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.68% (0.9941 => 1.0804, std.dev.: 0.0314)
  MultiSource/Benchmarks/sim/sim: 5.51% (0.3808 => 0.4018, std.dev.: 0.0081)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 76.33% (3.7285 => 6.5746, std.dev.: 0.0264)
  MultiSource/Benchmarks/FreeBench/neural/neural: 38.44% (0.3171 => 0.4390, std.dev.: 0.0123)
  SingleSource/Benchmarks/Shootout/hash: 26.02% (4.1846 => 5.2733, std.dev.: 0.3194)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.20% (1.5030 => 1.8817, std.dev.: 0.0186)
  SingleSource/Benchmarks/Shootout-C++/hash: 22.67% (0.6295 => 0.7722, std.dev.: 0.0433)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.80% (9.6817 => 11.7921, std.dev.: 0.0621)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.53% (3.0680 => 3.6059, std.dev.: 0.0136)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.56% (0.3557 => 0.4146, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.75% (4.6576 => 5.3446, std.dev.: 0.0372)
  MultiSource/Applications/sgefa/sgefa: 13.52% (1.4030 => 1.5927, std.dev.: 0.0496)
  MultiSource/Benchmarks/Olden/tsp/tsp: 13.31% (1.5339 => 1.7380, std.dev.: 0.0535)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.62% (14.9584 => 16.8458, std.dev.: 0.1739)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.02% (4.9231 => 5.5150, std.dev.: 0.1157)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.18% (7.0762 => 7.8675, std.dev.: 0.0075)
  MultiSource/Applications/JM/lencod/lencod: 10.57% (7.1799 => 7.9385, std.dev.: 0.1904)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.99% (1.2012 => 1.3212, std.dev.: 0.0243)
  SingleSource/Benchmarks/Shootout/ary3: 9.97% (5.8158 => 6.3956, std.dev.: 0.0536)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.58% (5.4910 => 6.0169, std.dev.: 0.1072)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.29% (2.9467 => 3.2205, std.dev.: 0.0142)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.13% (1.2557 => 1.3704, std.dev.: 0.0172)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.35% (48.3256 => 52.3594, std.dev.: 0.4437)
  MultiSource/Applications/siod/siod: 7.12% (3.3761 => 3.6166, std.dev.: 0.0313)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.43% (3.7593 => 4.0012, std.dev.: 0.0157)
  SingleSource/Benchmarks/Misc/lowercase: 6.37% (0.7849 => 0.8349, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.93% (3.3464 => 3.5448, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.79% (3.4085 => 3.6060, std.dev.: 0.0620)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.60% (5.5008 => 5.8091, std.dev.: 0.0837)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.58% (4.9040 => 5.1777, std.dev.: 0.0325)
  SingleSource/Benchmarks/McGill/queens: 4.34% (1.6536 => 1.7254, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.28% (5.1471 => 5.3672, std.dev.: 0.0204)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.51% (25.0200 => 25.8987, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.44% (4.8739 => 5.0417, std.dev.: 0.0264)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (6.1245 => 6.3211, std.dev.: 0.0491)
  SingleSource/Benchmarks/Misc/whetstone: 3.21% (3.4559 => 3.5668, std.dev.: 0.0292)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.13% (2.3894 => 2.4642, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.03% (12.8625 => 13.2518, std.dev.: 0.1054)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.72% (1.3104 => 1.3461, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.40% (3.5351 => 3.6198, std.dev.: 0.0105)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.53% (3.5791 => 3.6337, std.dev.: 0.0115)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.42% (1.1618 => 1.1783, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.11% (5.8810 => 5.9464, std.dev.: 0.0137)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.42% (2.1022 => 1.4206, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -28.43% (0.0816 => 0.0584, std.dev.: 0.0021)
  MultiSource/Applications/viterbi/viterbi: -26.63% (3.4923 => 2.5622, std.dev.: 0.0280)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6171, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -15.37% (5.3098 => 4.4937, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.15% (6.2627 => 5.4392, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc/mandel: -12.62% (1.1996 => 1.0482, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.59% (6.9552 => 6.4971, std.dev.: 0.1055)
  SingleSource/Benchmarks/Misc/fp-convert: -5.98% (8.0730 => 7.5899, std.dev.: 0.1090)
  SingleSource/Benchmarks/Shootout/matrix: -4.99% (1.7358 => 1.6491, std.dev.: 0.0228)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.84% (0.7355 => 0.6999, std.dev.: 0.0135)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.06% (21.6864 => 20.8055, std.dev.: 0.1838)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.04% (3.8119 => 3.6580, std.dev.: 0.0438)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.65% (0.2849 => 0.2745, std.dev.: 0.0034)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.27% (0.7806 => 0.7551, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.27% (1.1024 => 1.0664, std.dev.: 0.0136)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.15% (2.7049 => 2.6197, std.dev.: 0.0268)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.91% (6.0444 => 5.8687, std.dev.: 0.0404)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.62% (6.1482 => 5.9874, std.dev.: 0.0263)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.39% (47.2250 => 46.0971, std.dev.: 0.2657)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.03% (34.8438 => 34.1382, std.dev.: 0.1708)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.66% (0.1378 => 0.1300, std.dev.: 0.0344)

Report Time: 1.12s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130827/d373f799/attachment.html>


More information about the llvm-testresults mailing list