[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 12 11:31:05 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12315?compare_to=12311&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12315, Order: 183842, Start Time: 2013-06-12 16:42:28, End Time: 2013-06-12 18:31:55
      To: 12311, Order: 183826, Start Time: 2013-06-12 14:30:29, End Time: 2013-06-12 16:22:16
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 19 (25 on baseline)
Performance Improvements: 26 (28 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1062 (1054 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 45.91% (0.0220 => 0.0321, std.dev.: 0.0021)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 38.19% (0.9699 => 1.3403, std.dev.: 0.0942)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 26.84% (0.0503 => 0.0638, std.dev.: 0.0027)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.05% (0.0507 => 0.0634, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.49% (1.7093 => 1.8544, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.93% (1.5482 => 1.6710, std.dev.: 0.0071)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.96% (25.7429 => 27.5358, std.dev.: 0.1316)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.40% (1.4223 => 1.5133, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.58% (1.6616 => 1.7544, std.dev.: 0.0359)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.27% (1.4301 => 1.4912, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.93% (1.5147 => 1.5742, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.88% (1.4549 => 1.5114, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.44% (1.5995 => 1.6545, std.dev.: 0.0174)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.97% (2.3180 => 2.9664, std.dev.: 0.1800)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.69% (3.2615 => 3.3818, std.dev.: 0.0103)
  MultiSource/Applications/spiff/spiff: 3.46% (2.8556 => 2.9544, std.dev.: 0.0217)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.44% (39.6377 => 40.6057, std.dev.: 0.2527)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.28% (9.1056 => 9.3133, std.dev.: 0.0177)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (42.8245 => 43.4900, std.dev.: 0.0408)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -37.59% (0.1458 => 0.0910, std.dev.: 0.0136)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -36.83% (0.1773 => 0.1120, std.dev.: 0.0169)
  SingleSource/Benchmarks/Shootout-C++/fibo: -33.52% (0.3100 => 0.2061, std.dev.: 0.0246)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -30.42% (0.3307 => 0.2301, std.dev.: 0.0221)
  SingleSource/UnitTests/Vector/constpool: -28.93% (12.4669 => 8.8606, std.dev.: 1.3665)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -27.69% (1.6289 => 1.1779, std.dev.: 0.0118)
  SingleSource/Benchmarks/Shootout-C++/wc: -25.57% (0.3258 => 0.2425, std.dev.: 0.0130)
  MultiSource/Benchmarks/Olden/power/power: -25.36% (0.1999 => 0.1492, std.dev.: 0.0049)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -25.29% (1.7562 => 1.3120, std.dev.: 0.1069)
  MultiSource/Benchmarks/Olden/health/health: -24.33% (0.2092 => 0.1583, std.dev.: 0.0141)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.47% (1.4865 => 1.1822, std.dev.: 0.0229)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -18.03% (0.2612 => 0.2141, std.dev.: 0.0105)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -17.26% (0.2138 => 0.1769, std.dev.: 0.0112)
  MultiSource/Applications/lua/lua: -17.12% (5.2649 => 4.3635, std.dev.: 0.0665)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.05% (0.1056 => 0.0876, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/sieve: -7.54% (0.3367 => 0.3113, std.dev.: 0.0073)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.60% (0.1911 => 0.1804, std.dev.: 0.0028)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -34.86% (0.1331 => 0.0867, std.dev.: 0.0163)
  MultiSource/Applications/minisat/minisat: -22.25% (8.0362 => 6.2483, std.dev.: 0.5642)
  MultiSource/Benchmarks/McCat/08-main/main: -18.74% (0.0859 => 0.0698, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/lists1: -15.63% (0.7187 => 0.6064, std.dev.: 0.0397)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -5.91% (4.2882 => 4.0346, std.dev.: 0.0854)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -4.84% (4.1713 => 3.9696, std.dev.: 0.0295)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.28% (2.5579 => 2.4741, std.dev.: 0.0275)
  SingleSource/Benchmarks/Shootout-C++/methcall: -1.20% (11.6760 => 11.5355, std.dev.: 0.0491)
  SingleSource/Benchmarks/Misc/flops-8: -1.14% (2.5935 => 2.5640, std.dev.: 0.0079)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -11.51% (0.1677 => 0.1484, std.dev.: 0.0077)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 50.70% (0.0213 => 0.0321, std.dev.: 0.0021)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 34.51% (0.9964 => 1.3403, std.dev.: 0.0942)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 26.59% (0.0504 => 0.0638, std.dev.: 0.0027)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 23.11% (0.0515 => 0.0634, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.13% (1.6993 => 1.8544, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.96% (1.5478 => 1.6710, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.47% (1.4081 => 1.5133, std.dev.: 0.0284)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.17% (25.9348 => 27.5358, std.dev.: 0.1316)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2295 => 0.2422, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.00% (1.4202 => 1.4912, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.34% (1.4485 => 1.5114, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.20% (1.5108 => 1.5742, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.51% (1.5984 => 1.6545, std.dev.: 0.0174)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 17.78% (1.1695 => 1.3774, std.dev.: 0.0415)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.09% (5.2003 => 5.6210, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.17% (3.1853 => 3.3818, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.82% (3.2201 => 3.3754, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.80% (4.6639 => 4.8878, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.08% (5.2788 => 5.4942, std.dev.: 0.0584)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.05% (5.9362 => 6.1765, std.dev.: 0.0113)
  MultiSource/Applications/spiff/spiff: 3.53% (2.8536 => 2.9544, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.14% (5.5010 => 5.6739, std.dev.: 0.0174)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.29% (4.3727 => 4.4730, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.97% (5.6582 => 5.7697, std.dev.: 0.0185)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.71% (39.9248 => 40.6057, std.dev.: 0.2527)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.94% (0.0803 => 0.0675, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.07% (0.2006 => 0.1804, std.dev.: 0.0028)
  MultiSource/Applications/aha/aha: -7.96% (0.1407 => 0.1295, std.dev.: 0.0034)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.24% (1.2911 => 0.7328, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.44% (4.4050 => 3.2404, std.dev.: 0.0584)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.37% (6.2328 => 5.0258, std.dev.: 0.0306)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.04% (25.3677 => 21.2989, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/salsa20: -13.12% (10.3398 => 8.9829, std.dev.: 0.0142)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.02% (48.3307 => 43.4900, std.dev.: 0.0408)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.06% (3.5327 => 3.2127, std.dev.: 0.1180)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.42% (1.6679 => 1.5274, std.dev.: 0.0373)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.76% (3.2030 => 2.9545, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.66% (5.5889 => 5.2165, std.dev.: 0.1302)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.50% (4.5717 => 4.2746, std.dev.: 0.0334)
  MultiSource/Applications/sqlite3/sqlite3: -6.40% (4.6358 => 4.3393, std.dev.: 0.0812)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.67% (9.8728 => 9.3133, std.dev.: 0.0177)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.16% (9.1099 => 8.7307, std.dev.: 0.0582)
  MultiSource/Applications/hexxagon/hexxagon: -4.02% (15.4979 => 14.8754, std.dev.: 0.0786)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.84% (5.3184 => 5.1142, std.dev.: 0.0506)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.63% (5.3276 => 5.1340, std.dev.: 0.0672)
  SingleSource/Benchmarks/Misc/flops: -3.55% (10.2170 => 9.8548, std.dev.: 0.0400)
  SingleSource/Benchmarks/Shootout/sieve: -2.97% (8.0178 => 7.7798, std.dev.: 0.0440)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.86% (3.8665 => 3.7560, std.dev.: 0.0260)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.75% (8.5243 => 8.3755, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (4.2167 => 4.1453, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.64% (5.4801 => 5.3900, std.dev.: 0.0280)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.37% (12.1841 => 12.0173, std.dev.: 0.0541)
  MultiSource/Applications/aha/aha: -1.06% (3.6251 => 3.5865, std.dev.: 0.0030)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.98% (0.1441 => 0.1484, std.dev.: 0.0077)

Report Time: 1.36s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130612/cc86dc99/attachment.html>


More information about the llvm-testresults mailing list