[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Oct 5 05:10:34 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15998?compare_to=15994&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15998, Order: 192029, Start Time: 2013-10-05 10:29:42, End Time: 2013-10-05 12:13:31
      To: 15994, Order: 192027, Start Time: 2013-10-05 08:20:24, End Time: 2013-10-05 10:05:54
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 11 (63 on baseline)
Performance Improvements: 5 (25 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1091 (1019 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.62% (1.2940 => 1.3150, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.45% (10.7643 => 11.8890, std.dev.: 0.1222)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.15% (5.4231 => 5.6479, std.dev.: 0.0049)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.73% (2.1332 => 2.2128, std.dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.57% (1.0321 => 1.0689, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.12% (0.3688 => 0.3803, std.dev.: 0.0008)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.85% (2.4733 => 2.5439, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.76% (3.7562 => 3.8598, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.97% (5.8806 => 5.9967, std.dev.: 0.0061)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.95% (2.5346 => 2.5839, std.dev.: 0.0164)
  MultiSource/Benchmarks/sim/sim: 1.35% (4.0115 => 4.0657, std.dev.: 0.0043)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/siod/siod: -1.79% (2.5541 => 2.5085, std.dev.: 0.0110)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.62% (1.3119 => 1.2907, std.dev.: 0.0054)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.49% (1.1717 => 1.1543, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.05% (9.7780 => 9.6751, std.dev.: 0.0377)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/minisat/minisat: -1.15% (6.3709 => 6.2979, std.dev.: 0.0247)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1349 => 0.1350, std.dev.: 0.0005)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: 15.12% (0.2949 => 0.3395, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.02% (0.4624 => 0.4810, std.dev.: 0.0026)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.15% (2.6492 => 2.7327, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.93% (1.3365 => 1.3756, std.dev.: 0.0012)
  MultiSource/Applications/lemon/lemon: 2.71% (1.1862 => 1.2184, std.dev.: 0.0007)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.65% (1.5333 => 1.5739, std.dev.: 0.0004)
  MultiSource/Applications/sqlite3/sqlite3: 2.60% (16.2888 => 16.7116, std.dev.: 0.0835)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.51% (0.8014 => 0.8215, std.dev.: 0.0056)
  MultiSource/Applications/siod/siod: 2.47% (2.4480 => 2.5085, std.dev.: 0.0110)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.9828 => 1.0050, std.dev.: 0.0013)
  MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.4026 => 7.5574, std.dev.: 0.0231)
  MultiSource/Applications/oggenc/oggenc: 2.08% (5.3339 => 5.4449, std.dev.: 0.0076)
  MultiSource/Applications/treecc/treecc: 2.01% (2.2516 => 2.2969, std.dev.: 0.0066)
  MultiSource/Applications/kimwitu++/kc: 1.94% (18.3608 => 18.7179, std.dev.: 0.0365)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (14.4764 => 14.7563, std.dev.: 0.0461)
  MultiSource/Applications/JM/lencod/lencod: 1.76% (16.5902 => 16.8816, std.dev.: 0.0644)
  MultiSource/Applications/SPASS/SPASS: 1.62% (16.1646 => 16.4260, std.dev.: 0.0538)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (7.2661 => 7.3821, std.dev.: 0.0439)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.52% (1.4304 => 1.4521, std.dev.: 0.0006)
  MultiSource/Benchmarks/nbench/nbench: 1.46% (1.2484 => 1.2666, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.43% (1.2201 => 1.2376, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.2728 => 1.2907, std.dev.: 0.0054)
  MultiSource/Applications/hbd/hbd: 1.32% (1.5696 => 1.5903, std.dev.: 0.0059)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.32% (1.1393 => 1.1543, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.30% (1.2981 => 1.3150, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.30% (1.2630 => 1.2794, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.26% (1.2639 => 1.2798, std.dev.: 0.0051)
  MultiSource/Applications/d/make_dparser: 1.25% (3.4962 => 3.5400, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.23% (1.3036 => 1.3196, std.dev.: 0.0020)
  MultiSource/Applications/spiff/spiff: 1.21% (0.8911 => 0.9019, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.07% (1.3498 => 1.3643, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.04% (1.2116 => 1.2242, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.03% (1.2235 => 1.2361, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.00% (1.2250 => 1.2373, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.57% (7.6426 => 12.5773, std.dev.: 0.0461)
  SingleSource/Benchmarks/Misc/pi: 57.51% (1.6574 => 2.6106, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/matrix: 29.80% (2.8554 => 3.7063, std.dev.: 0.1142)
  SingleSource/Benchmarks/Shootout/matrix: 18.68% (1.7809 => 2.1136, std.dev.: 0.0295)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.43% (1.1013 => 1.2162, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.57% (3.5550 => 3.8598, std.dev.: 0.0035)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.00% (1.2516 => 1.3517, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 6.36% (0.1871 => 0.1990, std.dev.: 0.0005)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.18% (8.1346 => 8.6376, std.dev.: 0.0104)
  MultiSource/Benchmarks/sim/sim: 6.12% (3.8312 => 4.0657, std.dev.: 0.0043)
  MultiSource/Applications/aha/aha: 6.01% (3.5731 => 3.7878, std.dev.: 0.0010)
  MultiSource/Applications/spiff/spiff: 5.55% (2.8194 => 2.9760, std.dev.: 0.0565)
  MultiSource/Applications/hexxagon/hexxagon: 5.20% (14.7810 => 15.5493, std.dev.: 0.1013)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.14% (5.3716 => 5.6479, std.dev.: 0.0049)
  SingleSource/Benchmarks/McGill/misr: 5.09% (0.3771 => 0.3963, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.83% (5.7757 => 5.9967, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.68% (0.3836 => 0.3977, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.45% (4.4696 => 4.6239, std.dev.: 0.0017)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (2.1472 => 2.2128, std.dev.: 0.0000)
  MultiSource/Applications/siod/siod: 2.68% (3.5310 => 3.6258, std.dev.: 0.0068)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.68% (0.5182 => 0.5321, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/power/power: 2.39% (1.2170 => 1.2461, std.dev.: 0.0015)
  MultiSource/Applications/sqlite3/sqlite3: 2.20% (4.2733 => 4.3674, std.dev.: 0.0058)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.86% (2.5368 => 2.5839, std.dev.: 0.0164)
  SingleSource/Benchmarks/Shootout/fib2: 1.66% (3.5966 => 3.6563, std.dev.: 0.0048)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.61% (1.7652 => 1.7937, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.35% (6.6028 => 6.6921, std.dev.: 0.0055)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.34% (16.7972 => 17.0224, std.dev.: 0.0121)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.38% (0.1483 => 0.1166, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.43% (0.2193 => 0.2074, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.32% (0.1956 => 0.1852, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.71% (0.7461 => 0.7259, std.dev.: 0.0028)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.59% (0.7184 => 0.7070, std.dev.: 0.0044)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.67% (0.5226 => 0.2369, std.dev.: 0.0017)
  MultiSource/Applications/sgefa/sgefa: -46.73% (1.5790 => 0.8411, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -41.00% (0.0400 => 0.0236, std.dev.: 0.0034)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.31% (15.9508 => 12.7115, std.dev.: 0.2084)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.84% (57.2347 => 48.7401, std.dev.: 1.7505)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.56% (0.3304 => 0.2889, std.dev.: 0.0041)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.20% (20.8247 => 18.4916, std.dev.: 0.1539)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.29% (3.4956 => 3.1360, std.dev.: 0.0381)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.57% (50.0284 => 46.2413, std.dev.: 0.0592)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.72% (3.7437 => 3.5297, std.dev.: 0.0449)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.72% (0.7474 => 0.7121, std.dev.: 0.0113)
  SingleSource/Benchmarks/Misc/salsa20: -3.81% (7.7964 => 7.4992, std.dev.: 0.0086)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.21% (0.3462 => 0.3351, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.13% (17.1431 => 16.6062, std.dev.: 0.1036)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.08% (4.3592 => 4.2250, std.dev.: 0.0481)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.80% (36.8417 => 35.8115, std.dev.: 0.1017)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.64% (5.4473 => 5.3034, std.dev.: 0.0543)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.05% (2.5938 => 2.5406, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.61% (39.9519 => 39.3072, std.dev.: 0.0462)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.03% (1.5170 => 1.5014, std.dev.: 0.0056)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.15% (0.1348 => 0.1350, std.dev.: 0.0005)

Report Time: 1.28s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131005/6190cf19/attachment.html>


More information about the llvm-testresults mailing list