[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 19 11:45:46 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12544?compare_to=12541&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12544, Order: 184318, Start Time: 2013-06-19 16:57:24, End Time: 2013-06-19 18:46:42
      To: 12541, Order: 184302, Start Time: 2013-06-19 14:42:24, End Time: 2013-06-19 16:34:26
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 20 (42 on baseline)
Performance Improvements: 20 (37 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1067 (1028 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/salsa20: 59.97% (0.0577 => 0.0923, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc/pi: 55.66% (0.0221 => 0.0344, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/flops-3: 47.69% (0.0325 => 0.0480, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/ary2: 35.98% (0.2913 => 0.3961, std.dev.: 0.0279)
  MultiSource/Benchmarks/McCat/18-imp/imp: 24.56% (0.3991 => 0.4971, std.dev.: 0.0325)
  MultiSource/Applications/hbd/hbd: 20.03% (1.6303 => 1.9568, std.dev.: 0.0639)
  MultiSource/Applications/lambda-0_1_3/lambda: 18.47% (0.8358 => 0.9902, std.dev.: 0.0351)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.47% (1.4204 => 1.4697, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.26% (1.4477 => 1.4949, std.dev.: 0.0056)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 190.32% (0.0062 => 0.0180, std.dev.: 0.0007)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 40.40% (0.0552 => 0.0775, std.dev.: 0.0035)
  MultiSource/Applications/lemon/lemon: 33.18% (1.0017 => 1.3341, std.dev.: 0.0862)
  MultiSource/Applications/obsequi/Obsequi: 15.17% (2.2076 => 2.5426, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.72% (5.1685 => 5.4641, std.dev.: 0.0341)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.40% (3.9031 => 4.0360, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.88% (4.1804 => 4.3006, std.dev.: 0.0153)
  MultiSource/Benchmarks/Olden/bh/bh: 2.28% (2.4313 => 2.4867, std.dev.: 0.0170)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.2087 => 6.3164, std.dev.: 0.0250)
  MultiSource/Applications/JM/lencod/lencod: 1.60% (7.0148 => 7.1273, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.36% (3.2233 => 3.2671, std.dev.: 0.0101)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2006-12-01-float_varg: -40.15% (0.0259 => 0.0155, std.dev.: 0.0034)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -25.49% (0.3366 => 0.2508, std.dev.: 0.0209)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -22.65% (0.0746 => 0.0577, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -20.33% (0.0674 => 0.0537, std.dev.: 0.0007)
  MultiSource/Applications/Burg/burg: -17.86% (1.9999 => 1.6427, std.dev.: 0.0969)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -8.47% (5.5995 => 5.1250, std.dev.: 0.0630)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -8.11% (1.7738 => 1.6300, std.dev.: 0.0489)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.59% (1.8960 => 1.7521, std.dev.: 0.0491)
  MultiSource/Applications/d/make_dparser: -7.05% (4.2198 => 3.9222, std.dev.: 0.0884)
  SingleSource/Benchmarks/Shootout-C++/ary3: -5.89% (0.3056 => 0.2876, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/ary: -3.47% (0.3026 => 0.2921, std.dev.: 0.0016)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -3.34% (0.4335 => 0.4190, std.dev.: 0.0051)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -11.93% (0.3386 => 0.2982, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -7.23% (4.7201 => 4.3787, std.dev.: 0.0852)
  SingleSource/Benchmarks/Shootout/matrix: -5.99% (1.8476 => 1.7369, std.dev.: 0.0070)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -5.20% (0.9306 => 0.8822, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.90% (5.4260 => 5.2142, std.dev.: 0.0356)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.40% (0.5085 => 0.4912, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.67% (3.7653 => 3.6648, std.dev.: 0.0265)
  SingleSource/Benchmarks/Shootout-C++/sieve: -1.11% (3.5250 => 3.4860, std.dev.: 0.0105)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.31% (0.1386 => 0.1418, std.dev.: 0.0081)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/salsa20: 57.78% (0.0585 => 0.0923, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc/pi: 55.66% (0.0221 => 0.0344, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/flops-3: 37.14% (0.0350 => 0.0480, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/ary2: 34.23% (0.2951 => 0.3961, std.dev.: 0.0279)
  MultiSource/Applications/hbd/hbd: 19.42% (1.6386 => 1.9568, std.dev.: 0.0639)
  MultiSource/Applications/lambda-0_1_3/lambda: 14.49% (0.8649 => 0.9902, std.dev.: 0.0351)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.19% (1.3838 => 1.4971, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.49% (1.3667 => 1.4554, std.dev.: 0.0270)
  SingleSource/Benchmarks/Shootout-C++/ary: 6.33% (0.2747 => 0.2921, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.25% (1.3832 => 1.4697, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.16% (1.4081 => 1.4949, std.dev.: 0.0056)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.03% (0.2937 => 0.3114, std.dev.: 0.0061)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.78% (0.3061 => 0.3238, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.75% (0.3113 => 0.3292, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.14% (1.6726 => 1.7418, std.dev.: 0.0171)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 60.22% (6.0122 => 9.6329, std.dev.: 0.4517)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 58.49% (0.0489 => 0.0775, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout/heapsort: 50.98% (2.9988 => 4.5276, std.dev.: 0.0541)
  MultiSource/Applications/sgefa/sgefa: 32.53% (1.1695 => 1.5499, std.dev.: 0.0314)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.98% (16.4665 => 20.9089, std.dev.: 0.3925)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 25.11% (3.5000 => 4.3787, std.dev.: 0.0852)
  SingleSource/Benchmarks/Shootout-C++/ary: 17.85% (0.0633 => 0.0746, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.66% (6.1372 => 7.2212, std.dev.: 0.0203)
  MultiSource/Applications/obsequi/Obsequi: 13.52% (2.2398 => 2.5426, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.56% (5.2003 => 5.6454, std.dev.: 0.0276)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.60% (0.8276 => 0.8822, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.28% (3.1853 => 3.3853, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.15% (3.2201 => 3.4182, std.dev.: 0.0183)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.32% (94.2966 => 99.3106, std.dev.: 1.2381)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.20% (1.0571 => 1.1015, std.dev.: 0.0023)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.09% (1.2224 => 1.2724, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.03% (2.9004 => 3.0174, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.81% (5.9362 => 6.1626, std.dev.: 0.0304)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.73% (4.8986 => 5.0815, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.44% (5.5010 => 5.6902, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.42% (5.2788 => 5.4592, std.dev.: 0.0292)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.27% (3.9713 => 4.0614, std.dev.: 0.0298)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (4.3727 => 4.4596, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.85% (5.6582 => 5.7631, std.dev.: 0.0022)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.47% (1.7925 => 1.8189, std.dev.: 0.0079)
  MultiSource/Applications/JM/lencod/lencod: 1.31% (7.0353 => 7.1273, std.dev.: 0.0108)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.23% (11.4990 => 11.6404, std.dev.: 0.0233)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.82% (0.2006 => 0.1809, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.88% (0.7381 => 0.6873, std.dev.: 0.0128)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.57% (1.3686 => 1.3197, std.dev.: 0.0163)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.16% (1.2911 => 0.7339, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -27.23% (0.0393 => 0.0286, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -25.83% (4.4050 => 3.2671, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -24.55% (6.2328 => 4.7025, std.dev.: 0.0496)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.99% (25.3677 => 21.3107, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.10% (11.6227 => 9.9835, std.dev.: 0.0394)
  SingleSource/Benchmarks/Misc/salsa20: -12.96% (10.3398 => 9.0002, std.dev.: 0.0486)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.38% (7.0179 => 6.2891, std.dev.: 0.0199)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.83% (1.6679 => 1.5206, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -8.78% (0.2973 => 0.2712, std.dev.: 0.0068)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -8.72% (0.3267 => 0.2982, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -8.51% (2.4808 => 2.2698, std.dev.: 0.0722)
  MultiSource/Applications/siod/siod: -8.39% (3.7240 => 3.4117, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.71% (9.8728 => 9.1120, std.dev.: 0.0827)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.86% (48.3307 => 45.0149, std.dev.: 0.4367)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.70% (5.5889 => 5.2142, std.dev.: 0.0356)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.93% (4.5717 => 4.3006, std.dev.: 0.0153)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.10% (3.5327 => 3.3526, std.dev.: 0.0462)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.77% (5.3184 => 5.0645, std.dev.: 0.0287)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.43% (0.2777 => 0.2654, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.29% (4.2167 => 4.0360, std.dev.: 0.0371)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.24% (0.9806 => 0.9390, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/flops: -3.62% (10.2170 => 9.8474, std.dev.: 0.0113)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.80% (3.8665 => 3.7581, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.77% (5.3276 => 5.1798, std.dev.: 0.0511)
  SingleSource/Benchmarks/Shootout/sieve: -2.76% (8.0178 => 7.7965, std.dev.: 0.0062)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.31% (5.7342 => 5.6020, std.dev.: 0.0448)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.21% (4.5094 => 4.4098, std.dev.: 0.0345)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (1.1291 => 1.1054, std.dev.: 0.0075)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.87% (1.6980 => 1.6663, std.dev.: 0.0074)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.38% (2.8573 => 2.8179, std.dev.: 0.0113)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.29% (12.1841 => 12.0269, std.dev.: 0.0452)
  MultiSource/Benchmarks/sim/sim: -1.25% (3.8805 => 3.8321, std.dev.: 0.0053)
  MultiSource/Applications/hexxagon/hexxagon: -1.13% (15.4979 => 15.3226, std.dev.: 0.0320)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.60% (0.1441 => 0.1418, std.dev.: 0.0081)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130619/ea54d8af/attachment.html>


More information about the llvm-testresults mailing list