[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 19 04:43:01 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14562?compare_to=14557&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14562, Order: 188660, Start Time: 2013-08-19 09:55:16, End Time: 2013-08-19 11:45:07
      To: 14557, Order: 188657, Start Time: 2013-08-19 07:44:03, End Time: 2013-08-19 09:30:10
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 11 (39 on baseline)
Performance Improvements: 0 (53 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1096 (1015 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/constpool: 54.38% (8.7802 => 13.5546, std.dev.: 0.6898)
  SingleSource/UnitTests/Vector/Altivec/test1: 52.76% (0.1414 => 0.2160, std.dev.: 0.0078)
  SingleSource/UnitTests/Vector/sumarray: 48.17% (0.0218 => 0.0323, std.dev.: 0.0022)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 16.19% (6.9261 => 8.0475, std.dev.: 0.0188)
  SingleSource/Benchmarks/Misc/salsa20: 9.56% (8.1887 => 8.9712, std.dev.: 0.0259)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 6.86% (4.0215 => 4.2973, std.dev.: 0.0881)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.34% (5.0098 => 5.3275, std.dev.: 0.0362)
  SingleSource/Benchmarks/Misc/flops-4: 5.99% (1.5357 => 1.6277, std.dev.: 0.0201)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.33% (2.4372 => 2.5670, std.dev.: 0.0496)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.12% (1.5970 => 1.6309, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.22% (3.4919 => 3.5346, std.dev.: 0.0069)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.39% (0.1291 => 0.1309, std.dev.: 0.0174)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/Altivec/test1: 53.85% (0.1404 => 0.2160, std.dev.: 0.0078)
  SingleSource/UnitTests/Vector/constpool: 52.93% (8.8630 => 13.5546, std.dev.: 0.6898)
  SingleSource/UnitTests/Vector/sumarray: 48.17% (0.0218 => 0.0323, std.dev.: 0.0022)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 72.69% (3.7285 => 6.4389, std.dev.: 0.0687)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.55% (2.8867 => 4.2881, std.dev.: 0.0390)
  MultiSource/Benchmarks/FreeBench/neural/neural: 32.70% (0.3171 => 0.4208, std.dev.: 0.0300)
  SingleSource/Benchmarks/Misc/pi: 26.50% (1.9835 => 2.5092, std.dev.: 0.0078)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.42% (1.5030 => 1.8851, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout/hash: 22.53% (4.1846 => 5.1274, std.dev.: 0.3501)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 17.83% (2.9428 => 3.4675, std.dev.: 0.1835)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.84% (0.6295 => 0.7292, std.dev.: 0.0362)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.70% (7.0762 => 7.8331, std.dev.: 0.0346)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.15% (2.3304 => 2.5670, std.dev.: 0.0496)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.42% (0.1678 => 0.1836, std.dev.: 0.0003)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.94% (14.9584 => 16.2953, std.dev.: 0.3292)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.39% (5.4910 => 5.9519, std.dev.: 0.1097)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0047)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.31% (48.3256 => 52.3398, std.dev.: 0.2947)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.77% (3.2027 => 3.4195, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6223, std.dev.: 0.0953)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.74% (3.4085 => 3.6040, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.45% (5.5008 => 5.8005, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.63% (1.5339 => 1.6049, std.dev.: 0.0121)
  MultiSource/Applications/siod/siod: 4.45% (3.3761 => 3.5265, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.34% (3.3877 => 3.5346, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.26% (5.1471 => 5.3663, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.3151 => 4.4988, std.dev.: 0.0016)
  SingleSource/Benchmarks/McGill/misr: 3.84% (0.3674 => 0.3815, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.77% (3.3384 => 3.4643, std.dev.: 0.0460)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.30% (25.0200 => 25.8465, std.dev.: 0.0291)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (6.1245 => 6.3258, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/whetstone: 3.25% (3.4559 => 3.5682, std.dev.: 0.0166)
  MultiSource/Applications/spiff/spiff: 3.14% (2.7609 => 2.8476, std.dev.: 0.0318)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.68% (1.3104 => 1.3455, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.21% (1.5956 => 1.6309, std.dev.: 0.0056)
  SingleSource/UnitTests/Vector/multiplies: 1.89% (0.5600 => 0.5706, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.80% (3.3464 => 3.4068, std.dev.: 0.0140)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.35% (1.1618 => 1.1775, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.08% (3.0680 => 3.1011, std.dev.: 0.0030)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.06% (0.2237 => 0.1475, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.09% (0.1072 => 0.0728, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.09% (0.1818 => 0.1380, std.dev.: 0.0011)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.18% (0.1114 => 0.0878, std.dev.: 0.0041)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.02% (1.5228 => 1.2180, std.dev.: 0.0645)
  MultiSource/Benchmarks/Olden/health/health: -19.72% (0.1993 => 0.1600, std.dev.: 0.0132)
  MultiSource/Applications/obsequi/Obsequi: -18.67% (1.4685 => 1.1943, std.dev.: 0.0502)
  MultiSource/Applications/lua/lua: -17.08% (5.3200 => 4.4113, std.dev.: 0.2518)
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.39% (0.2367 => 0.2050, std.dev.: 0.0053)
  MultiSource/Applications/sgefa/sgefa: -12.93% (0.4809 => 0.4187, std.dev.: 0.0017)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.58% (1.3985 => 1.2226, std.dev.: 0.0578)
  MultiSource/Applications/ClamAV/clamscan: -11.88% (19.4145 => 17.1090, std.dev.: 0.6972)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -9.92% (1.7797 => 1.6031, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.11% (1.5144 => 1.4067, std.dev.: 0.0141)
  MultiSource/Applications/siod/siod: -6.54% (2.7150 => 2.5374, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.50% (1.4794 => 1.3832, std.dev.: 0.0152)
  MultiSource/Applications/JM/lencod/lencod: -6.35% (18.5029 => 17.3288, std.dev.: 0.2078)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (1.5426 => 1.4562, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (1.5437 => 1.4609, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.02% (1.4506 => 1.3778, std.dev.: 0.0278)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.83% (1.4721 => 1.4010, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.23% (1.4333 => 1.3727, std.dev.: 0.0189)
  MultiSource/Benchmarks/Olden/bh/bh: -4.14% (0.3603 => 0.3454, std.dev.: 0.0028)
  MultiSource/Benchmarks/McCat/18-imp/imp: -2.67% (0.4153 => 0.4042, std.dev.: 0.0029)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -36.08% (0.0316 => 0.0202, std.dev.: 0.0019)
  MultiSource/Applications/lemon/lemon: -36.02% (1.4194 => 0.9081, std.dev.: 0.0995)
  MultiSource/Benchmarks/Olden/mst/mst: -35.85% (0.2134 => 0.1369, std.dev.: 0.0157)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.38% (2.1022 => 1.4215, std.dev.: 0.0061)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.50% (0.9545 => 0.6729, std.dev.: 0.0225)
  MultiSource/Applications/viterbi/viterbi: -27.06% (3.4923 => 2.5472, std.dev.: 0.0207)
  MultiSource/Applications/JM/ldecod/ldecod: -25.73% (0.0859 => 0.0638, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2422, std.dev.: 0.0218)
  SingleSource/Benchmarks/Misc/perlin: -21.31% (4.5989 => 3.6190, std.dev.: 0.0033)
  MultiSource/Applications/obsequi/Obsequi: -18.56% (2.6081 => 2.1241, std.dev.: 0.1075)
  SingleSource/Benchmarks/Misc/mandel: -14.16% (1.1996 => 1.0297, std.dev.: 0.0013)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.46% (0.0884 => 0.0765, std.dev.: 0.0006)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.06% (3.5791 => 3.2907, std.dev.: 0.1017)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.86% (47.2250 => 44.4559, std.dev.: 0.9148)
  MultiSource/Applications/lua/lua: -4.43% (31.0707 => 29.6938, std.dev.: 0.5003)
  SingleSource/Benchmarks/Misc/fbench: -4.42% (4.9602 => 4.7412, std.dev.: 0.0017)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.27% (0.7355 => 0.7041, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.97% (1.1032 => 1.0594, std.dev.: 0.0133)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.45% (1.7207 => 1.6613, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.39% (6.0444 => 5.8392, std.dev.: 0.0672)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9626, std.dev.: 0.0092)
  MultiSource/Benchmarks/Olden/bh/bh: -2.99% (2.4879 => 2.4135, std.dev.: 0.0132)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.97% (0.7806 => 0.7574, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.83% (5.2218 => 5.0738, std.dev.: 0.0021)
  MultiSource/Applications/sgefa/sgefa: -2.46% (1.4030 => 1.3685, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.37% (8.6172 => 8.4128, std.dev.: 0.0645)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.94% (34.8438 => 34.1681, std.dev.: 0.0963)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.51% (5.0180 => 4.9423, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.48% (5.8810 => 5.7940, std.dev.: 0.0068)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.01% (0.1378 => 0.1309, std.dev.: 0.0174)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130819/b70e1a0a/attachment.html>


More information about the llvm-testresults mailing list