[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 22 06:35:11 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14673?compare_to=14670&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14673, Order: 188999, Start Time: 2013-08-22 11:42:25, End Time: 2013-08-22 13:37:19
      To: 14670, Order: 188993, Start Time: 2013-08-22 09:27:03, End Time: 2013-08-22 11:19:01
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 38 (47 on baseline)
Performance Improvements: 9 (29 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1060 (1031 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 49.54% (0.0216 => 0.0323, std.dev.: 0.0021)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 18.88% (0.5703 => 0.6780, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 17.30% (1.4313 => 1.6789, std.dev.: 0.0512)
  MultiSource/Benchmarks/Bullet/bullet: 15.42% (36.2247 => 41.8097, std.dev.: 1.9303)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 15.06% (1.5217 => 1.7508, std.dev.: 0.0593)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 15.05% (1.4781 => 1.7006, std.dev.: 0.0353)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.56% (47.5333 => 54.4537, std.dev.: 1.9581)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.48% (26.4442 => 30.2734, std.dev.: 0.3328)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 13.59% (1.3495 => 1.5329, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.74% (1.3923 => 1.5697, std.dev.: 0.0363)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.72% (1.3628 => 1.5361, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.12% (1.4336 => 1.6073, std.dev.: 0.0446)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.87% (1.3789 => 1.5426, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.30% (1.3482 => 1.5005, std.dev.: 0.0513)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.64% (1.4093 => 1.5452, std.dev.: 0.0291)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.52% (1.5900 => 1.7414, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.26% (1.3626 => 1.4888, std.dev.: 0.0309)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.43% (0.1399 => 0.1503, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2989 => 0.3191, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.92% (1.4559 => 1.4984, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.46% (1.4935 => 1.5302, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.31% (1.3989 => 1.4312, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.05% (1.3668 => 1.3948, std.dev.: 0.0034)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.17% (1.4782 => 1.8799, std.dev.: 0.0085)
  MultiSource/Applications/obsequi/Obsequi: 13.39% (2.1195 => 2.4032, std.dev.: 0.0745)
  MultiSource/Benchmarks/Bullet/bullet: 12.37% (6.9982 => 7.8636, std.dev.: 0.0174)
  MultiSource/Benchmarks/FreeBench/neural/neural: 12.09% (0.4327 => 0.4850, std.dev.: 0.0148)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.87% (90.8049 => 98.8586, std.dev.: 0.7008)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.57% (5.0234 => 5.3034, std.dev.: 0.0534)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.84% (0.6428 => 0.6675, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.74% (4.0579 => 4.2098, std.dev.: 0.0527)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.39% (12.8203 => 13.2545, std.dev.: 0.0345)
  MultiSource/Applications/siod/siod: 2.13% (3.5668 => 3.6429, std.dev.: 0.0175)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.94% (20.8753 => 21.2798, std.dev.: 0.1370)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.93% (5.7625 => 5.8736, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.71% (5.9485 => 6.0504, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.33% (9.7271 => 9.8560, std.dev.: 0.0427)
  SingleSource/Benchmarks/Shootout/lists: 1.05% (7.1592 => 7.2346, std.dev.: 0.0167)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -16.60% (0.1066 => 0.0889, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/flops: -12.66% (0.1248 => 0.1090, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/hello: -8.89% (0.2283 => 0.2080, std.dev.: 0.0064)
  SingleSource/Benchmarks/Shootout-C++/lists: -7.36% (0.3191 => 0.2956, std.dev.: 0.0076)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -12.94% (1.2132 => 1.0562, std.dev.: 0.0255)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -4.43% (1.3174 => 1.2590, std.dev.: 0.0093)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -3.31% (1.4673 => 1.4187, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.23% (4.8176 => 4.7104, std.dev.: 0.0401)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.12% (3.0325 => 2.9985, std.dev.: 0.0070)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.75% (0.1308 => 0.1344, std.dev.: 0.0242)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 53.08% (0.0211 => 0.0323, std.dev.: 0.0021)
  SingleSource/Regression/C/bigstack: 43.35% (0.0466 => 0.0668, std.dev.: 0.0034)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 19.92% (0.5654 => 0.6780, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.18% (1.3993 => 1.5697, std.dev.: 0.0363)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.10% (1.3826 => 1.5361, std.dev.: 0.0156)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.85% (49.1253 => 54.4537, std.dev.: 1.9581)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.17% (1.5239 => 1.6789, std.dev.: 0.0512)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.09% (1.3630 => 1.5005, std.dev.: 0.0513)
  SingleSource/Benchmarks/Shootout-C++/ary3: 9.88% (0.2904 => 0.3191, std.dev.: 0.0061)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.52% (27.6418 => 30.2734, std.dev.: 0.3328)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.53% (1.5815 => 1.7006, std.dev.: 0.0353)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.28% (0.1401 => 0.1503, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.95% (1.4333 => 1.5329, std.dev.: 0.0175)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.66% (3.7285 => 6.5121, std.dev.: 0.0238)
  SingleSource/Benchmarks/Shootout/ary3: 56.84% (5.8158 => 9.1216, std.dev.: 0.5505)
  MultiSource/Benchmarks/FreeBench/neural/neural: 52.95% (0.3171 => 0.4850, std.dev.: 0.0148)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.89% (2.8867 => 4.2981, std.dev.: 0.0367)
  SingleSource/Benchmarks/Shootout/hash: 26.28% (4.1846 => 5.2842, std.dev.: 0.1992)
  SingleSource/Benchmarks/Misc/pi: 26.25% (1.9835 => 2.5042, std.dev.: 0.0155)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.08% (1.5030 => 1.8799, std.dev.: 0.0085)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.96% (7.0762 => 7.8520, std.dev.: 0.0744)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.19% (5.4910 => 6.0504, std.dev.: 0.0307)
  SingleSource/Benchmarks/Shootout-C++/ary3: 8.95% (2.0229 => 2.2040, std.dev.: 0.0428)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.20% (48.3256 => 52.2866, std.dev.: 0.3541)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.17% (14.9584 => 16.1804, std.dev.: 0.3360)
  SingleSource/Benchmarks/Stanford/Puzzle: 8.07% (0.1711 => 0.1849, std.dev.: 0.0046)
  MultiSource/Applications/siod/siod: 7.90% (3.3761 => 3.6429, std.dev.: 0.0175)
  MultiSource/Benchmarks/Bullet/bullet: 7.73% (7.2995 => 7.8636, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.13% (3.2027 => 3.4312, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.62% (5.5008 => 5.8651, std.dev.: 0.0510)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.06% (3.4085 => 3.6149, std.dev.: 0.0190)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.54% (93.6732 => 98.8586, std.dev.: 0.7008)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.77% (5.1471 => 5.3924, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.27% (4.3151 => 4.4994, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/whetstone: 4.02% (3.4559 => 3.5947, std.dev.: 0.0105)
  MultiSource/Applications/spiff/spiff: 3.89% (2.7609 => 2.8682, std.dev.: 0.0283)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.71% (4.8739 => 5.0545, std.dev.: 0.0172)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (6.1245 => 6.3350, std.dev.: 0.0659)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.34% (25.0200 => 25.8563, std.dev.: 0.0317)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.05% (12.8625 => 13.2545, std.dev.: 0.0345)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.01% (0.6480 => 0.6675, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.88% (4.9040 => 4.9961, std.dev.: 0.0103)
  SingleSource/UnitTests/Vector/multiplies: 1.80% (0.5600 => 0.5701, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.72% (3.3464 => 3.4040, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.58% (9.7023 => 9.8560, std.dev.: 0.0427)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.50% (3.0680 => 3.1139, std.dev.: 0.0099)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.31% (1.5957 => 1.6166, std.dev.: 0.0065)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -32.59% (0.2237 => 0.1508, std.dev.: 0.0242)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -18.65% (1.5228 => 1.2388, std.dev.: 0.1004)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.44% (1.7461 => 1.6686, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.78% (1.4721 => 1.4312, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.45% (1.5361 => 1.4984, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.09% (1.5629 => 1.5302, std.dev.: 0.0101)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.51% (2.1022 => 1.4187, std.dev.: 0.0058)
  MultiSource/Applications/viterbi/viterbi: -27.21% (3.4923 => 2.5421, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.44% (6.9552 => 5.2551, std.dev.: 0.0183)
  MultiSource/Applications/lemon/lemon: -21.79% (1.4194 => 1.1101, std.dev.: 0.0454)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6131, std.dev.: 0.0338)
  MultiSource/Applications/JM/ldecod/ldecod: -21.07% (0.0859 => 0.0678, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc/mandel: -14.79% (1.1996 => 1.0222, std.dev.: 0.0371)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.31% (0.3557 => 0.3119, std.dev.: 0.0140)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.05% (0.5173 => 0.4653, std.dev.: 0.0071)
  MultiSource/Applications/obsequi/Obsequi: -7.86% (2.6081 => 2.4032, std.dev.: 0.0745)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.97% (3.5791 => 3.3298, std.dev.: 0.0180)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.49% (47.2250 => 44.1601, std.dev.: 0.5890)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.74% (1.7207 => 1.6220, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.83% (3.8119 => 3.6276, std.dev.: 0.0255)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.24% (0.7355 => 0.7043, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc/fbench: -3.91% (4.9602 => 4.7665, std.dev.: 0.0055)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.07% (0.7806 => 0.7566, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9625, std.dev.: 0.0439)
  SingleSource/Regression/C/uint64_to_float: -2.54% (1.5184 => 1.4799, std.dev.: 0.0038)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.87% (21.6864 => 21.2798, std.dev.: 0.1370)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.72% (34.8438 => 34.2428, std.dev.: 0.0209)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.49% (2.1343 => 2.1024, std.dev.: 0.0028)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.18% (1.6737 => 1.6539, std.dev.: 0.0063)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.47% (0.1378 => 0.1344, std.dev.: 0.0242)

Report Time: 1.47s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130822/a8aa6d3e/attachment.html>


More information about the llvm-testresults mailing list