[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 23 15:15:24 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13684?compare_to=13681&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13684, Order: 186982, Start Time: 2013-07-23 20:25:38, End Time: 2013-07-23 22:16:58
      To: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 32 (32 on baseline)
Performance Improvements: 24 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1051 (1051 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 179.17% (0.0072 => 0.0201, std.dev.: 0.0035)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 81.99% (0.0161 => 0.0293, std.dev.: 0.0001)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 74.05% (0.0158 => 0.0275, std.dev.: 0.0020)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: 72.47% (0.0178 => 0.0307, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout/methcall: 67.96% (0.0362 => 0.0608, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/sumarray-dbl: 66.35% (0.0211 => 0.0351, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/strcat: 64.04% (0.0292 => 0.0479, std.dev.: 0.0028)
  SingleSource/UnitTests/Vector/simple: 58.18% (0.0220 => 0.0348, std.dev.: 0.0013)
  MultiSource/Applications/spiff/spiff: 41.00% (0.9578 => 1.3505, std.dev.: 0.0652)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.61% (0.1423 => 0.1702, std.dev.: 0.0054)
  SingleSource/UnitTests/Vector/constpool: 19.52% (8.8630 => 10.5932, std.dev.: 0.2134)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (4.2444 => 4.5357, std.dev.: 0.0290)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.90% (0.3934 => 0.4048, std.dev.: 0.0029)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 61.82% (5.8158 => 9.4110, std.dev.: 0.6201)
  SingleSource/Benchmarks/Shootout/heapsort: 56.24% (2.9123 => 4.5502, std.dev.: 0.0681)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 36.93% (1.6121 => 2.2075, std.dev.: 0.0268)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.48% (4.5517 => 6.0303, std.dev.: 0.0157)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 23.58% (1.5030 => 1.8574, std.dev.: 0.0219)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 18.36% (3.9978 => 4.7318, std.dev.: 0.2384)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 15.50% (2.1022 => 2.4280, std.dev.: 0.0180)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.41% (29.8131 => 34.4084, std.dev.: 0.3532)
  SingleSource/Benchmarks/Shootout/strcat: 10.61% (0.1593 => 0.1762, std.dev.: 0.0045)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.78% (48.3256 => 51.6000, std.dev.: 0.3088)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.80% (2.0229 => 2.1403, std.dev.: 0.0350)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.66% (2.9568 => 3.1241, std.dev.: 0.0612)
  SingleSource/Benchmarks/Misc/flops-7: 5.00% (1.7330 => 1.8197, std.dev.: 0.0317)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (40.5028 => 41.9196, std.dev.: 0.4738)
  SingleSource/Benchmarks/Misc/ffbench: 3.16% (1.3679 => 1.4111, std.dev.: 0.0159)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.15% (60.3477 => 62.2510, std.dev.: 0.7263)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.46% (4.9040 => 4.9758, std.dev.: 0.0192)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.26% (1.3489 => 1.3659, std.dev.: 0.0063)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.06% (8.6713 => 8.7630, std.dev.: 0.0154)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.24% (0.2237 => 0.1471, std.dev.: 0.0147)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.18% (0.1072 => 0.0727, std.dev.: 0.0127)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.90% (0.1114 => 0.0870, std.dev.: 0.0080)
  MultiSource/Benchmarks/MallocBench/gs/gs: -20.95% (6.0938 => 4.8174, std.dev.: 0.2843)
  MultiSource/Applications/obsequi/Obsequi: -18.93% (1.4685 => 1.1905, std.dev.: 0.0390)
  MultiSource/Applications/hbd/hbd: -16.98% (2.0193 => 1.6764, std.dev.: 0.0933)
  MultiSource/Applications/hexxagon/hexxagon: -14.31% (1.3285 => 1.1384, std.dev.: 0.0436)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -10.25% (0.1141 => 0.1024, std.dev.: 0.0017)
  MultiSource/Applications/lambda-0_1_3/lambda: -9.14% (0.9461 => 0.8596, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.94% (1.5426 => 1.4356, std.dev.: 0.0376)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.93% (2.6853 => 2.4991, std.dev.: 0.0393)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.75% (1.4514 => 1.3534, std.dev.: 0.0358)
  MultiSource/Applications/ClamAV/clamscan: -5.94% (19.4145 => 18.2616, std.dev.: 0.2478)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.93% (0.3309 => 0.3179, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.77% (0.1189 => 0.0835, std.dev.: 0.0026)
  MultiSource/Applications/lemon/lemon: -27.60% (1.4194 => 1.0276, std.dev.: 0.0609)
  MultiSource/Applications/obsequi/Obsequi: -12.18% (2.6081 => 2.2904, std.dev.: 0.0791)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -8.60% (0.2047 => 0.1871, std.dev.: 0.0068)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.15% (0.3557 => 0.3267, std.dev.: 0.0103)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.10% (1.3148 => 1.2477, std.dev.: 0.0123)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.16% (3.5791 => 3.4301, std.dev.: 0.0469)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.04% (0.5097 => 0.4891, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.76% (4.9231 => 4.8364, std.dev.: 0.0315)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.69% (2.8052 => 2.7579, std.dev.: 0.0098)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.27% (0.1378 => 0.1333, std.dev.: 0.0050)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 179.17% (0.0072 => 0.0201, std.dev.: 0.0035)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 81.99% (0.0161 => 0.0293, std.dev.: 0.0001)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 74.05% (0.0158 => 0.0275, std.dev.: 0.0020)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: 72.47% (0.0178 => 0.0307, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout/methcall: 67.96% (0.0362 => 0.0608, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/sumarray-dbl: 66.35% (0.0211 => 0.0351, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/strcat: 64.04% (0.0292 => 0.0479, std.dev.: 0.0028)
  SingleSource/UnitTests/Vector/simple: 58.18% (0.0220 => 0.0348, std.dev.: 0.0013)
  MultiSource/Applications/spiff/spiff: 41.00% (0.9578 => 1.3505, std.dev.: 0.0652)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.61% (0.1423 => 0.1702, std.dev.: 0.0054)
  SingleSource/UnitTests/Vector/constpool: 19.52% (8.8630 => 10.5932, std.dev.: 0.2134)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (4.2444 => 4.5357, std.dev.: 0.0290)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.90% (0.3934 => 0.4048, std.dev.: 0.0029)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 61.82% (5.8158 => 9.4110, std.dev.: 0.6201)
  SingleSource/Benchmarks/Shootout/heapsort: 56.24% (2.9123 => 4.5502, std.dev.: 0.0681)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 36.93% (1.6121 => 2.2075, std.dev.: 0.0268)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.48% (4.5517 => 6.0303, std.dev.: 0.0157)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 23.58% (1.5030 => 1.8574, std.dev.: 0.0219)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 18.36% (3.9978 => 4.7318, std.dev.: 0.2384)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 15.50% (2.1022 => 2.4280, std.dev.: 0.0180)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.41% (29.8131 => 34.4084, std.dev.: 0.3532)
  SingleSource/Benchmarks/Shootout/strcat: 10.61% (0.1593 => 0.1762, std.dev.: 0.0045)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.78% (48.3256 => 51.6000, std.dev.: 0.3088)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.80% (2.0229 => 2.1403, std.dev.: 0.0350)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.66% (2.9568 => 3.1241, std.dev.: 0.0612)
  SingleSource/Benchmarks/Misc/flops-7: 5.00% (1.7330 => 1.8197, std.dev.: 0.0317)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (40.5028 => 41.9196, std.dev.: 0.4738)
  SingleSource/Benchmarks/Misc/ffbench: 3.16% (1.3679 => 1.4111, std.dev.: 0.0159)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.15% (60.3477 => 62.2510, std.dev.: 0.7263)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.46% (4.9040 => 4.9758, std.dev.: 0.0192)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.26% (1.3489 => 1.3659, std.dev.: 0.0063)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.06% (8.6713 => 8.7630, std.dev.: 0.0154)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.24% (0.2237 => 0.1471, std.dev.: 0.0147)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.18% (0.1072 => 0.0727, std.dev.: 0.0127)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.90% (0.1114 => 0.0870, std.dev.: 0.0080)
  MultiSource/Benchmarks/MallocBench/gs/gs: -20.95% (6.0938 => 4.8174, std.dev.: 0.2843)
  MultiSource/Applications/obsequi/Obsequi: -18.93% (1.4685 => 1.1905, std.dev.: 0.0390)
  MultiSource/Applications/hbd/hbd: -16.98% (2.0193 => 1.6764, std.dev.: 0.0933)
  MultiSource/Applications/hexxagon/hexxagon: -14.31% (1.3285 => 1.1384, std.dev.: 0.0436)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -10.25% (0.1141 => 0.1024, std.dev.: 0.0017)
  MultiSource/Applications/lambda-0_1_3/lambda: -9.14% (0.9461 => 0.8596, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.94% (1.5426 => 1.4356, std.dev.: 0.0376)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.93% (2.6853 => 2.4991, std.dev.: 0.0393)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.75% (1.4514 => 1.3534, std.dev.: 0.0358)
  MultiSource/Applications/ClamAV/clamscan: -5.94% (19.4145 => 18.2616, std.dev.: 0.2478)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.93% (0.3309 => 0.3179, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.77% (0.1189 => 0.0835, std.dev.: 0.0026)
  MultiSource/Applications/lemon/lemon: -27.60% (1.4194 => 1.0276, std.dev.: 0.0609)
  MultiSource/Applications/obsequi/Obsequi: -12.18% (2.6081 => 2.2904, std.dev.: 0.0791)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -8.60% (0.2047 => 0.1871, std.dev.: 0.0068)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.15% (0.3557 => 0.3267, std.dev.: 0.0103)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.10% (1.3148 => 1.2477, std.dev.: 0.0123)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.16% (3.5791 => 3.4301, std.dev.: 0.0469)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.04% (0.5097 => 0.4891, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.76% (4.9231 => 4.8364, std.dev.: 0.0315)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.69% (2.8052 => 2.7579, std.dev.: 0.0098)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.27% (0.1378 => 0.1333, std.dev.: 0.0050)

Report Time: 0.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130723/82f02a47/attachment.html>


More information about the llvm-testresults mailing list