[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Oct 17 08:21:06 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16408?compare_to=16404&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16408, Order: 192890, Start Time: 2013-10-17 13:30:46, End Time: 2013-10-17 15:24:16
      To: 16404, Order: 192880, Start Time: 2013-10-17 11:10:49, End Time: 2013-10-17 13:04:33
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 39 (50 on baseline)
Performance Improvements: 9 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1059 (1044 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-10-13-SwitchTest: 114.50% (0.0131 => 0.0281, std.dev.: 0.0014)
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 69.43% (0.0157 => 0.0266, std.dev.: 0.0016)
  SingleSource/UnitTests/2002-05-02-ManyArguments: 67.60% (0.0179 => 0.0300, std.dev.: 0.0036)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 43.73% (0.9762 => 1.4031, std.dev.: 0.1019)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 40.66% (0.2248 => 0.3162, std.dev.: 0.0252)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 34.69% (0.1695 => 0.2283, std.dev.: 0.0209)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 30.95% (0.2262 => 0.2962, std.dev.: 0.0034)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 26.09% (1.1719 => 1.4776, std.dev.: 0.1043)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 24.73% (7.5049 => 9.3611, std.dev.: 0.3121)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.03% (0.2246 => 0.2606, std.dev.: 0.0106)
  MultiSource/Applications/kimwitu++/kc: 13.52% (18.7887 => 21.3288, std.dev.: 0.1746)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.05% (1.0846 => 1.2044, std.dev.: 0.0227)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.84% (2.8741 => 3.1857, std.dev.: 0.0693)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.70% (0.2878 => 0.3186, std.dev.: 0.0092)
  MultiSource/Benchmarks/FreeBench/neural/neural: 7.43% (0.1870 => 0.2009, std.dev.: 0.0014)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.76% (0.5130 => 0.5374, std.dev.: 0.0033)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 85.36% (0.7553 => 1.4000, std.dev.: 0.0604)
  MultiSource/Benchmarks/Olden/bisort/bisort: 52.64% (0.6691 => 1.0213, std.dev.: 0.0137)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 39.28% (2.3984 => 3.3406, std.dev.: 0.1355)
  MultiSource/Applications/minisat/minisat: 39.01% (6.3688 => 8.8530, std.dev.: 0.5030)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.55% (0.0965 => 0.1173, std.dev.: 0.0046)
  MultiSource/Benchmarks/llubenchmark/llu: 13.18% (2.0113 => 2.2763, std.dev.: 0.0844)
  MultiSource/Benchmarks/FreeBench/neural/neural: 9.62% (0.2319 => 0.2542, std.dev.: 0.0049)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.99% (12.8593 => 13.8865, std.dev.: 0.1967)
  MultiSource/Benchmarks/Olden/tsp/tsp: 7.47% (1.5425 => 1.6577, std.dev.: 0.0182)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 7.40% (3.9669 => 4.2606, std.dev.: 0.0277)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.96% (22.4484 => 23.7854, std.dev.: 0.4048)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.83% (2.4212 => 2.5381, std.dev.: 0.0266)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.96% (0.7148 => 0.7431, std.dev.: 0.0086)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.95% (39.5197 => 41.0797, std.dev.: 0.3918)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.76% (44.5336 => 46.2060, std.dev.: 0.3665)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.80% (5.8173 => 5.9804, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.70% (5.2796 => 5.4222, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.02% (5.5135 => 5.6248, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.00% (5.8941 => 6.0119, std.dev.: 0.0415)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.57% (1.8577 => 1.8869, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.47% (3.1735 => 3.2202, std.dev.: 0.0045)
  MultiSource/Applications/siod/siod: 1.40% (3.5509 => 3.6006, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.21% (3.9177 => 3.9651, std.dev.: 0.0098)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/simple: -30.95% (0.0336 => 0.0232, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/perlin: -18.00% (0.0750 => 0.0615, std.dev.: 0.0042)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.25% (0.6413 => 0.5371, std.dev.: 0.0197)
  SingleSource/Benchmarks/Shootout-C++/hash2: -10.57% (0.5044 => 0.4511, std.dev.: 0.0115)
  SingleSource/Benchmarks/Stanford/Puzzle: -8.47% (0.1417 => 0.1297, std.dev.: 0.0031)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: -44.44% (0.0387 => 0.0215, std.dev.: 0.0033)
  SingleSource/Benchmarks/Linpack/linpack-pc: -21.51% (48.1754 => 37.8114, std.dev.: 3.3346)
  SingleSource/Benchmarks/Stanford/FloatMM: -9.09% (0.7676 => 0.6978, std.dev.: 0.0154)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.98% (0.5430 => 0.5268, std.dev.: 0.0009)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -7.19% (0.1404 => 0.1303, std.dev.: 0.0106)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-10-13-SwitchTest: 77.85% (0.0158 => 0.0281, std.dev.: 0.0014)
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 68.35% (0.0158 => 0.0266, std.dev.: 0.0016)
  SingleSource/UnitTests/2002-05-02-ManyArguments: 66.67% (0.0180 => 0.0300, std.dev.: 0.0036)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 47.79% (0.9494 => 1.4031, std.dev.: 0.1019)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 44.45% (0.2189 => 0.3162, std.dev.: 0.0252)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 37.78% (0.1657 => 0.2283, std.dev.: 0.0209)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 31.12% (0.2259 => 0.2962, std.dev.: 0.0034)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.56% (0.0849 => 0.1100, std.dev.: 0.0097)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 28.83% (7.2661 => 9.3611, std.dev.: 0.3121)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 27.60% (1.1580 => 1.4776, std.dev.: 0.1043)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.25% (2.6492 => 3.1857, std.dev.: 0.0693)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.91% (0.2229 => 0.2606, std.dev.: 0.0106)
  MultiSource/Applications/kimwitu++/kc: 16.16% (18.3608 => 21.3288, std.dev.: 0.1746)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.94% (0.2821 => 0.3186, std.dev.: 0.0092)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.97% (1.0756 => 1.2044, std.dev.: 0.0227)
  SingleSource/Benchmarks/Misc/oourafft: 10.72% (0.2294 => 0.2540, std.dev.: 0.0052)
  SingleSource/Benchmarks/McGill/chomp: 6.90% (0.2202 => 0.2354, std.dev.: 0.0056)
  MultiSource/Benchmarks/FreeBench/neural/neural: 6.75% (0.1882 => 0.2009, std.dev.: 0.0014)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.50% (0.5046 => 0.5374, std.dev.: 0.0033)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 88.93% (0.7410 => 1.4000, std.dev.: 0.0604)
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.21% (7.6426 => 12.5499, std.dev.: 0.0454)
  MultiSource/Benchmarks/Olden/bisort/bisort: 53.65% (0.6647 => 1.0213, std.dev.: 0.0137)
  MultiSource/Applications/minisat/minisat: 41.06% (6.2760 => 8.8530, std.dev.: 0.5030)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 39.13% (2.4010 => 3.3406, std.dev.: 0.1355)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 26.94% (2.4753 => 3.1422, std.dev.: 0.1922)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.60% (0.0949 => 0.1173, std.dev.: 0.0046)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 22.06% (1.1431 => 1.3953, std.dev.: 0.0595)
  MultiSource/Benchmarks/llubenchmark/llu: 14.45% (1.9889 => 2.2763, std.dev.: 0.0844)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.83% (2.1111 => 2.4031, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.99% (4.9428 => 5.4858, std.dev.: 0.0096)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 10.52% (21.5217 => 23.7854, std.dev.: 0.4048)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.95% (2.3084 => 2.5381, std.dev.: 0.0266)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 7.34% (3.9691 => 4.2606, std.dev.: 0.0277)
  MultiSource/Benchmarks/Olden/tsp/tsp: 6.58% (1.5553 => 1.6577, std.dev.: 0.0182)
  SingleSource/UnitTests/Vector/multiplies: 5.95% (0.5561 => 0.5892, std.dev.: 0.0089)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.72% (3.1730 => 3.3546, std.dev.: 0.0376)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.54% (5.7757 => 5.9804, std.dev.: 0.0085)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.15% (89.7126 => 92.5422, std.dev.: 0.2067)
  MultiSource/Applications/hexxagon/hexxagon: 2.96% (14.7810 => 15.2189, std.dev.: 0.0570)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.94% (2.4920 => 2.5653, std.dev.: 0.0149)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (39.9519 => 41.0797, std.dev.: 0.3918)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.41% (5.4925 => 5.6248, std.dev.: 0.0051)
  MultiSource/Benchmarks/Olden/power/power: 2.32% (1.2170 => 1.2452, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1569 => 3.2202, std.dev.: 0.0045)
  MultiSource/Applications/siod/siod: 1.97% (3.5310 => 3.6006, std.dev.: 0.0176)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.91% (1.7652 => 1.7990, std.dev.: 0.0078)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.89% (1.8519 => 1.8869, std.dev.: 0.0048)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.80% (8.1346 => 8.2814, std.dev.: 0.0239)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.57% (16.7972 => 17.0612, std.dev.: 0.0534)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.57% (5.3022 => 5.3854, std.dev.: 0.0079)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -51.36% (0.5226 => 0.2542, std.dev.: 0.0049)
  MultiSource/Applications/sgefa/sgefa: -42.20% (1.5790 => 0.9127, std.dev.: 0.0034)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.25% (0.0400 => 0.0259, std.dev.: 0.0009)
  SingleSource/Benchmarks/Linpack/linpack-pc: -33.94% (57.2347 => 37.8114, std.dev.: 3.3346)
  MultiSource/Benchmarks/Olden/em3d/em3d: -28.29% (5.0288 => 3.6063, std.dev.: 0.0248)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.94% (15.9508 => 13.8865, std.dev.: 0.1967)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.48% (20.8247 => 18.4337, std.dev.: 0.1437)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.49% (3.4956 => 3.1288, std.dev.: 0.0252)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.64% (50.0284 => 46.2060, std.dev.: 0.3665)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.98% (3.0561 => 2.9038, std.dev.: 0.0397)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.35% (3.7437 => 3.6556, std.dev.: 0.0320)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.33% (2.4471 => 2.3900, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.08% (17.1431 => 16.7870, std.dev.: 0.0259)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.34% (0.1348 => 0.1303, std.dev.: 0.0106)

Report Time: 1.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131017/8ae567ef/attachment.html>


More information about the llvm-testresults mailing list