[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 1 16:52:30 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15872?compare_to=15868&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15872, Order: 191796, Start Time: 2013-10-01 22:06:51, End Time: 2013-10-01 23:55:23
      To: 15868, Order: 191786, Start Time: 2013-10-01 19:50:39, End Time: 2013-10-01 21:43:26
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 11 (22 on baseline)
Performance Improvements: 42 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1054 (1072 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 35.02% (1.5641 => 2.1118, std.dev.: 0.1438)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 34.57% (0.1458 => 0.1962, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/ReedSolomon: 13.92% (8.5876 => 9.7831, std.dev.: 0.0022)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 9.83% (0.4546 => 0.4993, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.51% (0.8272 => 0.8893, std.dev.: 0.0035)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 6.28% (0.3582 => 0.3807, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.82% (3.5668 => 3.7745, std.dev.: 0.0435)
  SingleSource/Regression/C/uint64_to_float: 4.51% (1.4190 => 1.4830, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.60% (6.7497 => 6.9924, std.dev.: 0.0750)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.23% (0.6994 => 0.7220, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.27% (5.9338 => 6.0093, std.dev.: 0.0191)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-1: -45.84% (0.0541 => 0.0293, std.dev.: 0.0010)
  SingleSource/Benchmarks/Stanford/Perm: -43.79% (0.0580 => 0.0326, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/ffbench: -41.78% (0.1357 => 0.0790, std.dev.: 0.0010)
  SingleSource/Benchmarks/Stanford/Quicksort: -41.54% (0.0674 => 0.0394, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/strcat: -30.98% (0.2970 => 0.2050, std.dev.: 0.0028)
  SingleSource/Benchmarks/Stanford/Oscar: -30.08% (0.0984 => 0.0688, std.dev.: 0.0012)
  SingleSource/Benchmarks/McGill/exptree: -28.37% (0.1336 => 0.0957, std.dev.: 0.0016)
  SingleSource/Benchmarks/Stanford/Towers: -26.29% (0.0696 => 0.0513, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/fbench: -21.89% (0.0941 => 0.0735, std.dev.: 0.0003)
  SingleSource/Benchmarks/CoyoteBench/almabench: -16.70% (0.0916 => 0.0763, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -15.56% (1.5015 => 1.2678, std.dev.: 0.0716)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -15.31% (0.2488 => 0.2107, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.13% (0.0750 => 0.0644, std.dev.: 0.0032)
  SingleSource/Benchmarks/McGill/chomp: -11.72% (0.2499 => 0.2206, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -11.19% (1.3869 => 1.2317, std.dev.: 0.0105)
  MultiSource/Benchmarks/PAQ8p/paq8p: -11.03% (2.8815 => 2.5638, std.dev.: 0.0980)
  SingleSource/Benchmarks/Stanford/Puzzle: -11.01% (0.1435 => 0.1277, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -10.97% (0.3836 => 0.3415, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -10.82% (0.4290 => 0.3826, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/hash: -10.29% (0.4517 => 0.4052, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/ary3: -9.21% (0.2811 => 0.2552, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/matrix: -8.20% (0.2609 => 0.2395, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -7.86% (1.3848 => 1.2759, std.dev.: 0.0164)
  SingleSource/Benchmarks/Shootout-C++/moments: -7.20% (0.4183 => 0.3882, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/objinst: -7.13% (0.2299 => 0.2135, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.12% (0.6350 => 0.5898, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.70% (1.3416 => 1.2517, std.dev.: 0.0283)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.49% (1.3395 => 1.2526, std.dev.: 0.0081)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -5.55% (0.2035 => 0.1922, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.23% (0.2086 => 0.1977, std.dev.: 0.0017)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: -47.06% (0.0357 => 0.0189, std.dev.: 0.0041)
  SingleSource/Benchmarks/Stanford/Quicksort: -35.11% (0.0413 => 0.0268, std.dev.: 0.0026)
  SingleSource/Benchmarks/Stanford/Bubblesort: -23.81% (0.0462 => 0.0352, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -13.50% (4.1157 => 3.5599, std.dev.: 0.1971)
  SingleSource/Benchmarks/McGill/chomp: -9.22% (1.1233 => 1.0197, std.dev.: 0.0034)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -7.28% (1.6025 => 1.4858, std.dev.: 0.0187)
  SingleSource/Benchmarks/McGill/misr: -5.60% (0.4199 => 0.3964, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.75% (6.1945 => 5.9004, std.dev.: 0.1117)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.00% (0.7673 => 0.7443, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/oourafft: -1.18% (3.7871 => 3.7425, std.dev.: 0.0080)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.16% (4.2372 => 4.1881, std.dev.: 0.0124)
  MultiSource/Applications/siod/siod: -1.08% (3.6532 => 3.6139, std.dev.: 0.0093)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.46% (0.1371 => 0.1351, std.dev.: 0.0056)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/siod/siod: 3.89% (2.4480 => 2.5432, std.dev.: 0.0147)
  SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.3771 => 0.3882, std.dev.: 0.0039)
  MultiSource/Applications/hbd/hbd: 2.38% (1.5696 => 1.6070, std.dev.: 0.0101)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.25% (7.6426 => 12.5533, std.dev.: 0.0452)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.75% (8.5256 => 9.7831, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.49% (0.8273 => 0.8893, std.dev.: 0.0035)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0002)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (8.1346 => 8.6481, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.17% (3.5550 => 3.7745, std.dev.: 0.0435)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.96% (6.5990 => 6.9924, std.dev.: 0.0750)
  SingleSource/Benchmarks/McGill/misr: 5.12% (0.3771 => 0.3964, std.dev.: 0.0010)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.35% (2.5368 => 2.6217, std.dev.: 0.0148)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.3836 => 0.3957, std.dev.: 0.0018)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.09% (5.3716 => 5.5378, std.dev.: 0.0585)
  MultiSource/Applications/spiff/spiff: 2.90% (2.8194 => 2.9013, std.dev.: 0.0306)
  MultiSource/Benchmarks/Olden/power/power: 2.38% (1.2170 => 1.2460, std.dev.: 0.0097)
  MultiSource/Applications/siod/siod: 2.35% (3.5310 => 3.6139, std.dev.: 0.0093)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (1.7652 => 1.8057, std.dev.: 0.0047)
  SingleSource/Regression/C/uint64_to_float: 2.08% (1.4528 => 1.4830, std.dev.: 0.0023)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.99% (2.4920 => 2.5415, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.77% (3.1569 => 3.2128, std.dev.: 0.0034)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.32% (16.7972 => 17.0194, std.dev.: 0.0296)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.50% (0.1483 => 0.1179, std.dev.: 0.0044)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.05% (0.5226 => 0.2349, std.dev.: 0.0614)
  MultiSource/Applications/sgefa/sgefa: -46.81% (1.5790 => 0.8398, std.dev.: 0.0005)
  SingleSource/Benchmarks/Linpack/linpack-pc: -20.91% (57.2347 => 45.2670, std.dev.: 3.4897)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.44% (15.9508 => 13.0098, std.dev.: 0.1838)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.99% (20.8247 => 18.7445, std.dev.: 0.0049)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.87% (3.4956 => 3.1505, std.dev.: 0.0286)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.20% (50.0284 => 45.9264, std.dev.: 0.3297)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.76% (3.7437 => 3.5282, std.dev.: 0.0591)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.93% (4.3592 => 4.1881, std.dev.: 0.0124)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.65% (2.5938 => 2.4990, std.dev.: 0.0184)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.29% (2.4471 => 2.3911, std.dev.: 0.0165)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.15% (4.9022 => 4.8456, std.dev.: 0.0133)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1348 => 0.1351, std.dev.: 0.0056)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131001/5f5148ff/attachment.html>


More information about the llvm-testresults mailing list