[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jul 5 15:48:38 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13118?compare_to=13115&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13118, Order: 185721, Start Time: 2013-07-05 21:00:53, End Time: 2013-07-05 22:49:53
      To: 13115, Order: 185710, Start Time: 2013-07-05 18:45:57, End Time: 2013-07-05 20:37:38
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 5 (27 on baseline)
Performance Improvements: 23 (56 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1079 (1024 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: 11.62% (0.2117 => 0.2363, std.dev.: 0.0077)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.92% (0.8535 => 0.9040, std.dev.: 0.0181)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.15% (0.6390 => 0.6655, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.00% (5.3126 => 5.4191, std.dev.: 0.0277)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.34% (1.5773 => 1.5984, std.dev.: 0.0033)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -26.53% (0.1127 => 0.0828, std.dev.: 0.0095)
  SingleSource/Benchmarks/Shootout/heapsort: -18.05% (0.0565 => 0.0463, std.dev.: 0.0028)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -16.97% (0.1497 => 0.1243, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -16.18% (0.0921 => 0.0772, std.dev.: 0.0007)
  MultiSource/Applications/sgefa/sgefa: -13.63% (0.4849 => 0.4188, std.dev.: 0.0180)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -10.93% (1.2546 => 1.1175, std.dev.: 0.0189)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.40% (1.7938 => 1.6611, std.dev.: 0.0399)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.87% (0.5166 => 0.4811, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.86% (1.8325 => 1.7068, std.dev.: 0.0487)
  SingleSource/Benchmarks/Shootout-C++/lists1: -5.39% (0.3581 => 0.3388, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.25% (1.5446 => 1.4635, std.dev.: 0.0276)
  SingleSource/Benchmarks/Shootout-C++/sieve: -5.24% (0.3299 => 0.3126, std.dev.: 0.0048)
  MultiSource/Benchmarks/Prolangs-C/football/football: -2.83% (1.0699 => 1.0396, std.dev.: 0.0034)
  MultiSource/Applications/Burg/burg: -2.59% (1.5035 => 1.4645, std.dev.: 0.0112)
  MultiSource/Applications/hbd/hbd: -2.28% (1.6857 => 1.6472, std.dev.: 0.0124)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -46.80% (0.0344 => 0.0183, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -35.82% (4.5800 => 2.9396, std.dev.: 0.4080)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -13.86% (43.0997 => 37.1261, std.dev.: 2.3015)
  SingleSource/Benchmarks/Shootout-C++/lists1: -11.26% (0.6811 => 0.6044, std.dev.: 0.0254)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.84% (1.1500 => 1.0713, std.dev.: 0.0273)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.71% (1.4636 => 1.4093, std.dev.: 0.0200)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.15% (7.2605 => 7.0315, std.dev.: 0.0851)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.9002 => 1.8732, std.dev.: 0.0089)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1361 => 0.1395, std.dev.: 0.0033)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: 9.86% (0.2151 => 0.2363, std.dev.: 0.0077)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.01% (1.0292 => 1.0396, std.dev.: 0.0034)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 35.71% (2.5688 => 3.4860, std.dev.: 0.0439)
  MultiSource/Applications/sgefa/sgefa: 29.50% (1.1695 => 1.5145, std.dev.: 0.0075)
  SingleSource/Benchmarks/Misc/perlin: 26.57% (3.6271 => 4.5907, std.dev.: 0.0203)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 23.97% (0.0459 => 0.0569, std.dev.: 0.0033)
  SingleSource/Benchmarks/Stanford/Puzzle: 19.86% (0.1455 => 0.1744, std.dev.: 0.0060)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.80% (2.5366 => 2.9628, std.dev.: 0.1035)
  SingleSource/Benchmarks/Misc/mandel: 16.76% (1.0293 => 1.2018, std.dev.: 0.0060)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.09% (0.9806 => 1.1384, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.57% (6.1372 => 7.0315, std.dev.: 0.0851)
  MultiSource/Applications/lua/lua: 10.22% (28.2496 => 31.1356, std.dev.: 0.2417)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.23% (0.8276 => 0.9040, std.dev.: 0.0181)
  SingleSource/Benchmarks/Shootout/strcat: 8.04% (0.1456 => 0.1573, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.03% (5.2003 => 5.6178, std.dev.: 0.0777)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.16% (3.1853 => 3.3815, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.88% (3.2201 => 3.3773, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.85% (4.6639 => 4.8901, std.dev.: 0.0418)
  SingleSource/Benchmarks/Misc/fbench: 4.81% (4.7508 => 4.9793, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.75% (5.9362 => 6.1587, std.dev.: 0.0655)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.56% (5.2788 => 5.4665, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.90% (5.5010 => 5.6608, std.dev.: 0.0408)
  SingleSource/Benchmarks/Misc/ffbench: 2.79% (1.3696 => 1.4078, std.dev.: 0.0072)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.21% (34.3107 => 35.0705, std.dev.: 0.0753)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (4.3727 => 4.4612, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.70% (5.6582 => 5.7542, std.dev.: 0.0061)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.63% (0.6548 => 0.6655, std.dev.: 0.0012)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.40% (0.1113 => 0.0719, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.19% (0.0803 => 0.0673, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/whetstone: -14.68% (0.1097 => 0.0936, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -11.56% (0.7918 => 0.7003, std.dev.: 0.0284)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.77% (0.2006 => 0.1790, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.36% (0.8025 => 0.7274, std.dev.: 0.0228)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (0.1224 => 0.1121, std.dev.: 0.0039)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -8.06% (0.1563 => 0.1437, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.30% (1.7804 => 1.6505, std.dev.: 0.0471)
  MultiSource/Applications/lemon/lemon: -6.74% (1.3155 => 1.2268, std.dev.: 0.0191)
  MultiSource/Applications/Burg/burg: -4.75% (1.5375 => 1.4645, std.dev.: 0.0112)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.31% (0.8649 => 0.8276, std.dev.: 0.0119)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.55% (1.2911 => 0.7288, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.88% (4.4050 => 2.7366, std.dev.: 0.0143)
  MultiSource/Applications/lemon/lemon: -33.58% (1.3499 => 0.8966, std.dev.: 0.0714)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.64% (1.6105 => 1.2136, std.dev.: 0.0154)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.81% (9.1099 => 7.0318, std.dev.: 0.0258)
  SingleSource/Benchmarks/Shootout/hash: -22.50% (5.3656 => 4.1581, std.dev.: 0.2635)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.02% (4.8986 => 3.8689, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.08% (5.7264 => 4.5764, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.80% (6.2328 => 5.0612, std.dev.: 0.0284)
  SingleSource/Benchmarks/Shootout-C++/hash: -18.69% (0.7941 => 0.6457, std.dev.: 0.0153)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.98% (25.3677 => 21.3138, std.dev.: 0.1127)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.67% (1.6679 => 1.4399, std.dev.: 0.0797)
  SingleSource/Benchmarks/Misc/salsa20: -13.26% (10.3398 => 8.9692, std.dev.: 0.0325)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.07% (1.6613 => 1.4441, std.dev.: 0.0661)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -10.51% (0.1542 => 0.1380, std.dev.: 0.0060)
  SingleSource/Regression/C/uint64_to_float: -10.31% (1.6851 => 1.5114, std.dev.: 0.0285)
  MultiSource/Applications/siod/siod: -10.05% (3.7240 => 3.3498, std.dev.: 0.1134)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.50% (9.8728 => 9.0339, std.dev.: 0.0212)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -8.19% (2.5087 => 2.3032, std.dev.: 0.0736)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.24% (4.5717 => 4.2408, std.dev.: 0.0156)
  MultiSource/Applications/sqlite3/sqlite3: -7.20% (4.6358 => 4.3018, std.dev.: 0.0303)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -6.80% (2.8537 => 2.6597, std.dev.: 0.0622)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.71% (5.5889 => 5.2140, std.dev.: 0.0117)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.13% (3.5939 => 3.3736, std.dev.: 0.0383)
  SingleSource/Benchmarks/Misc/flops: -5.72% (10.2170 => 9.6324, std.dev.: 0.1025)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -5.46% (1.3084 => 1.2369, std.dev.: 0.0121)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.29% (6.3757 => 6.0384, std.dev.: 0.0124)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.97% (3.5327 => 3.3571, std.dev.: 0.0632)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.82% (5.3184 => 5.0620, std.dev.: 0.0661)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.67% (1.4783 => 1.4093, std.dev.: 0.0200)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3276 => 5.1024, std.dev.: 0.0512)
  SingleSource/Benchmarks/Misc/whetstone: -3.53% (3.5970 => 3.4701, std.dev.: 0.0063)
  MultiSource/Applications/hexxagon/hexxagon: -3.38% (15.4979 => 14.9748, std.dev.: 0.0475)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -3.33% (1.6535 => 1.5984, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -3.05% (4.5935 => 4.4532, std.dev.: 0.0184)
  SingleSource/Benchmarks/Shootout/sieve: -2.87% (8.0178 => 7.7874, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -2.69% (1.6440 => 1.5997, std.dev.: 0.0078)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.50% (48.3307 => 47.1222, std.dev.: 0.3083)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.43% (3.8665 => 3.7726, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.72% (4.2167 => 4.1442, std.dev.: 0.0188)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.63% (4.9946 => 4.9131, std.dev.: 0.0316)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.52% (1.1791 => 1.1612, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.35% (1.8989 => 1.8732, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.18% (9.6556 => 9.5412, std.dev.: 0.0436)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.19% (0.1441 => 0.1395, std.dev.: 0.0033)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130705/7bdcde96/attachment.html>


More information about the llvm-testresults mailing list