[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jul 4 22:32:40 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13091?compare_to=13087&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13091, Order: 185679, Start Time: 2013-07-05 03:46:47, End Time: 2013-07-05 05:33:54
      To: 13087, Order: 185677, Start Time: 2013-07-05 01:42:36, End Time: 2013-07-05 03:26:10
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 17 (36 on baseline)
Performance Improvements: 2 (45 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1088 (1026 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 55.22% (0.0670 => 0.1040, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 42.70% (0.0733 => 0.1046, std.dev.: 0.0059)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.41% (0.9779 => 0.9917, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.21% (4.1213 => 4.8305, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc/fp-convert: 15.39% (6.9859 => 8.0613, std.dev.: 0.0140)
  SingleSource/Benchmarks/Misc/salsa20: 11.68% (8.0445 => 8.9839, std.dev.: 0.0369)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.92% (2.8860 => 3.1146, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (4.7130 => 5.0664, std.dev.: 0.0156)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 6.56% (2.3240 => 2.4765, std.dev.: 0.0564)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.20% (3.9354 => 4.1794, std.dev.: 0.0812)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.72% (40.1062 => 42.3991, std.dev.: 0.2608)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.21% (2.3377 => 2.4595, std.dev.: 0.0223)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.53% (0.2693 => 0.2815, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.60% (1.4095 => 1.4602, std.dev.: 0.0086)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.26% (11.3753 => 11.6324, std.dev.: 0.0467)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.18% (5.5960 => 5.7181, std.dev.: 0.0443)
  SingleSource/Benchmarks/Misc/flops: 1.74% (9.6304 => 9.7978, std.dev.: 0.0145)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.11% (1.6421 => 1.6239, std.dev.: 0.0043)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: -15.30% (2.0496 => 1.7361, std.dev.: 0.0516)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.31% (0.1379 => 0.1397, std.dev.: 0.0226)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 55.92% (0.0667 => 0.1040, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 43.88% (0.0727 => 0.1046, std.dev.: 0.0059)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.98% (0.2721 => 0.2911, std.dev.: 0.0071)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.32% (2.6076 => 2.7725, std.dev.: 0.0631)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.26% (0.7059 => 0.7360, std.dev.: 0.0081)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 3.99% (1.5862 => 1.6495, std.dev.: 0.0051)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.2937 => 0.3044, std.dev.: 0.0018)
  MultiSource/Applications/hexxagon/hexxagon: 3.09% (1.0794 => 1.1128, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.26% (1.4991 => 1.5330, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.75% (1.5959 => 1.6239, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.69% (1.5108 => 1.5363, std.dev.: 0.0088)
  MultiSource/Applications/hbd/hbd: 1.65% (1.6386 => 1.6657, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.63% (1.6073 => 1.6335, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.43% (1.6881 => 1.7122, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 36.37% (2.5688 => 3.5030, std.dev.: 0.0055)
  MultiSource/Applications/sgefa/sgefa: 30.27% (1.1695 => 1.5235, std.dev.: 0.0295)
  SingleSource/Benchmarks/Misc/perlin: 26.67% (3.6271 => 4.5945, std.dev.: 0.0144)
  SingleSource/Benchmarks/Misc/mandel: 17.24% (1.0293 => 1.2068, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.05% (6.1372 => 7.1838, std.dev.: 0.2351)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.95% (0.9806 => 1.1370, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.98% (5.2003 => 5.6154, std.dev.: 0.0674)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.23% (3.1853 => 3.3839, std.dev.: 0.0004)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.04% (2.8994 => 3.0455, std.dev.: 0.0202)
  SingleSource/Benchmarks/Misc/fbench: 4.93% (4.7508 => 4.9851, std.dev.: 0.0092)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.69% (1.2224 => 1.2797, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.64% (1.0571 => 1.1062, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.63% (4.6639 => 4.8800, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.38% (40.6198 => 42.3991, std.dev.: 0.2608)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.73% (5.9362 => 6.1578, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.51% (5.2788 => 5.4643, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.98% (5.5010 => 5.6651, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.54% (4.6379 => 4.7555, std.dev.: 0.0045)
  MultiSource/Benchmarks/sim/sim: 2.32% (3.8805 => 3.9705, std.dev.: 0.0160)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.21% (34.3107 => 35.0700, std.dev.: 0.0649)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.02% (5.6582 => 5.7726, std.dev.: 0.0130)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.16% (11.4990 => 11.6324, std.dev.: 0.0467)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.49% (0.1113 => 0.0718, std.dev.: 0.0008)
  MultiSource/Applications/viterbi/viterbi: -24.23% (0.2431 => 0.1842, std.dev.: 0.0217)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.57% (0.2006 => 0.1794, std.dev.: 0.0049)
  MultiSource/Applications/lemon/lemon: -5.59% (1.3155 => 1.2419, std.dev.: 0.0103)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.32% (1.2911 => 0.7318, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -38.17% (4.4050 => 2.7238, std.dev.: 0.0602)
  MultiSource/Applications/lemon/lemon: -26.71% (1.3499 => 0.9894, std.dev.: 0.0567)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.61% (1.6105 => 1.2141, std.dev.: 0.0040)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.76% (9.1099 => 7.0368, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/hash: -21.33% (0.7941 => 0.6247, std.dev.: 0.0369)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.06% (4.8986 => 3.8671, std.dev.: 0.0094)
  SingleSource/Benchmarks/Shootout/hash: -20.27% (5.3656 => 4.2780, std.dev.: 0.2394)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.15% (5.7264 => 4.5727, std.dev.: 0.0548)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.71% (6.2328 => 5.0664, std.dev.: 0.0156)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.51% (25.3677 => 21.4321, std.dev.: 0.0929)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -15.00% (1.0251 => 0.8713, std.dev.: 0.0525)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.55% (0.1945 => 0.1662, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.79% (1.6613 => 1.4322, std.dev.: 0.0503)
  SingleSource/Benchmarks/Misc/salsa20: -13.11% (10.3398 => 8.9839, std.dev.: 0.0369)
  MultiSource/Benchmarks/FreeBench/neural/neural: -10.73% (0.3513 => 0.3136, std.dev.: 0.0130)
  MultiSource/Applications/siod/siod: -10.10% (3.7240 => 3.3477, std.dev.: 0.0993)
  SingleSource/Regression/C/uint64_to_float: -9.17% (1.6851 => 1.5306, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.40% (9.8728 => 9.0434, std.dev.: 0.0114)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.72% (0.1542 => 0.1423, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.19% (4.5717 => 4.2432, std.dev.: 0.0079)
  MultiSource/Applications/sqlite3/sqlite3: -6.79% (4.6358 => 4.3212, std.dev.: 0.0507)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.76% (5.5889 => 5.2112, std.dev.: 0.0311)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.24% (6.3757 => 6.0413, std.dev.: 0.0529)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.99% (3.5327 => 3.3565, std.dev.: 0.0656)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.93% (1.6535 => 1.5720, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.85% (5.3184 => 5.0602, std.dev.: 0.0660)
  SingleSource/Benchmarks/Misc/flops: -4.10% (10.2170 => 9.7978, std.dev.: 0.0145)
  SingleSource/Benchmarks/Misc/whetstone: -4.00% (3.5970 => 3.4531, std.dev.: 0.0295)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.67% (2.8537 => 2.7490, std.dev.: 0.0371)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.58% (1.6440 => 1.5852, std.dev.: 0.0106)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.92% (0.6548 => 0.6357, std.dev.: 0.0065)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.86% (0.4480 => 0.4352, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.76% (3.2030 => 3.1146, std.dev.: 0.0324)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.34% (48.3307 => 47.1981, std.dev.: 0.0452)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.22% (4.5094 => 4.4093, std.dev.: 0.0098)
  MultiSource/Benchmarks/llubenchmark/llu: -1.66% (2.0425 => 2.0086, std.dev.: 0.0094)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (4.9946 => 4.9160, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.38% (3.6122 => 3.5624, std.dev.: 0.0164)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.34% (12.1841 => 12.0209, std.dev.: 0.0630)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.25% (9.6556 => 9.5348, std.dev.: 0.0139)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.05% (0.1441 => 0.1397, std.dev.: 0.0226)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130705/26640b5f/attachment.html>


More information about the llvm-testresults mailing list