[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 5 12:54:25 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14114?compare_to=14111&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14114, Order: 187729, Start Time: 2013-08-05 18:02:50, End Time: 2013-08-05 19:56:15
      To: 14111, Order: 187727, Start Time: 2013-08-05 15:55:59, End Time: 2013-08-05 17:39:44
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 23 (41 on baseline)
Performance Improvements: 0 (35 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1082 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 73.74% (0.0697 => 0.1211, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.35% (0.0782 => 0.0902, std.dev.: 0.0039)
  MultiSource/Applications/ClamAV/clamscan: 12.34% (17.2095 => 19.3330, std.dev.: 0.7160)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.88% (0.1027 => 0.1149, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 11.19% (0.0983 => 0.1093, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 33.53% (37.0381 => 49.4573, std.dev.: 2.4044)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.32% (1.4873 => 1.8937, std.dev.: 0.0300)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.58% (21.1821 => 25.1167, std.dev.: 1.3964)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.62% (0.3149 => 0.3641, std.dev.: 0.0140)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 12.31% (2.9946 => 3.3632, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.37% (5.2201 => 5.8136, std.dev.: 0.1819)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 11.24% (2.8941 => 3.2195, std.dev.: 0.0556)
  SingleSource/Benchmarks/Misc/salsa20: 9.85% (8.1670 => 8.9715, std.dev.: 0.0542)
  MultiSource/Benchmarks/nbench/nbench: 8.99% (19.0576 => 20.7705, std.dev.: 0.0763)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.84% (3.9622 => 4.2728, std.dev.: 0.0408)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 7.79% (2.3315 => 2.5131, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/hash: 7.20% (0.7249 => 0.7771, std.dev.: 0.0116)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.72% (4.6796 => 4.8536, std.dev.: 0.0588)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.52% (4.4591 => 4.6159, std.dev.: 0.0060)
  MultiSource/Applications/spiff/spiff: 3.33% (2.8315 => 2.9259, std.dev.: 0.0277)
  MultiSource/Applications/siod/siod: 3.21% (3.8412 => 3.9644, std.dev.: 0.0193)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 3.14% (5.8174 => 5.9999, std.dev.: 0.0255)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.95% (1.0704 => 1.1020, std.dev.: 0.0034)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -2.47% (0.1334 => 0.1301, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.26% (0.2737 => 0.2744, std.dev.: 0.0035)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0279 => 0.0279, std.dev.: 0.0070)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.45% (0.2813 => 0.2744, std.dev.: 0.0035)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.13% (0.0345 => 0.0279, std.dev.: 0.0070)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 70.80% (0.0709 => 0.1211, std.dev.: 0.0054)
  SingleSource/Regression/C/bigstack: 39.27% (0.0466 => 0.0649, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 14.61% (0.0787 => 0.0902, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.21% (0.1024 => 0.1149, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 11.87% (0.0977 => 0.1093, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 70.91% (3.7285 => 6.3722, std.dev.: 0.0887)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.63% (2.8867 => 4.2905, std.dev.: 0.0355)
  MultiSource/Benchmarks/FreeBench/neural/neural: 37.56% (0.3171 => 0.4362, std.dev.: 0.0267)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 34.07% (36.8900 => 49.4573, std.dev.: 2.4044)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.99% (1.5030 => 1.8937, std.dev.: 0.0300)
  SingleSource/Benchmarks/Shootout-C++/hash: 23.45% (0.6295 => 0.7771, std.dev.: 0.0116)
  MultiSource/Applications/siod/siod: 17.43% (3.3761 => 3.9644, std.dev.: 0.0193)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 15.17% (2.9428 => 3.3891, std.dev.: 0.1470)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.75% (0.3173 => 0.3641, std.dev.: 0.0140)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.70% (7.0762 => 7.9751, std.dev.: 0.0255)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 12.25% (2.9962 => 3.3632, std.dev.: 0.0146)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.54% (0.1678 => 0.1838, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.88% (2.9568 => 3.2195, std.dev.: 0.0556)
  MultiSource/Applications/JM/lencod/lencod: 8.77% (7.1799 => 7.8099, std.dev.: 0.1168)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.25% (5.4910 => 5.9439, std.dev.: 0.0251)
  SingleSource/Benchmarks/McGill/chomp: 7.98% (1.0051 => 1.0853, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.93% (3.2027 => 3.4247, std.dev.: 0.0188)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.84% (48.3256 => 51.6328, std.dev.: 0.3150)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.62% (4.0075 => 4.2728, std.dev.: 0.0408)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.40% (0.2799 => 0.2978, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.01% (5.3042 => 5.6230, std.dev.: 0.0256)
  MultiSource/Applications/spiff/spiff: 5.98% (2.7609 => 2.9259, std.dev.: 0.0277)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.64% (3.3877 => 3.5787, std.dev.: 0.0485)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.57% (5.5008 => 5.8073, std.dev.: 0.0224)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.54% (3.4085 => 3.5975, std.dev.: 0.0367)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.18% (2.3894 => 2.5131, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/whetstone: 4.73% (3.4559 => 3.6195, std.dev.: 0.0579)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.23% (5.1471 => 5.3650, std.dev.: 0.0398)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.3151 => 4.4965, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.67% (3.3384 => 3.4610, std.dev.: 0.0475)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.44% (4.4624 => 4.6159, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.76% (5.8390 => 5.9999, std.dev.: 0.0255)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.57% (1.5956 => 1.6366, std.dev.: 0.0144)
  SingleSource/Benchmarks/Shootout/matrix: 2.51% (1.7358 => 1.7794, std.dev.: 0.0056)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.36% (1.1618 => 1.1776, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.25% (3.0680 => 3.1065, std.dev.: 0.0101)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.06% (0.2237 => 0.1475, std.dev.: 0.0011)
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.02% (0.1072 => 0.0718, std.dev.: 0.0072)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.59% (0.1818 => 0.1371, std.dev.: 0.0005)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.72% (0.1114 => 0.0872, std.dev.: 0.0053)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -21.04% (0.0675 => 0.0533, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/health/health: -19.87% (0.1993 => 0.1597, std.dev.: 0.0042)
  MultiSource/Applications/obsequi/Obsequi: -19.13% (1.4685 => 1.1876, std.dev.: 0.1031)
  MultiSource/Applications/hbd/hbd: -17.09% (2.0193 => 1.6743, std.dev.: 0.0912)
  MultiSource/Applications/hexxagon/hexxagon: -15.81% (1.3285 => 1.1184, std.dev.: 0.0491)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.39% (1.4514 => 1.3442, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.04% (1.5239 => 1.4318, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.21% (1.4166 => 1.3428, std.dev.: 0.0120)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.00% (2.1022 => 1.4294, std.dev.: 0.0023)
  MultiSource/Applications/lemon/lemon: -30.70% (1.4194 => 0.9837, std.dev.: 0.0482)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.15% (0.0816 => 0.0570, std.dev.: 0.0004)
  MultiSource/Benchmarks/MallocBench/gs/gs: -27.50% (0.1189 => 0.0862, std.dev.: 0.0009)
  MultiSource/Applications/viterbi/viterbi: -27.05% (3.4923 => 2.5476, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.65% (6.9552 => 5.2404, std.dev.: 0.0244)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6131, std.dev.: 0.0534)
  SingleSource/Benchmarks/Misc/mandel: -14.66% (1.1996 => 1.0237, std.dev.: 0.0360)
  MultiSource/Applications/sgefa/sgefa: -14.06% (1.4030 => 1.2057, std.dev.: 0.0089)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.53% (0.3557 => 0.3147, std.dev.: 0.0057)
  MultiSource/Applications/lua/lua: -8.56% (31.0707 => 28.4121, std.dev.: 0.2745)
  SingleSource/Benchmarks/Shootout/strcat: -7.85% (0.1593 => 0.1468, std.dev.: 0.0039)
  MultiSource/Benchmarks/nbench/nbench: -5.62% (22.0083 => 20.7705, std.dev.: 0.0763)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.21% (47.2250 => 44.7641, std.dev.: 0.2077)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.21% (1.7207 => 1.6311, std.dev.: 0.0314)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.41% (0.4969 => 0.4750, std.dev.: 0.0024)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.38% (0.7355 => 0.7033, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/fbench: -4.04% (4.9602 => 4.7598, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9616, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.77% (5.2218 => 5.0770, std.dev.: 0.0224)
  SingleSource/Benchmarks/Misc/oourafft: -2.11% (3.7891 => 3.7091, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.56% (5.0180 => 4.9395, std.dev.: 0.0200)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.18% (1.3104 => 1.2950, std.dev.: 0.0019)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.59% (0.1378 => 0.1301, std.dev.: 0.0046)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130805/35e0e46c/attachment.html>


More information about the llvm-testresults mailing list