[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Sep 11 14:22:44 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15200?compare_to=15196&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15200, Order: 190540, Start Time: 2013-09-11 19:31:44, End Time: 2013-09-11 21:25:15
      To: 15196, Order: 190528, Start Time: 2013-09-11 17:10:35, End Time: 2013-09-11 19:03:48
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 21 (31 on baseline)
Performance Improvements: 27 (1 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1059 (1075 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 68.36% (0.0749 => 0.1261, std.dev.: 0.0112)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 61.02% (0.1742 => 0.2805, std.dev.: 0.0158)
  MultiSource/Applications/viterbi/viterbi: 25.45% (0.2051 => 0.2573, std.dev.: 0.0132)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 24.73% (4.6097 => 5.7495, std.dev.: 0.1369)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.10% (1.9394 => 2.3487, std.dev.: 0.0990)
  MultiSource/Applications/ClamAV/clamscan: 9.77% (16.6557 => 18.2823, std.dev.: 0.2713)
  SingleSource/Benchmarks/Shootout-C++/hash2: 7.83% (0.4382 => 0.4725, std.dev.: 0.0033)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.29% (0.1638 => 0.1741, std.dev.: 0.0020)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 29.09% (37.8685 => 48.8838, std.dev.: 0.3705)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.67% (30.3689 => 36.3434, std.dev.: 0.5211)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 19.67% (0.1281 => 0.1533, std.dev.: 0.0072)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 7.91% (0.4524 => 0.4882, std.dev.: 0.0076)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.29% (2.9739 => 3.1312, std.dev.: 0.0337)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.94% (3.6560 => 3.8367, std.dev.: 0.0213)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.35% (2.4027 => 2.5072, std.dev.: 0.0192)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.75% (4.0832 => 4.2362, std.dev.: 0.0384)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.51% (8.1363 => 8.4221, std.dev.: 0.0935)
  SingleSource/Benchmarks/Linpack/linpack-pc: 2.93% (57.0382 => 58.7081, std.dev.: 0.3858)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.81% (4.2376 => 4.3568, std.dev.: 0.0419)
  SingleSource/Benchmarks/Misc/fp-convert: 1.80% (7.5348 => 7.6701, std.dev.: 0.0250)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.55% (5.8497 => 5.9401, std.dev.: 0.0069)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -29.88% (1.6270 => 1.1409, std.dev.: 0.0367)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -29.10% (0.2041 => 0.1447, std.dev.: 0.0050)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -25.30% (1.5273 => 1.1409, std.dev.: 0.0196)
  MultiSource/Benchmarks/Olden/health/health: -21.65% (0.1995 => 0.1563, std.dev.: 0.0120)
  MultiSource/Applications/lua/lua: -19.30% (5.1899 => 4.1885, std.dev.: 0.0596)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -18.68% (1.8401 => 1.4963, std.dev.: 0.1100)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -16.16% (0.2055 => 0.1723, std.dev.: 0.0048)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -11.56% (28.2148 => 24.9541, std.dev.: 0.9617)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -11.29% (0.1284 => 0.1139, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -10.82% (1.4901 => 1.3289, std.dev.: 0.0208)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -10.26% (1.3485 => 1.2102, std.dev.: 0.0438)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -10.17% (1.5038 => 1.3508, std.dev.: 0.0205)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -10.15% (0.1133 => 0.1018, std.dev.: 0.0043)
  MultiSource/Applications/kimwitu++/kc: -10.09% (20.6608 => 18.5763, std.dev.: 0.7552)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -9.50% (0.3747 => 0.3391, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -9.36% (1.4034 => 1.2720, std.dev.: 0.0146)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.40% (6.9260 => 6.3444, std.dev.: 0.2070)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.73% (1.2548 => 1.2205, std.dev.: 0.0075)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/minisat/minisat: -26.52% (8.7180 => 6.4061, std.dev.: 0.2006)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -24.40% (1.7476 => 1.3212, std.dev.: 0.0390)
  MultiSource/Benchmarks/nbench/nbench: -14.31% (23.1492 => 19.8371, std.dev.: 1.0717)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -13.14% (2.4088 => 2.0922, std.dev.: 0.0871)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.82% (100.3819 => 94.5420, std.dev.: 1.7169)
  SingleSource/Benchmarks/Misc/ffbench: -3.48% (1.4270 => 1.3773, std.dev.: 0.0171)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.52% (3.6955 => 3.6022, std.dev.: 0.0061)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.98% (50.8561 => 49.8480, std.dev.: 0.1869)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.51% (1.2056 => 1.1874, std.dev.: 0.0055)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.46% (0.1370 => 0.1350, std.dev.: 0.0144)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 71.10% (0.0737 => 0.1261, std.dev.: 0.0112)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 70.21% (0.1648 => 0.2805, std.dev.: 0.0158)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 43.60% (0.3096 => 0.4446, std.dev.: 0.0375)
  MultiSource/Applications/viterbi/viterbi: 30.21% (0.1976 => 0.2573, std.dev.: 0.0132)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.10% (1.8775 => 2.3487, std.dev.: 0.0990)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 23.85% (4.6423 => 5.7495, std.dev.: 0.1369)
  SingleSource/Benchmarks/McGill/queens: 19.88% (0.0503 => 0.0603, std.dev.: 0.0020)
  MultiSource/Applications/ClamAV/clamscan: 10.54% (16.5398 => 18.2823, std.dev.: 0.2713)
  SingleSource/Benchmarks/Shootout-C++/strcat: 9.05% (0.2021 => 0.2204, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/hash2: 8.15% (0.4369 => 0.4725, std.dev.: 0.0033)
  MultiSource/Applications/oggenc/oggenc: 7.13% (5.3339 => 5.7144, std.dev.: 0.1032)
  SingleSource/Benchmarks/Shootout-C++/objinst: 6.56% (0.2119 => 0.2258, std.dev.: 0.0044)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.35% (0.1637 => 0.1741, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.61% (0.6439 => 0.6800, std.dev.: 0.0136)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 32.69% (36.8417 => 48.8838, std.dev.: 0.3705)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.40% (1.4830 => 1.8893, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 20.41% (30.1838 => 36.3434, std.dev.: 0.5211)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 16.99% (40.5588 => 47.4516, std.dev.: 1.2262)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.18% (0.1331 => 0.1533, std.dev.: 0.0072)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.61% (2.3084 => 2.5072, std.dev.: 0.0192)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.60% (2.9372 => 3.1312, std.dev.: 0.0337)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.29% (3.9856 => 4.2362, std.dev.: 0.0384)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 5.40% (3.6401 => 3.8367, std.dev.: 0.0213)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.53% (8.1346 => 8.4221, std.dev.: 0.0935)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.39% (6.5990 => 6.8225, std.dev.: 0.0557)
  SingleSource/Benchmarks/McGill/misr: 3.34% (0.3771 => 0.3897, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.85% (5.7757 => 5.9401, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.78% (4.2391 => 4.3568, std.dev.: 0.0419)
  SingleSource/Benchmarks/Linpack/linpack-pc: 2.57% (57.2347 => 58.7081, std.dev.: 0.3858)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.97% (5.8715 => 5.9871, std.dev.: 0.0374)
  SingleSource/Benchmarks/Misc/fp-convert: 1.09% (7.5877 => 7.6701, std.dev.: 0.0250)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.82% (3.6646 => 3.5979, std.dev.: 0.0227)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.15% (0.1348 => 0.1350, std.dev.: 0.0144)

Report Time: 0.32s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130911/99b49f3d/attachment.html>


More information about the llvm-testresults mailing list