[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 10 09:20:34 PST 2013


http://llvm.org/perf/db_default/v4/nts/18253?compare_to=18249&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18253, Order: 196924, Start Time: 2013-12-10 15:35:39, End Time: 2013-12-10 17:24:47
      To: 18249, Order: 196916, Start Time: 2013-12-10 13:23:53, End Time: 2013-12-10 15:09:12
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 49 (45 on baseline)
Performance Improvements: 6 (7 on baseline)
Unchanged Tests: 1055 (1058 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: 71.46% (0.0508 => 0.0871, std.dev.: 0.0061)
  MultiSource/Benchmarks/Olden/power/power: 51.70% (0.1412 => 0.2142, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 45.06% (0.1964 => 0.2849, std.dev.: 0.0149)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.53% (0.0561 => 0.0794, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/bh/bh: 38.43% (0.3201 => 0.4431, std.dev.: 0.0292)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 36.72% (0.9681 => 1.3236, std.dev.: 0.0373)
  MultiSource/Benchmarks/Olden/mst/mst: 31.82% (0.1323 => 0.1744, std.dev.: 0.0080)
  MultiSource/Benchmarks/McCat/05-eks/eks: 31.34% (0.5230 => 0.6869, std.dev.: 0.0313)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 29.39% (0.6666 => 0.8625, std.dev.: 0.0145)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 23.10% (4.9453 => 6.0876, std.dev.: 0.4063)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.25% (1.1117 => 1.3591, std.dev.: 0.0465)
  SingleSource/Benchmarks/Stanford/Oscar: 21.27% (0.0677 => 0.0821, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.15% (0.9292 => 1.1164, std.dev.: 0.0500)
  MultiSource/Benchmarks/MallocBench/gs/gs: 20.12% (4.6691 => 5.6083, std.dev.: 0.3057)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.34% (1.3962 => 1.6662, std.dev.: 0.0650)
  MultiSource/Applications/d/make_dparser: 13.75% (3.5554 => 4.0444, std.dev.: 0.1783)
  MultiSource/Benchmarks/mafft/pairlocalalign: 8.97% (10.0828 => 10.9874, std.dev.: 0.1249)
  MultiSource/Benchmarks/nbench/nbench: 8.89% (1.2313 => 1.3408, std.dev.: 0.0325)
  MultiSource/Applications/siod/siod: 8.22% (2.5261 => 2.7337, std.dev.: 0.0759)
  MultiSource/Applications/kimwitu++/kc: 6.11% (18.5146 => 19.6452, std.dev.: 0.1659)
  MultiSource/Applications/sqlite3/sqlite3: 5.26% (15.8156 => 16.6469, std.dev.: 0.2754)
  MultiSource/Applications/lemon/lemon: 4.64% (1.2091 => 1.2652, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.53% (1.2107 => 1.2413, std.dev.: 0.0026)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.00% (0.6259 => 0.6384, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.99% (1.2787 => 1.3042, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.57% (1.2776 => 1.2977, std.dev.: 0.0054)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 92.05% (0.1333 => 0.2560, std.dev.: 0.0207)
  SingleSource/Benchmarks/Stanford/Towers: 88.21% (0.0212 => 0.0399, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 45.73% (0.0562 => 0.0819, std.dev.: 0.0059)
  SingleSource/Benchmarks/Stanford/Perm: 45.19% (0.0312 => 0.0453, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 28.96% (0.0670 => 0.0864, std.dev.: 0.0045)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 19.78% (3.8384 => 4.5975, std.dev.: 0.1483)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.38% (2.4760 => 2.9310, std.dev.: 0.0234)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.62% (9.3137 => 10.5826, std.dev.: 0.0691)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.85% (2.0997 => 2.3695, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 10.47% (3.8483 => 4.2512, std.dev.: 0.0520)
  SingleSource/Benchmarks/Misc/salsa20: 9.27% (7.4714 => 8.1639, std.dev.: 0.0249)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (5.0323 => 5.4036, std.dev.: 0.0195)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.48% (60.5234 => 63.8377, std.dev.: 1.1612)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.83% (4.5734 => 4.7945, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.76% (4.0995 => 4.2948, std.dev.: 0.0262)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.17% (94.7848 => 98.7397, std.dev.: 1.2551)
  SingleSource/Benchmarks/Misc/flops: 3.50% (9.2679 => 9.5920, std.dev.: 0.0171)
  MultiSource/Benchmarks/Olden/bh/bh: 3.38% (2.3861 => 2.4667, std.dev.: 0.0278)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.89% (5.9146 => 6.0853, std.dev.: 0.0380)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.25% (39.4835 => 40.3706, std.dev.: 0.1732)
  SingleSource/Benchmarks/Misc/ffbench: 2.18% (1.4301 => 1.4613, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.25% (5.2570 => 5.3229, std.dev.: 0.0227)
  SingleSource/Benchmarks/Misc/flops-1: 1.10% (2.2797 => 2.3047, std.dev.: 0.0027)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/ReedSolomon: -8.26% (9.2721 => 8.5065, std.dev.: 0.1028)
  SingleSource/Benchmarks/McGill/misr: -7.96% (0.4156 => 0.3825, std.dev.: 0.0113)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.92% (3.8420 => 3.7298, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/fp-convert: -1.71% (7.7259 => 7.5939, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.54% (12.1475 => 11.9610, std.dev.: 0.0618)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.17% (6.8431 => 6.7628, std.dev.: 0.0108)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: 70.12% (0.0512 => 0.0871, std.dev.: 0.0061)
  MultiSource/Benchmarks/Olden/power/power: 52.35% (0.1406 => 0.2142, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 41.60% (0.2012 => 0.2849, std.dev.: 0.0149)
  MultiSource/Benchmarks/Olden/bh/bh: 34.72% (0.3289 => 0.4431, std.dev.: 0.0292)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 34.12% (0.0592 => 0.0794, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 30.74% (0.6597 => 0.8625, std.dev.: 0.0145)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 29.80% (1.0197 => 1.3236, std.dev.: 0.0373)
  MultiSource/Benchmarks/McCat/05-eks/eks: 29.07% (0.5322 => 0.6869, std.dev.: 0.0313)
  MultiSource/Benchmarks/Olden/mst/mst: 27.39% (0.1369 => 0.1744, std.dev.: 0.0080)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.72% (0.8880 => 1.1164, std.dev.: 0.0500)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.49% (1.0830 => 1.3591, std.dev.: 0.0465)
  SingleSource/Benchmarks/Stanford/Oscar: 20.03% (0.0684 => 0.0821, std.dev.: 0.0049)
  MultiSource/Benchmarks/MallocBench/gs/gs: 19.68% (4.6860 => 5.6083, std.dev.: 0.3057)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.32% (1.4449 => 1.6662, std.dev.: 0.0650)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.57% (10.3096 => 10.9874, std.dev.: 0.1249)
  MultiSource/Applications/sqlite3/sqlite3: 5.75% (15.7419 => 16.6469, std.dev.: 0.2754)
  MultiSource/Applications/kimwitu++/kc: 5.13% (18.6861 => 19.6452, std.dev.: 0.1659)
  MultiSource/Applications/lemon/lemon: 3.70% (1.2200 => 1.2652, std.dev.: 0.0086)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 90.33% (0.1345 => 0.2560, std.dev.: 0.0207)
  SingleSource/Benchmarks/Stanford/Towers: 46.15% (0.0273 => 0.0399, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 43.18% (0.0572 => 0.0819, std.dev.: 0.0059)
  SingleSource/Benchmarks/Stanford/Perm: 36.45% (0.0332 => 0.0453, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 29.54% (0.0667 => 0.0864, std.dev.: 0.0045)
  SingleSource/Benchmarks/Stanford/Puzzle: 21.52% (0.1668 => 0.2027, std.dev.: 0.0131)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.68% (2.5559 => 2.9310, std.dev.: 0.0234)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 13.33% (4.0567 => 4.5975, std.dev.: 0.1483)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.73% (2.1020 => 2.3695, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 9.33% (3.8883 => 4.2512, std.dev.: 0.0520)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.49% (1.1019 => 1.1955, std.dev.: 0.0263)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.78% (35.9684 => 38.7665, std.dev.: 1.0127)
  SingleSource/Benchmarks/Misc/salsa20: 7.49% (7.5947 => 8.1639, std.dev.: 0.0249)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (5.0320 => 5.4036, std.dev.: 0.0195)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 5.60% (10.0217 => 10.5826, std.dev.: 0.0691)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.49% (4.5883 => 4.7945, std.dev.: 0.0128)
  SingleSource/Benchmarks/Misc/ffbench: 3.62% (1.4103 => 1.4613, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.58% (4.1462 => 4.2948, std.dev.: 0.0262)
  SingleSource/Benchmarks/Misc/flops: 3.50% (9.2673 => 9.5920, std.dev.: 0.0171)
  MultiSource/Benchmarks/Olden/bh/bh: 3.13% (2.3919 => 2.4667, std.dev.: 0.0278)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.91% (5.9133 => 6.0853, std.dev.: 0.0380)
  SingleSource/Benchmarks/Misc/fp-convert: 2.77% (7.3892 => 7.5939, std.dev.: 0.0180)
  MultiSource/Applications/JM/lencod/lencod: 2.61% (7.9450 => 8.1521, std.dev.: 0.0658)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.34% (18.6185 => 19.0548, std.dev.: 0.0087)
  MultiSource/Applications/aha/aha: 1.77% (3.5645 => 3.6277, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.42% (5.2486 => 5.3229, std.dev.: 0.0227)
  MultiSource/Applications/viterbi/viterbi: 1.07% (2.6366 => 2.6647, std.dev.: 0.0087)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.78% (0.6882 => 0.6553, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.25% (1.4113 => 1.3513, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.43% (1.3505 => 1.3042, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.26% (1.5305 => 1.4806, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.16% (1.3264 => 1.2977, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.35% (1.2583 => 1.2413, std.dev.: 0.0026)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.06% (6.0535 => 5.8683, std.dev.: 0.0152)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131210/55f7ecef/attachment.html>


More information about the llvm-testresults mailing list