[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Oct 20 07:19:28 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16501?compare_to=16498&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16501, Order: 193047, Start Time: 2013-10-20 12:39:19, End Time: 2013-10-20 14:22:43
      To: 16498, Order: 193044, Start Time: 2013-10-20 07:01:07, End Time: 2013-10-20 08:42:07
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 12 (55 on baseline)
Performance Improvements: 2 (26 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1093 (1026 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.30% (1.2137 => 1.2295, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.27% (1.3012 => 1.3177, std.dev.: 0.0004)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/ReedSolomon: 12.57% (8.5979 => 9.6787, std.dev.: 0.0689)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.80% (43.6531 => 47.0564, std.dev.: 0.0786)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.77% (5.2383 => 5.4360, std.dev.: 0.0009)
  MultiSource/Applications/hexxagon/hexxagon: 2.79% (15.3415 => 15.7691, std.dev.: 0.0145)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 2.39% (9.2783 => 9.5005, std.dev.: 0.0390)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.14% (2.2948 => 2.3438, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout/fib2: 1.93% (3.5823 => 3.6515, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.57% (11.9434 => 12.1313, std.dev.: 0.0032)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.56% (23.4500 => 23.8165, std.dev.: 0.0100)
  MultiSource/Applications/sgefa/sgefa: 1.44% (0.9055 => 0.9185, std.dev.: 0.0005)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.19% (25.5190 => 25.2152, std.dev.: 0.1130)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.03% (7.5334 => 7.2296, std.dev.: 0.0859)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1363 => 0.1362, std.dev.: 0.0066)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/oourafft: 6.97% (0.2294 => 0.2454, std.dev.: 0.0019)
  MultiSource/Applications/d/make_dparser: 4.01% (3.4962 => 3.6363, std.dev.: 0.0081)
  MultiSource/Applications/lemon/lemon: 3.69% (1.1862 => 1.2300, std.dev.: 0.0154)
  MultiSource/Applications/siod/siod: 3.53% (2.4480 => 2.5345, std.dev.: 0.0316)
  MultiSource/Benchmarks/Prolangs-C/football/football: 3.06% (0.9828 => 1.0129, std.dev.: 0.0043)
  MultiSource/Applications/Burg/burg: 2.89% (1.3994 => 1.4399, std.dev.: 0.0075)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.51% (1.1393 => 1.1679, std.dev.: 0.0049)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.51% (9.9903 => 10.2408, std.dev.: 0.0273)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.44% (24.6139 => 25.2152, std.dev.: 0.1130)
  MultiSource/Applications/treecc/treecc: 2.33% (2.2516 => 2.3040, std.dev.: 0.0110)
  MultiSource/Benchmarks/Bullet/bullet: 2.21% (32.7552 => 33.4776, std.dev.: 0.0813)
  MultiSource/Applications/minisat/minisat: 2.14% (0.7439 => 0.7598, std.dev.: 0.0009)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (9.7354 => 9.9316, std.dev.: 0.0348)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.89% (1.2932 => 1.3177, std.dev.: 0.0004)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.57% (44.2807 => 44.9767, std.dev.: 0.1471)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.49% (1.0952 => 1.1115, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.39% (1.2007 => 1.2174, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.05% (1.2630 => 1.2763, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.02% (1.2639 => 1.2768, std.dev.: 0.0013)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 65.54% (7.6426 => 12.6512, std.dev.: 0.0219)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.30% (2.8554 => 3.9490, std.dev.: 0.0006)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 22.32% (1.1431 => 1.3982, std.dev.: 0.0525)
  SingleSource/Benchmarks/Shootout/matrix: 18.62% (1.7809 => 2.1125, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/sieve: 17.54% (7.2254 => 8.4929, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/ReedSolomon: 13.53% (8.5256 => 9.6787, std.dev.: 0.0689)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.22% (6.4425 => 7.2296, std.dev.: 0.0859)
  SingleSource/Benchmarks/McGill/misr: 10.16% (0.3771 => 0.4154, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.06% (2.4753 => 2.6749, std.dev.: 0.0110)
  MultiSource/Applications/hexxagon/hexxagon: 6.68% (14.7810 => 15.7691, std.dev.: 0.0145)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930)
  MultiSource/Applications/aha/aha: 5.73% (3.5731 => 3.7777, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.50% (3.1730 => 3.3475, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.82% (5.7757 => 5.9961, std.dev.: 0.0009)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.65% (2.5368 => 2.6294, std.dev.: 0.0341)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.54% (5.3716 => 5.5615, std.dev.: 0.0516)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.12% (89.7126 => 92.5142, std.dev.: 0.4032)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.10% (4.0181 => 4.1426, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/fp-convert: 2.79% (7.5877 => 7.7994, std.dev.: 0.0249)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.75% (1.7652 => 1.8138, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.52% (1.8519 => 1.8986, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.40% (5.4925 => 5.6245, std.dev.: 0.0003)
  SingleSource/Regression/C/uint64_to_float: 2.00% (1.4528 => 1.4819, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.00% (3.1569 => 3.2201, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.91% (1.5940 => 1.6244, std.dev.: 0.0102)
  SingleSource/Benchmarks/Shootout/lists: 1.86% (7.3703 => 7.5071, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.70% (11.9288 => 12.1313, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.53% (2.3084 => 2.3438, std.dev.: 0.0037)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (2.4920 => 2.5302, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout/fib2: 1.53% (3.5966 => 3.6515, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout/methcall: 1.47% (8.5434 => 8.6694, std.dev.: 0.0187)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.47% (23.4704 => 23.8165, std.dev.: 0.0100)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6950, std.dev.: 0.0001)
  MultiSource/Applications/sqlite3/sqlite3: 1.24% (4.2733 => 4.3262, std.dev.: 0.0117)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (16.7972 => 16.9804, std.dev.: 0.0311)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.63% (0.1483 => 0.1177, std.dev.: 0.0004)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.21% (0.1195 => 0.1085, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.58% (0.2571 => 0.2376, std.dev.: 0.0005)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -52.56% (0.5226 => 0.2479, std.dev.: 0.0297)
  MultiSource/Applications/sgefa/sgefa: -41.83% (1.5790 => 0.9185, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.75% (0.0400 => 0.0273, std.dev.: 0.0041)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.23% (15.9508 => 12.8828, std.dev.: 0.1006)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.49% (50.0284 => 40.7764, std.dev.: 1.7480)
  SingleSource/Benchmarks/Shootout/heapsort: -18.10% (3.5900 => 2.9403, std.dev.: 0.0107)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.78% (57.2347 => 47.0564, std.dev.: 0.0786)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -14.89% (1.7197 => 1.4637, std.dev.: 0.0039)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -10.90% (4.1004 => 3.6534, std.dev.: 0.1655)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.98% (20.8247 => 18.7462, std.dev.: 0.0424)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.33% (3.4956 => 3.1693, std.dev.: 0.0090)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.69% (3.7437 => 3.4932, std.dev.: 0.0505)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -6.33% (3.0111 => 2.8206, std.dev.: 0.0556)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.38% (30.1838 => 28.5585, std.dev.: 0.0673)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.37% (0.3501 => 0.3313, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/salsa20: -4.18% (7.7964 => 7.4708, std.dev.: 0.0147)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -4.02% (0.3462 => 0.3323, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.96% (2.5938 => 2.4911, std.dev.: 0.0198)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.64% (3.7874 => 3.6875, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/flops: -1.85% (9.4433 => 9.2688, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.74% (17.1431 => 16.8452, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (4.9459 => 4.8707, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/oourafft: -1.12% (3.7484 => 3.7066, std.dev.: 0.0038)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1348 => 0.1362, std.dev.: 0.0066)

Report Time: 0.94s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131020/7f7f0908/attachment.html>


More information about the llvm-testresults mailing list