[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jul 5 18:02:43 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13122?compare_to=13118&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13122, Order: 185730, Start Time: 2013-07-05 23:13:25, End Time: 2013-07-06 01:03:59
      To: 13118, Order: 185721, Start Time: 2013-07-05 21:00:53, End Time: 2013-07-05 22:49:53
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 21 (31 on baseline)
Performance Improvements: 1 (40 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1085 (1036 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 48.97% (0.0829 => 0.1235, std.dev.: 0.0087)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 35.25% (0.1725 => 0.2333, std.dev.: 0.0076)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 33.54% (0.9548 => 1.2750, std.dev.: 0.0597)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 24.58% (0.0956 => 0.1191, std.dev.: 0.0059)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.21% (0.2679 => 0.3274, std.dev.: 0.0044)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 20.07% (1.2071 => 1.4494, std.dev.: 0.0665)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.17% (0.6944 => 0.7789, std.dev.: 0.0179)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.96% (1.7702 => 1.9111, std.dev.: 0.0446)
  MultiSource/Applications/lemon/lemon: 4.35% (1.2268 => 1.2802, std.dev.: 0.0190)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.13% (0.1380 => 0.1782, std.dev.: 0.0099)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.02% (0.0544 => 0.0691, std.dev.: 0.0009)
  MultiSource/Applications/SPASS/SPASS: 21.70% (8.1407 => 9.9075, std.dev.: 0.0983)
  MultiSource/Applications/minisat/minisat: 19.87% (6.1803 => 7.4086, std.dev.: 0.4087)
  SingleSource/Benchmarks/Shootout-C++/fibo: 15.84% (4.1699 => 4.8305, std.dev.: 0.0145)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.46% (29.3099 => 33.5488, std.dev.: 0.4585)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.52% (2.9372 => 3.1288, std.dev.: 0.0565)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.43% (1.0488 => 1.1058, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/random: 1.81% (2.4329 => 2.4770, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/methcall: 1.79% (8.3576 => 8.5074, std.dev.: 0.0318)
  SingleSource/Benchmarks/Misc/flops: 1.72% (9.6324 => 9.7976, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.03% (5.4191 => 5.4748, std.dev.: 0.0118)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: -11.30% (0.2363 => 0.2096, std.dev.: 0.0074)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.86% (0.1395 => 0.1369, std.dev.: 0.0283)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 45.64% (0.0848 => 0.1235, std.dev.: 0.0087)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.70% (0.1886 => 0.2333, std.dev.: 0.0076)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.62% (1.0314 => 1.2750, std.dev.: 0.0597)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 20.72% (1.2006 => 1.4494, std.dev.: 0.0665)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.59% (1.5981 => 1.9111, std.dev.: 0.0446)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.92% (0.2753 => 0.3274, std.dev.: 0.0044)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.02% (4.9917 => 5.8414, std.dev.: 0.2773)
  MultiSource/Benchmarks/Prolangs-C/football/football: 6.69% (1.0292 => 1.0981, std.dev.: 0.0231)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 36.22% (2.5688 => 3.4993, std.dev.: 0.0052)
  MultiSource/Applications/sgefa/sgefa: 29.47% (1.1695 => 1.5141, std.dev.: 0.0148)
  SingleSource/Benchmarks/Misc/perlin: 26.79% (3.6271 => 4.5988, std.dev.: 0.0139)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.54% (2.5366 => 3.0829, std.dev.: 0.0590)
  SingleSource/Benchmarks/Misc/mandel: 17.24% (1.0293 => 1.2068, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.11% (6.1372 => 7.1872, std.dev.: 0.1666)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.54% (0.9806 => 1.1428, std.dev.: 0.0297)
  MultiSource/Applications/SPASS/SPASS: 11.67% (8.8720 => 9.9075, std.dev.: 0.0983)
  MultiSource/Applications/lua/lua: 9.68% (28.2496 => 30.9837, std.dev.: 0.4850)
  SingleSource/Benchmarks/Shootout/strcat: 8.45% (0.1456 => 0.1579, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.96% (5.2003 => 5.6144, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.87% (3.2201 => 3.3768, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.71% (4.6639 => 4.8836, std.dev.: 0.0163)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.61% (1.0571 => 1.1058, std.dev.: 0.0038)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.38% (2.8994 => 3.0264, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.77% (5.9362 => 6.1602, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.59% (5.2788 => 5.4684, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.91% (5.5010 => 5.6611, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.63% (4.6379 => 4.7600, std.dev.: 0.0089)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (4.3727 => 4.4724, std.dev.: 0.0256)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.24% (34.3107 => 35.0807, std.dev.: 0.0338)
  SingleSource/Benchmarks/Shootout/methcall: 1.98% (8.3425 => 8.5074, std.dev.: 0.0318)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.57% (5.6582 => 5.7473, std.dev.: 0.0272)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.06% (1.2911 => 0.7351, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -38.10% (4.4050 => 2.7269, std.dev.: 0.0113)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.56% (1.6105 => 1.2149, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -24.47% (6.2328 => 4.7076, std.dev.: 0.1799)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.76% (9.1099 => 7.0364, std.dev.: 0.0180)
  SingleSource/Benchmarks/Shootout/hash: -22.45% (5.3656 => 4.1612, std.dev.: 0.1983)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.59% (4.8986 => 3.8898, std.dev.: 0.0408)
  SingleSource/Benchmarks/Shootout-C++/hash: -19.82% (0.7941 => 0.6367, std.dev.: 0.0474)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.75% (5.7264 => 4.5952, std.dev.: 0.0436)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.53% (25.3677 => 21.4269, std.dev.: 0.0398)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.71% (1.6679 => 1.4392, std.dev.: 0.0769)
  SingleSource/Benchmarks/Misc/salsa20: -13.06% (10.3398 => 8.9892, std.dev.: 0.0050)
  MultiSource/Benchmarks/Olden/tsp/tsp: -12.29% (1.6613 => 1.4571, std.dev.: 0.0461)
  SingleSource/Regression/C/uint64_to_float: -9.64% (1.6851 => 1.5227, std.dev.: 0.0089)
  MultiSource/Applications/siod/siod: -9.07% (3.7240 => 3.3862, std.dev.: 0.0714)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.51% (9.8728 => 9.0328, std.dev.: 0.0220)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.15% (4.5717 => 4.2446, std.dev.: 0.0709)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.88% (5.5889 => 5.2046, std.dev.: 0.0279)
  MultiSource/Applications/sqlite3/sqlite3: -6.43% (4.6358 => 4.3378, std.dev.: 0.0738)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.29% (3.5939 => 3.3677, std.dev.: 0.0077)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -5.95% (2.8537 => 2.6839, std.dev.: 0.0379)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -5.46% (1.3084 => 1.2370, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.39% (2.4808 => 2.3472, std.dev.: 0.0418)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.15% (6.3757 => 6.0471, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.90% (5.3184 => 5.0579, std.dev.: 0.0109)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.58% (1.6535 => 1.5777, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3276 => 5.1030, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/flops: -4.10% (10.2170 => 9.7976, std.dev.: 0.0177)
  SingleSource/Benchmarks/Misc/whetstone: -3.75% (3.5970 => 3.4621, std.dev.: 0.0048)
  MultiSource/Applications/hexxagon/hexxagon: -3.14% (15.4979 => 15.0119, std.dev.: 0.0174)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.10% (1.6440 => 1.5930, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout/sieve: -2.88% (8.0178 => 7.7870, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.68% (4.5935 => 4.4703, std.dev.: 0.0111)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.63% (3.8665 => 3.7648, std.dev.: 0.0088)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.47% (48.3307 => 47.1348, std.dev.: 0.1555)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.12% (4.5094 => 4.4136, std.dev.: 0.0238)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.83% (1.6980 => 1.6669, std.dev.: 0.0055)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.48% (1.1791 => 1.1617, std.dev.: 0.0039)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.46% (2.8573 => 2.8156, std.dev.: 0.0131)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.31% (12.1841 => 12.0245, std.dev.: 0.0549)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.00% (0.1441 => 0.1369, std.dev.: 0.0283)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130705/15b682fe/attachment.html>


More information about the llvm-testresults mailing list