[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri May 24 19:06:40 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11726?compare_to=11723&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11726, Order: 182696, Start Time: 2013-05-25 00:21:10, End Time: 2013-05-25 02:07:07
      To: 11723, Order: 182674, Start Time: 2013-05-24 22:06:46, End Time: 2013-05-24 23:59:00
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 4 (4 on baseline)
Performance Improvements: 70 (26 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1033 (1077 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.58% (0.0586 => 0.0689, std.dev.: 0.0008)
  SingleSource/Benchmarks/Linpack/linpack-pc: 17.52% (43.5212 => 51.1456, std.dev.: 0.5612)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.47% (1.2224 => 1.2893, std.dev.: 0.0181)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.79% (48.2863 => 49.6357, std.dev.: 0.2074)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/initp1: -37.67% (0.0799 => 0.0498, std.dev.: 0.0038)
  MultiSource/Benchmarks/NPB-serial/is/is: -36.67% (0.1339 => 0.0848, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -35.24% (0.1138 => 0.0737, std.dev.: 0.0012)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -31.72% (0.0763 => 0.0521, std.dev.: 0.0012)
  MultiSource/Applications/treecc/treecc: -24.82% (3.0902 => 2.3232, std.dev.: 0.2374)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -22.61% (1.8438 => 1.4270, std.dev.: 0.1398)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -22.55% (0.1224 => 0.0948, std.dev.: 0.0033)
  MultiSource/Applications/Burg/burg: -22.11% (1.8886 => 1.4711, std.dev.: 0.1585)
  SingleSource/Benchmarks/Shootout/methcall: -21.74% (0.0460 => 0.0360, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -15.48% (5.5563 => 4.6964, std.dev.: 0.0481)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -15.17% (0.4033 => 0.3421, std.dev.: 0.0091)
  MultiSource/Benchmarks/MallocBench/gs/gs: -14.04% (5.4869 => 4.7166, std.dev.: 0.0324)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.55% (0.7973 => 0.6893, std.dev.: 0.0120)
  SingleSource/Benchmarks/Shootout-C++/lists1: -12.58% (0.3784 => 0.3308, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout-C++/sieve: -11.58% (0.3463 => 0.3062, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/methcall: -11.47% (0.2484 => 0.2199, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -10.50% (0.1105 => 0.0989, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -10.32% (0.7918 => 0.7101, std.dev.: 0.0196)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.13% (0.2212 => 0.1988, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -10.10% (0.7442 => 0.6690, std.dev.: 0.0102)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.98% (0.7993 => 0.7195, std.dev.: 0.0220)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -9.82% (0.4247 => 0.3830, std.dev.: 0.0118)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.75% (1.8108 => 1.6343, std.dev.: 0.0258)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -9.59% (0.6320 => 0.5714, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -9.39% (1.8293 => 1.6575, std.dev.: 0.0608)
  SingleSource/Benchmarks/Shootout-C++/hello: -9.12% (0.2150 => 0.1954, std.dev.: 0.0014)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -9.02% (0.4224 => 0.3843, std.dev.: 0.0067)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -8.13% (0.6001 => 0.5513, std.dev.: 0.0156)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.13% (1.6414 => 1.5080, std.dev.: 0.0272)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -7.86% (0.5167 => 0.4761, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -7.73% (0.2419 => 0.2232, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/hash2: -7.68% (0.5119 => 0.4726, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -7.61% (0.2458 => 0.2271, std.dev.: 0.0013)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.47% (0.9517 => 0.8806, std.dev.: 0.0138)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.41% (1.2054 => 1.1161, std.dev.: 0.0233)
  SingleSource/Benchmarks/Shootout-C++/matrix: -6.38% (0.2710 => 0.2537, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.72% (1.5079 => 1.4217, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.58% (1.5087 => 1.4245, std.dev.: 0.0321)
  MultiSource/Applications/JM/lencod/lencod: -5.52% (19.3960 => 18.3261, std.dev.: 0.3172)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (1.7232 => 1.6295, std.dev.: 0.0165)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -4.90% (0.2223 => 0.2114, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/oourafft: -4.89% (0.2353 => 0.2238, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2257 => 0.2154, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/ary: -4.55% (0.2880 => 0.2749, std.dev.: 0.0019)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.27% (0.2505 => 0.2398, std.dev.: 0.0007)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.18% (2.5616 => 2.5058, std.dev.: 0.0216)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.58% (1.2973 => 0.7320, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -36.16% (4.5932 => 2.9322, std.dev.: 0.2629)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -23.34% (4.4531 => 3.4137, std.dev.: 0.0875)
  SingleSource/Benchmarks/Shootout-C++/ary: -21.07% (0.0802 => 0.0633, std.dev.: 0.0049)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -20.24% (1.0929 => 0.8717, std.dev.: 0.0740)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.45% (6.2786 => 5.0575, std.dev.: 0.0074)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -17.53% (4.8908 => 4.0332, std.dev.: 0.0837)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.40% (25.3981 => 21.2340, std.dev.: 0.2659)
  SingleSource/Benchmarks/Misc/salsa20: -13.11% (10.3443 => 8.9880, std.dev.: 0.0481)
  MultiSource/Benchmarks/MallocBench/gs/gs: -11.61% (0.0965 => 0.0853, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/lists1: -11.59% (0.6792 => 0.6005, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/moments: -10.17% (0.1131 => 0.1016, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -8.39% (4.5932 => 4.2078, std.dev.: 0.0078)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -7.76% (64.0027 => 59.0356, std.dev.: 1.8432)
  SingleSource/Benchmarks/Shootout-C++/ary3: -6.07% (2.1494 => 2.0189, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.94% (4.7862 => 4.5496, std.dev.: 0.0874)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -4.43% (0.4835 => 0.4621, std.dev.: 0.0059)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -3.85% (3.1322 => 3.0117, std.dev.: 0.0264)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -3.41% (4.7249 => 4.5639, std.dev.: 0.0462)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.03% (7.0898 => 6.8748, std.dev.: 0.0793)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.57% (12.2746 => 12.0820, std.dev.: 0.0367)
  MultiSource/Applications/JM/lencod/lencod: -1.46% (7.0557 => 6.9524, std.dev.: 0.0369)
  SingleSource/Benchmarks/Misc/richards_benchmark: -1.14% (1.3552 => 1.3397, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/methcall: -1.04% (11.6440 => 11.5227, std.dev.: 0.0278)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 10.37% (0.1446 => 0.1596, std.dev.: 0.0117)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/ClamAV/clamscan: 7.14% (17.3229 => 18.5592, std.dev.: 0.4058)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.67% (0.3429 => 0.3555, std.dev.: 0.0041)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.47% (1.2224 => 1.2893, std.dev.: 0.0181)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (48.3307 => 49.6357, std.dev.: 0.2074)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.06% (0.0803 => 0.0666, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/whetstone: -15.13% (0.1097 => 0.0931, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.95% (0.7918 => 0.6893, std.dev.: 0.0120)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.34% (0.8025 => 0.7195, std.dev.: 0.0220)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.67% (0.2006 => 0.1812, std.dev.: 0.0070)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.96% (5.1587 => 4.6964, std.dev.: 0.0481)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.21% (1.7804 => 1.6343, std.dev.: 0.0258)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.1828 => 0.1726, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/strcat: -5.37% (0.2309 => 0.2185, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/objinst: -4.26% (0.2397 => 0.2295, std.dev.: 0.0025)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -4.22% (1.3686 => 1.3108, std.dev.: 0.0204)
  SingleSource/Benchmarks/Shootout-C++/ary2: -3.69% (0.2951 => 0.2842, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -2.85% (0.3617 => 0.3514, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.33% (0.4293 => 0.4193, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.30% (1.2911 => 0.7320, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -22.50% (4.4050 => 3.4137, std.dev.: 0.0875)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.86% (6.2328 => 5.0575, std.dev.: 0.0074)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.30% (25.3677 => 21.2340, std.dev.: 0.2659)
  SingleSource/Benchmarks/Misc/salsa20: -13.07% (10.3398 => 8.9880, std.dev.: 0.0481)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -12.00% (10.2418 => 9.0129, std.dev.: 0.4253)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.96% (4.5717 => 4.2078, std.dev.: 0.0078)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -7.35% (0.1945 => 0.1802, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.18% (2.8537 => 2.7343, std.dev.: 0.0349)
  MultiSource/Applications/sqlite3/sqlite3: -2.76% (4.6358 => 4.5077, std.dev.: 0.0390)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (1.1291 => 1.1154, std.dev.: 0.0044)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.13% (5.7342 => 5.6695, std.dev.: 0.0199)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 10.76% (0.1441 => 0.1596, std.dev.: 0.0117)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130524/b1be1b4c/attachment.html>


More information about the llvm-testresults mailing list