[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Sep 12 14:52:22 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15234?compare_to=15230&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15234, Order: 190624, Start Time: 2013-09-12 20:06:48, End Time: 2013-09-12 21:54:55
      To: 15230, Order: 190613, Start Time: 2013-09-12 17:49:57, End Time: 2013-09-12 19:42:50
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 17 (22 on baseline)
Performance Improvements: 49 (7 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1041 (1078 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: 12.82% (42.0284 => 47.4167, std.dev.: 0.6264)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 11.25% (0.4553 => 0.5065, std.dev.: 0.0004)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.45% (0.4192 => 0.4630, std.dev.: 0.0166)
  SingleSource/Benchmarks/Shootout-C++/fibo: 9.44% (4.9686 => 5.4374, std.dev.: 0.0554)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.04% (1.2635 => 1.3525, std.dev.: 0.0197)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 6.25% (1.1061 => 1.1752, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.82% (0.5930 => 0.6275, std.dev.: 0.0108)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.72% (99.2504 => 102.9430, std.dev.: 0.2070)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (3.5835 => 3.6853, std.dev.: 0.0249)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.67% (5.4997 => 5.6467, std.dev.: 0.0516)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.57% (4.3427 => 4.4545, std.dev.: 0.0259)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.72% (1.6117 => 1.6395, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.45% (3.5941 => 3.6462, std.dev.: 0.0130)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 1.38% (1.1227 => 1.1382, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.28% (3.9268 => 3.9769, std.dev.: 0.0076)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.17% (21.7997 => 22.0554, std.dev.: 0.0771)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.14% (5.9616 => 6.0293, std.dev.: 0.0055)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.04% (0.1728 => 0.0967, std.dev.: 0.0083)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -42.60% (0.0669 => 0.0384, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -38.97% (0.1958 => 0.1195, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -36.71% (0.1144 => 0.0724, std.dev.: 0.0022)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -36.58% (0.1665 => 0.1056, std.dev.: 0.0098)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -33.87% (1.4627 => 0.9673, std.dev.: 0.0886)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -31.32% (0.4598 => 0.3158, std.dev.: 0.0372)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.07% (2.0870 => 1.4385, std.dev.: 0.1337)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -28.74% (0.3828 => 0.2728, std.dev.: 0.0332)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -27.57% (0.8024 => 0.5812, std.dev.: 0.0057)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -27.50% (0.3007 => 0.2180, std.dev.: 0.0187)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -23.73% (0.1656 => 0.1263, std.dev.: 0.0113)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -23.12% (0.3430 => 0.2637, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -22.61% (6.2565 => 4.8421, std.dev.: 0.4248)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -22.50% (0.2142 => 0.1660, std.dev.: 0.0167)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -22.25% (9.5106 => 7.3942, std.dev.: 0.5325)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.09% (0.0906 => 0.0733, std.dev.: 0.0025)
  MultiSource/Benchmarks/mafft/pairlocalalign: -15.78% (11.9530 => 10.0668, std.dev.: 0.5285)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -14.19% (0.0726 => 0.0623, std.dev.: 0.0036)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -13.94% (51.6921 => 44.4864, std.dev.: 0.9434)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.75% (0.7362 => 0.6350, std.dev.: 0.0353)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -9.23% (0.4073 => 0.3697, std.dev.: 0.0028)
  SingleSource/Benchmarks/Linpack/linpack-pc: -8.43% (0.3167 => 0.2900, std.dev.: 0.0062)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.80% (27.1809 => 25.0611, std.dev.: 0.6156)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.86% (0.3890 => 0.3623, std.dev.: 0.0085)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.85% (1.1537 => 1.0978, std.dev.: 0.0032)
  MultiSource/Benchmarks/Bullet/bullet: -4.61% (34.8099 => 33.2061, std.dev.: 0.4516)
  MultiSource/Benchmarks/Prolangs-C/football/football: -2.60% (1.0142 => 0.9878, std.dev.: 0.0089)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.03% (0.7144 => 0.6999, std.dev.: 0.0015)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.83% (4.2238 => 4.1463, std.dev.: 0.0250)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -53.25% (0.0415 => 0.0194, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.76% (0.0963 => 0.0532, std.dev.: 0.0124)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -26.07% (3.2415 => 2.3966, std.dev.: 0.1925)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -23.14% (0.1452 => 0.1116, std.dev.: 0.0054)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -22.55% (3.2021 => 2.4801, std.dev.: 0.2625)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -21.86% (1.8973 => 1.4826, std.dev.: 0.1432)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -15.47% (71.7960 => 60.6900, std.dev.: 2.1008)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -13.25% (0.3872 => 0.3359, std.dev.: 0.0158)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -10.46% (2.5092 => 2.2468, std.dev.: 0.0432)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.37% (0.3137 => 0.2843, std.dev.: 0.0076)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.98% (0.5133 => 0.4672, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.08% (3.1607 => 2.9368, std.dev.: 0.0805)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -4.46% (4.1849 => 3.9983, std.dev.: 0.0460)
  MultiSource/Applications/aha/aha: -4.44% (3.7826 => 3.6148, std.dev.: 0.0631)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.58% (0.5365 => 0.5173, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -3.58% (5.0423 => 4.8619, std.dev.: 0.0484)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.25% (1.5338 => 1.4840, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.37% (16.8960 => 16.6644, std.dev.: 0.0779)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.13% (2.5508 => 2.5220, std.dev.: 0.0106)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.59% (0.1364 => 0.1413, std.dev.: 0.0297)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.55% (0.4624 => 0.4788, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.24% (0.3822 => 0.3946, std.dev.: 0.0003)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.64% (4.0397 => 4.1463, std.dev.: 0.0250)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (4.9428 => 5.4374, std.dev.: 0.0554)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.06% (1.2516 => 1.3525, std.dev.: 0.0197)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 6.71% (1.1013 => 1.1752, std.dev.: 0.0111)
  SingleSource/UnitTests/Vector/multiplies: 6.62% (0.5561 => 0.5929, std.dev.: 0.0001)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.36% (96.7834 => 102.9430, std.dev.: 0.2070)
  MultiSource/Benchmarks/sim/sim: 6.08% (3.8312 => 4.0641, std.dev.: 0.0044)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 5.91% (20.8247 => 22.0554, std.dev.: 0.0771)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.43% (0.5952 => 0.6275, std.dev.: 0.0108)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.12% (5.3716 => 5.6467, std.dev.: 0.0516)
  MultiSource/Applications/lua/lua: 3.95% (29.5202 => 30.6859, std.dev.: 0.4205)
  MultiSource/Applications/siod/siod: 3.18% (3.5310 => 3.6433, std.dev.: 0.0301)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.85% (1.5940 => 1.6395, std.dev.: 0.0024)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.83% (1.7652 => 1.8151, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (4.3592 => 4.4545, std.dev.: 0.0259)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.18% (3.5683 => 3.6462, std.dev.: 0.0130)
  SingleSource/Regression/C/uint64_to_float: 2.05% (1.4528 => 1.4826, std.dev.: 0.0019)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.30% (16.7972 => 17.0158, std.dev.: 0.0098)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.20% (2.4920 => 2.5220, std.dev.: 0.0106)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.08% (1.0477 => 1.0590, std.dev.: 0.0031)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.84% (0.1483 => 0.1174, std.dev.: 0.0075)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.15% (57.2347 => 47.4167, std.dev.: 0.6264)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.68% (0.3304 => 0.2918, std.dev.: 0.0049)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.24% (3.7437 => 3.4728, std.dev.: 0.0644)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.79% (17.1431 => 16.6644, std.dev.: 0.0779)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.65% (89.7126 => 88.2300, std.dev.: 0.2852)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.21% (3.8582 => 3.8116, std.dev.: 0.0138)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.82% (0.1348 => 0.1413, std.dev.: 0.0297)

Report Time: 0.64s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130912/821eb8c4/attachment.html>


More information about the llvm-testresults mailing list