[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri May 24 10:27:22 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11713?compare_to=11710&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11713, Order: 182647, Start Time: 2013-05-24 15:42:54, End Time: 2013-05-24 17:27:49
      To: 11710, Order: 182640, Start Time: 2013-05-24 13:32:36, End Time: 2013-05-24 15:21:11
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 6 (4 on baseline)
Performance Improvements: 54 (28 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1047 (1075 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: 9.93% (19.6823 => 21.6367, std.dev.: 0.6536)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.52% (3.9633 => 4.0631, std.dev.: 0.0119)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.21% (11.3445 => 11.5956, std.dev.: 0.0267)
  SingleSource/Benchmarks/Shootout/methcall: 2.09% (8.4088 => 8.5842, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.72% (5.6882 => 5.7861, std.dev.: 0.0308)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.67% (2.5149 => 2.5570, std.dev.: 0.0152)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -38.10% (0.0840 => 0.0520, std.dev.: 0.0011)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -33.39% (0.1261 => 0.0840, std.dev.: 0.0015)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -33.05% (0.1425 => 0.0954, std.dev.: 0.0022)
  MultiSource/Benchmarks/McCat/08-main/main: -31.14% (0.4278 => 0.2946, std.dev.: 0.0058)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -30.87% (0.3204 => 0.2215, std.dev.: 0.0070)
  MultiSource/Benchmarks/Olden/bisort/bisort: -30.37% (0.1024 => 0.0713, std.dev.: 0.0015)
  MultiSource/Benchmarks/McCat/18-imp/imp: -28.47% (0.5480 => 0.3920, std.dev.: 0.0042)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -28.34% (0.1436 => 0.1029, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -24.29% (0.0700 => 0.0530, std.dev.: 0.0065)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -23.85% (0.3736 => 0.2845, std.dev.: 0.0118)
  MultiSource/Benchmarks/Olden/health/health: -23.06% (0.1999 => 0.1538, std.dev.: 0.0024)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -22.98% (0.1732 => 0.1334, std.dev.: 0.0023)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.95% (1.8339 => 1.4131, std.dev.: 0.1027)
  MultiSource/Benchmarks/Olden/tsp/tsp: -22.44% (0.1756 => 0.1362, std.dev.: 0.0037)
  MultiSource/Benchmarks/Olden/em3d/em3d: -21.52% (0.2532 => 0.1987, std.dev.: 0.0025)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -21.49% (0.1317 => 0.1034, std.dev.: 0.0005)
  MultiSource/Benchmarks/McCat/05-eks/eks: -20.80% (0.6813 => 0.5396, std.dev.: 0.0011)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -17.62% (1.5821 => 1.3034, std.dev.: 0.0289)
  MultiSource/Benchmarks/Bullet/bullet: -13.91% (40.7351 => 35.0670, std.dev.: 2.0846)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -12.91% (5.7478 => 5.0055, std.dev.: 0.1716)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.94% (0.8124 => 0.7154, std.dev.: 0.0074)
  MultiSource/Benchmarks/McCat/09-vor/vor: -11.81% (0.3981 => 0.3511, std.dev.: 0.0035)
  MultiSource/Benchmarks/Olden/bh/bh: -11.18% (0.3749 => 0.3330, std.dev.: 0.0026)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -9.19% (1.0724 => 0.9738, std.dev.: 0.0257)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -6.65% (0.1595 => 0.1489, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.35% (1.7980 => 1.6838, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.31% (1.6724 => 1.5668, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.29% (1.7129 => 1.6052, std.dev.: 0.0272)
  MultiSource/Benchmarks/FreeBench/neural/neural: -6.01% (0.2164 => 0.2034, std.dev.: 0.0046)
  MultiSource/Benchmarks/sim/sim: -5.93% (0.3897 => 0.3666, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.88% (0.3675 => 0.3459, std.dev.: 0.0083)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -5.76% (0.1857 => 0.1750, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.62% (1.7239 => 1.6271, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.52% (1.7077 => 1.6134, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.14% (1.6872 => 1.6005, std.dev.: 0.0267)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: -44.62% (1.3623 => 0.7544, std.dev.: 0.1957)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.86% (0.0350 => 0.0249, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/bisort/bisort: -28.42% (0.9437 => 0.6755, std.dev.: 0.0828)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -24.44% (0.4730 => 0.3574, std.dev.: 0.0098)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -24.07% (0.4138 => 0.3142, std.dev.: 0.0015)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -24.03% (0.1082 => 0.0822, std.dev.: 0.0002)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -21.97% (1.6446 => 1.2832, std.dev.: 0.0595)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -20.35% (1.5583 => 1.2412, std.dev.: 0.0287)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -10.56% (0.1524 => 0.1363, std.dev.: 0.0011)
  MultiSource/Benchmarks/llubenchmark/llu: -8.67% (2.2179 => 2.0256, std.dev.: 0.0035)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -7.71% (0.4577 => 0.4224, std.dev.: 0.0081)
  MultiSource/Benchmarks/Olden/tsp/tsp: -5.74% (1.7014 => 1.6038, std.dev.: 0.0083)
  MultiSource/Benchmarks/Olden/health/health: -5.32% (0.3498 => 0.3312, std.dev.: 0.0041)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.31% (0.5141 => 0.4868, std.dev.: 0.0080)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.90% (0.3492 => 0.3321, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.32% (21.7432 => 20.8047, std.dev.: 0.3635)
  MultiSource/Benchmarks/Olden/bh/bh: -2.78% (2.4888 => 2.4197, std.dev.: 0.0188)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.96% (1.6342 => 1.6021, std.dev.: 0.0065)
  MultiSource/Benchmarks/Olden/em3d/em3d: -1.12% (5.1924 => 5.1344, std.dev.: 0.0175)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.20% (0.1481 => 0.1404, std.dev.: 0.0282)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.50% (1.0571 => 1.0941, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout/methcall: 2.90% (8.3425 => 8.5842, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.31% (3.9713 => 4.0631, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.07% (9.8728 => 9.9783, std.dev.: 0.0182)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -25.87% (0.2431 => 0.1802, std.dev.: 0.0126)
  SingleSource/UnitTests/Vector/constpool: -18.61% (10.3086 => 8.3897, std.dev.: 0.1903)
  SingleSource/Benchmarks/Misc/whetstone: -17.41% (0.1097 => 0.0906, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.56% (0.0803 => 0.0670, std.dev.: 0.0037)
  MultiSource/Applications/JM/lencod/lencod: -11.09% (18.9387 => 16.8383, std.dev.: 0.7847)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.59% (0.1067 => 0.0954, std.dev.: 0.0022)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.52% (0.2006 => 0.1795, std.dev.: 0.0004)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (0.1224 => 0.1123, std.dev.: 0.0007)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.42% (0.1563 => 0.1447, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/18-imp/imp: -6.64% (0.4199 => 0.3920, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/em3d/em3d: -6.14% (0.2117 => 0.1987, std.dev.: 0.0025)
  MultiSource/Benchmarks/McCat/09-vor/vor: -5.69% (0.3723 => 0.3511, std.dev.: 0.0035)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.1828 => 0.1724, std.dev.: 0.0037)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -5.56% (0.1853 => 0.1750, std.dev.: 0.0033)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.30% (0.5698 => 0.5396, std.dev.: 0.0011)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.49% (0.5748 => 0.5490, std.dev.: 0.0013)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -2.56% (0.4138 => 0.4032, std.dev.: 0.0029)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -17.79% (1.8291 => 1.5037, std.dev.: 0.0467)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.57% (0.7941 => 0.7181, std.dev.: 0.0173)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.06% (32.4581 => 29.5186, std.dev.: 0.0212)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.74% (0.1945 => 0.1814, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.32% (3.2030 => 3.0005, std.dev.: 0.0518)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.71% (0.4480 => 0.4224, std.dev.: 0.0081)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -3.62% (4.1768 => 4.0254, std.dev.: 0.0446)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.46% (1.6613 => 1.6038, std.dev.: 0.0083)
  SingleSource/Benchmarks/Dhrystone/dry: -2.05% (0.5126 => 0.5021, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/multiplies: -1.85% (0.5665 => 0.5560, std.dev.: 0.0009)
  MultiSource/Applications/viterbi/viterbi: -1.68% (2.5688 => 2.5257, std.dev.: 0.0159)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.57% (0.1441 => 0.1404, std.dev.: 0.0282)

Report Time: 0.61s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130524/8ed724e2/attachment.html>


More information about the llvm-testresults mailing list