[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 1 10:25:06 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13999?compare_to=13995&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13999, Order: 187577, Start Time: 2013-08-01 15:40:31, End Time: 2013-08-01 17:26:52
      To: 13995, Order: 187574, Start Time: 2013-08-01 13:31:28, End Time: 2013-08-01 15:18:20
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 6 (29 on baseline)
Performance Improvements: 5 (52 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1096 (1026 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.79% (0.3324 => 0.3583, std.dev.: 0.0005)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.48% (1.1202 => 1.1480, std.dev.: 0.0096)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.30% (1.0703 => 1.0949, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.29% (4.9724 => 5.0864, std.dev.: 0.0229)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.38% (1.6070 => 1.6292, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.01% (4.4804 => 4.5255, std.dev.: 0.0128)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.91% (1.1464 => 1.1245, std.dev.: 0.0074)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (7.7221 => 7.6442, std.dev.: 0.0261)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/hash: -5.76% (0.7726 => 0.7281, std.dev.: 0.0025)
  MultiSource/Applications/JM/lencod/lencod: -4.40% (7.4207 => 7.0945, std.dev.: 0.1098)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.20% (2.6406 => 2.5296, std.dev.: 0.0136)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 7.00% (0.1300 => 0.1391, std.dev.: 0.0256)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.51% (2.8867 => 4.2871, std.dev.: 0.0356)
  MultiSource/Benchmarks/FreeBench/neural/neural: 35.19% (0.3171 => 0.4287, std.dev.: 0.0397)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.66% (0.6295 => 0.7281, std.dev.: 0.0025)
  MultiSource/Applications/siod/siod: 13.77% (3.3761 => 3.8411, std.dev.: 0.0731)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.86% (7.0762 => 7.9862, std.dev.: 0.0132)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.48% (0.1678 => 0.1837, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.39% (1.2557 => 1.3610, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.36% (5.4910 => 5.9498, std.dev.: 0.1161)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.67% (3.2027 => 3.4162, std.dev.: 0.0217)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.29% (0.2799 => 0.2975, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.92% (3.3877 => 3.5883, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.84% (5.3042 => 5.6138, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.67% (5.5008 => 5.8128, std.dev.: 0.0901)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.66% (3.4085 => 3.6014, std.dev.: 0.0302)
  SingleSource/Benchmarks/Misc/whetstone: 4.33% (3.4559 => 3.6055, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3654, std.dev.: 0.0453)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.3151 => 4.4957, std.dev.: 0.0073)
  MultiSource/Applications/spiff/spiff: 3.76% (2.7609 => 2.8648, std.dev.: 0.0315)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1142 => 1.1480, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.98% (4.8739 => 5.0190, std.dev.: 0.0335)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.24% (12.8625 => 13.1502, std.dev.: 0.0805)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.10% (1.5957 => 1.6292, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout/matrix: 2.05% (1.7358 => 1.7714, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.81% (3.3464 => 3.4071, std.dev.: 0.0161)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.64% (1.4398 => 1.4634, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.58% (3.5351 => 3.5911, std.dev.: 0.0183)
  SingleSource/Benchmarks/Misc/flops: 1.51% (9.7664 => 9.9139, std.dev.: 0.0205)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.41% (4.4624 => 4.5255, std.dev.: 0.0128)
  SingleSource/Benchmarks/Shootout/methcall: 1.24% (8.4614 => 8.5663, std.dev.: 0.0127)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.85% (0.2237 => 0.1435, std.dev.: 0.0075)
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.96% (0.1072 => 0.0708, std.dev.: 0.0103)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.37% (0.1818 => 0.1375, std.dev.: 0.0154)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.44% (0.1114 => 0.0864, std.dev.: 0.0072)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -22.37% (0.0675 => 0.0524, std.dev.: 0.0029)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.37% (6.0938 => 4.7309, std.dev.: 0.0438)
  MultiSource/Benchmarks/Olden/health/health: -20.12% (0.1993 => 0.1592, std.dev.: 0.0103)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.38% (0.3576 => 0.2883, std.dev.: 0.0088)
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.90% (0.2367 => 0.2038, std.dev.: 0.0092)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -12.25% (0.1870 => 0.1641, std.dev.: 0.0016)
  MultiSource/Applications/JM/ldecod/ldecod: -11.98% (8.6720 => 7.6330, std.dev.: 0.4001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.02% (0.3073 => 0.2765, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -9.27% (0.1144 => 0.1038, std.dev.: 0.0006)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.17% (0.1947 => 0.1788, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.62% (1.4514 => 1.3408, std.dev.: 0.0103)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.53% (2.6853 => 2.5099, std.dev.: 0.0235)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.87% (6.1631 => 5.8014, std.dev.: 0.0440)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -3.96% (5.2851 => 5.0757, std.dev.: 0.0182)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.93% (0.3309 => 0.3179, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.81% (1.3952 => 1.3560, std.dev.: 0.0101)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.68% (1.4932 => 1.4681, std.dev.: 0.0027)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -38.70% (0.0292 => 0.0179, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.37% (2.1022 => 1.4217, std.dev.: 0.0134)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.10% (0.1189 => 0.0843, std.dev.: 0.0010)
  MultiSource/Applications/viterbi/viterbi: -27.22% (3.4923 => 2.5418, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.50% (6.9552 => 5.2509, std.dev.: 0.3961)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -23.45% (1.0962 => 0.8391, std.dev.: 0.0312)
  SingleSource/Benchmarks/Misc/perlin: -21.51% (4.5989 => 3.6096, std.dev.: 0.1188)
  SingleSource/Benchmarks/Misc/mandel: -14.53% (1.1996 => 1.0253, std.dev.: 0.0156)
  MultiSource/Applications/sgefa/sgefa: -12.75% (1.4030 => 1.2241, std.dev.: 0.0450)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.60% (2.6992 => 2.3861, std.dev.: 0.0438)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -10.88% (0.0956 => 0.0852, std.dev.: 0.0017)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.96% (3.5791 => 3.2225, std.dev.: 0.0858)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.57% (0.5173 => 0.4678, std.dev.: 0.0008)
  MultiSource/Applications/lua/lua: -8.60% (31.0707 => 28.3976, std.dev.: 0.8714)
  SingleSource/Benchmarks/Shootout/strcat: -8.16% (0.1593 => 0.1463, std.dev.: 0.0005)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.68% (47.2250 => 43.5963, std.dev.: 0.6725)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.35% (0.3773 => 0.3571, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.12% (3.8119 => 3.6167, std.dev.: 0.0086)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.02% (1.7207 => 1.6344, std.dev.: 0.0100)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.89% (0.4969 => 0.4726, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc/fbench: -4.35% (4.9602 => 4.7445, std.dev.: 0.0065)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.16% (0.7355 => 0.7049, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.00% (2.8052 => 2.6930, std.dev.: 0.0366)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.29% (21.6864 => 20.9724, std.dev.: 0.2390)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.27% (6.0444 => 5.8465, std.dev.: 0.0361)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9627, std.dev.: 0.0430)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.98% (93.6732 => 90.8816, std.dev.: 1.0300)
  SingleSource/Benchmarks/Misc/oourafft: -2.04% (3.7891 => 3.7119, std.dev.: 0.0041)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.71% (1.5112 => 1.4853, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.41% (5.8810 => 5.7982, std.dev.: 0.0139)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.23% (2.1343 => 2.1080, std.dev.: 0.0019)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.94% (0.1378 => 0.1391, std.dev.: 0.0256)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130801/c5bcb76c/attachment.html>


More information about the llvm-testresults mailing list