[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Aug 2 06:25:29 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14030?compare_to=14026&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14030, Order: 187650, Start Time: 2013-08-02 11:40:46, End Time: 2013-08-02 13:27:16
      To: 14026, Order: 187646, Start Time: 2013-08-02 09:30:59, End Time: 2013-08-02 11:17:22
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 11 (27 on baseline)
Performance Improvements: 4 (63 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1090 (1015 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.28% (0.5828 => 0.5961, std.dev.: 0.0038)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.50% (2.5088 => 2.5465, std.dev.: 0.0016)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: 9.62% (4.7090 => 5.1618, std.dev.: 0.0059)
  SingleSource/Benchmarks/Shootout-C++/hash: 6.36% (0.7285 => 0.7748, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.11% (5.0112 => 5.3176, std.dev.: 0.0328)
  MultiSource/Applications/spiff/spiff: 4.89% (2.8411 => 2.9801, std.dev.: 0.0114)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.53% (3.2195 => 3.3655, std.dev.: 0.0522)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.42% (15.9215 => 16.6260, std.dev.: 0.1887)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.41% (4.4624 => 4.5254, std.dev.: 0.0224)
  SingleSource/Benchmarks/Shootout/methcall: 1.31% (8.4328 => 8.5435, std.dev.: 0.0110)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 1.30% (1.4810 => 1.5002, std.dev.: 0.0074)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.60% (1.3774 => 1.3416, std.dev.: 0.0098)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.75% (3.6684 => 3.6042, std.dev.: 0.0225)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.63% (1.2028 => 1.1832, std.dev.: 0.0044)
  SingleSource/Benchmarks/Linpack/linpack-pc: -1.46% (52.9294 => 52.1579, std.dev.: 0.0903)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -3.38% (0.1392 => 0.1345, std.dev.: 0.0098)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.07% (0.2738 => 0.2740, std.dev.: 0.0008)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.08% (0.0279 => 0.0276, std.dev.: 0.0001)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.60% (0.2813 => 0.2740, std.dev.: 0.0008)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.00% (0.0345 => 0.0276, std.dev.: 0.0001)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 1.98% (0.5845 => 0.5961, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.18% (3.7285 => 6.2334, std.dev.: 0.1516)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.84% (2.8867 => 4.3254, std.dev.: 0.0187)
  MultiSource/Benchmarks/FreeBench/neural/neural: 33.02% (0.3171 => 0.4218, std.dev.: 0.0272)
  SingleSource/Benchmarks/Shootout/hash: 27.51% (4.1846 => 5.3356, std.dev.: 0.3329)
  SingleSource/Benchmarks/Shootout-C++/hash: 23.08% (0.6295 => 0.7748, std.dev.: 0.0117)
  MultiSource/Applications/JM/lencod/lencod: 21.01% (7.1799 => 8.6887, std.dev.: 0.3222)
  MultiSource/Applications/siod/siod: 13.95% (3.3761 => 3.8470, std.dev.: 0.0554)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.70% (7.0762 => 7.9748, std.dev.: 0.0467)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.15% (14.9584 => 16.6260, std.dev.: 0.1887)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.31% (5.4910 => 5.9474, std.dev.: 0.0707)
  MultiSource/Applications/spiff/spiff: 7.94% (2.7609 => 2.9801, std.dev.: 0.0114)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.93% (48.3256 => 52.1579, std.dev.: 0.0903)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4242, std.dev.: 0.0484)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.05% (5.5008 => 5.8337, std.dev.: 0.0918)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6217, std.dev.: 0.0463)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.74% (3.4085 => 3.6042, std.dev.: 0.0225)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (3.3877 => 3.5822, std.dev.: 0.0353)
  SingleSource/Benchmarks/Misc/whetstone: 4.55% (3.4559 => 3.6130, std.dev.: 0.0102)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.52% (1.5339 => 1.6033, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.33% (4.3151 => 4.5019, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.67% (3.3384 => 3.4610, std.dev.: 0.0369)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.10% (4.8739 => 5.0248, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.67% (3.3464 => 3.4024, std.dev.: 0.0023)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.55% (1.4398 => 1.4621, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.41% (4.4624 => 4.5254, std.dev.: 0.0224)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.29% (0.2237 => 0.1470, std.dev.: 0.0051)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.65% (0.1072 => 0.0722, std.dev.: 0.0004)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -29.44% (0.1114 => 0.0786, std.dev.: 0.0047)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.75% (0.1818 => 0.1368, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -23.85% (0.0675 => 0.0514, std.dev.: 0.0004)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.83% (6.0938 => 4.7024, std.dev.: 0.0593)
  MultiSource/Benchmarks/Olden/health/health: -20.92% (0.1993 => 0.1576, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.27% (0.3576 => 0.2887, std.dev.: 0.0024)
  MultiSource/Benchmarks/Olden/em3d/em3d: -14.70% (0.2367 => 0.2019, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -11.08% (0.3655 => 0.3250, std.dev.: 0.0069)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -10.27% (0.1947 => 0.1747, std.dev.: 0.0024)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -9.18% (0.1144 => 0.1039, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.94% (0.3073 => 0.2829, std.dev.: 0.0054)
  MultiSource/Applications/kimwitu++/kc: -7.52% (21.0770 => 19.4916, std.dev.: 0.1983)
  MultiSource/Benchmarks/Olden/bh/bh: -5.97% (0.3603 => 0.3388, std.dev.: 0.0011)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.68% (6.1631 => 5.8130, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.23% (1.5361 => 1.4557, std.dev.: 0.0153)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.17% (2.6853 => 2.5465, std.dev.: 0.0016)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.70% (5.3476 => 5.0962, std.dev.: 0.0315)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.55% (5.2851 => 5.0448, std.dev.: 0.0234)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.19% (0.4153 => 0.3979, std.dev.: 0.0012)
  MultiSource/Applications/SPASS/SPASS: -4.07% (17.9111 => 17.1815, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.01% (1.4947 => 1.4348, std.dev.: 0.0207)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.79% (1.5376 => 1.4793, std.dev.: 0.0204)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.66% (0.7189 => 0.6926, std.dev.: 0.0072)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.38% (1.3780 => 1.3314, std.dev.: 0.0037)
  MultiSource/Benchmarks/nbench/nbench: -3.06% (1.3677 => 1.3259, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.02% (0.3309 => 0.3209, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.75% (10.3031 => 10.0197, std.dev.: 0.0689)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -36.93% (0.2134 => 0.1346, std.dev.: 0.0177)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.43% (2.1022 => 1.4204, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/bisort/bisort: -28.99% (0.9545 => 0.6778, std.dev.: 0.0073)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.93% (0.1189 => 0.0845, std.dev.: 0.0012)
  MultiSource/Applications/viterbi/viterbi: -27.35% (3.4923 => 2.5373, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.60% (6.9552 => 5.2444, std.dev.: 0.0291)
  SingleSource/Benchmarks/Misc/perlin: -21.39% (4.5989 => 3.6154, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc/mandel: -14.21% (1.1996 => 1.0291, std.dev.: 0.0281)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -13.21% (0.3557 => 0.3087, std.dev.: 0.0011)
  MultiSource/Applications/sgefa/sgefa: -13.18% (1.4030 => 1.2181, std.dev.: 0.0056)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.36% (47.2250 => 41.8626, std.dev.: 1.1235)
  MultiSource/Applications/lua/lua: -8.67% (31.0707 => 28.3757, std.dev.: 0.5606)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.58% (0.5173 => 0.4729, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/health/health: -7.68% (0.3556 => 0.3283, std.dev.: 0.0050)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.97% (3.5791 => 3.3655, std.dev.: 0.0522)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.67% (0.3773 => 0.3559, std.dev.: 0.0009)
  SingleSource/Regression/C/uint64_to_float: -5.49% (1.5184 => 1.4351, std.dev.: 0.0294)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.32% (1.7207 => 1.6292, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.76% (3.8119 => 3.6304, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/fbench: -4.23% (4.9602 => 4.7505, std.dev.: 0.0201)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.23% (0.3479 => 0.3332, std.dev.: 0.0005)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.02% (0.7355 => 0.7059, std.dev.: 0.0006)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.92% (1.3148 => 1.2633, std.dev.: 0.0100)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.66% (2.7049 => 2.6059, std.dev.: 0.0347)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.63% (21.6864 => 20.8991, std.dev.: 0.2657)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.41% (6.0444 => 5.8380, std.dev.: 0.0612)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.24% (5.2218 => 5.0526, std.dev.: 0.0459)
  MultiSource/Benchmarks/Olden/bh/bh: -2.96% (2.4879 => 2.4142, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.91% (1.1024 => 1.0703, std.dev.: 0.0108)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.27% (8.6172 => 8.4215, std.dev.: 0.0139)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.13% (1.0964 => 1.0731, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/oourafft: -2.10% (3.7891 => 3.7096, std.dev.: 0.0170)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.93% (34.8438 => 34.1726, std.dev.: 0.1014)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.50% (1.2012 => 1.1832, std.dev.: 0.0044)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.39% (0.1378 => 0.1345, std.dev.: 0.0098)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130802/37ce9f04/attachment.html>


More information about the llvm-testresults mailing list