[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Aug 18 08:26:07 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14532?compare_to=14528&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14532, Order: 188637, Start Time: 2013-08-18 13:45:30, End Time: 2013-08-18 15:28:12
      To: 14528, Order: 188636, Start Time: 2013-08-18 10:54:50, End Time: 2013-08-18 12:36:03
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 4 (45 on baseline)
Performance Improvements: 2 (102 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1101 (960 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.39% (0.2575 => 0.2688, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 13.32% (4.2588 => 4.8259, std.dev.: 0.0027)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.33% (5.5622 => 5.6362, std.dev.: 0.0255)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.05% (1.5840 => 1.6006, std.dev.: 0.0045)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/hbd/hbd: -1.55% (1.6864 => 1.6602, std.dev.: 0.0053)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.13% (6.5672 => 6.3618, std.dev.: 0.0501)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.77% (0.1297 => 0.1307, std.dev.: 0.0001)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 43.13% (0.0466 => 0.0667, std.dev.: 0.0058)
  MultiSource/Benchmarks/FreeBench/distray/distray: 18.10% (0.1033 => 0.1220, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/oourafft: 4.82% (0.2284 => 0.2394, std.dev.: 0.0010)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.81% (0.9941 => 1.0220, std.dev.: 0.0062)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.58% (0.6785 => 0.6960, std.dev.: 0.0031)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.9407 => 0.9552, std.dev.: 0.0036)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.17% (1.9317 => 1.9543, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.17% (0.9761 => 0.9875, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.02% (6.4979 => 6.5640, std.dev.: 0.0087)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 70.63% (3.7285 => 6.3618, std.dev.: 0.0501)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.27% (2.8867 => 4.2802, std.dev.: 0.0280)
  MultiSource/Benchmarks/FreeBench/neural/neural: 26.81% (0.3171 => 0.4021, std.dev.: 0.0169)
  SingleSource/Benchmarks/Shootout/hash: 23.07% (4.1846 => 5.1498, std.dev.: 0.2250)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.85% (0.6295 => 0.7293, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 15.72% (2.9428 => 3.4055, std.dev.: 0.0150)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.97% (7.0762 => 7.8523, std.dev.: 0.0162)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.73% (0.1678 => 0.1858, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.34% (5.4910 => 5.9489, std.dev.: 0.0726)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.00% (48.3256 => 52.1927, std.dev.: 0.3446)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.75% (1.2557 => 1.3530, std.dev.: 0.0033)
  MultiSource/Applications/JM/lencod/lencod: 7.11% (7.1799 => 7.6902, std.dev.: 0.1527)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.90% (3.2027 => 3.4237, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6223, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.62% (3.4085 => 3.6001, std.dev.: 0.0497)
  MultiSource/Benchmarks/FreeBench/mason/mason: 5.47% (0.2799 => 0.2952, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.48% (1.5339 => 1.6026, std.dev.: 0.0046)
  MultiSource/Applications/siod/siod: 4.38% (3.3761 => 3.5240, std.dev.: 0.0392)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.3151 => 4.4974, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.22% (5.1471 => 5.3642, std.dev.: 0.0217)
  SingleSource/Benchmarks/Misc/whetstone: 3.97% (3.4559 => 3.5930, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.77% (3.3384 => 3.4641, std.dev.: 0.0315)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.30% (6.1245 => 6.3266, std.dev.: 0.0057)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.27% (25.0200 => 25.8387, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.85% (3.3877 => 3.4844, std.dev.: 0.0109)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.75% (1.3104 => 1.3464, std.dev.: 0.0006)
  MultiSource/Applications/spiff/spiff: 2.68% (2.7609 => 2.8348, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.16% (12.8625 => 13.1407, std.dev.: 0.0353)
  SingleSource/Benchmarks/Shootout/matrix: 2.10% (1.7358 => 1.7722, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.84% (3.3464 => 3.4081, std.dev.: 0.0095)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.66% (1.4398 => 1.4637, std.dev.: 0.0086)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.66% (3.5351 => 3.5937, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.36% (5.0417 => 5.1103, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout/methcall: 1.31% (8.4614 => 8.5725, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.11% (4.9040 => 4.9582, std.dev.: 0.0124)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.05% (1.4813 => 1.4969, std.dev.: 0.0005)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.15% (0.2237 => 0.1473, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.37% (0.1072 => 0.0725, std.dev.: 0.0007)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.15% (0.1818 => 0.1379, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -22.52% (0.0675 => 0.0523, std.dev.: 0.0004)
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.69% (6.0938 => 4.7720, std.dev.: 0.0070)
  MultiSource/Benchmarks/Olden/health/health: -21.48% (0.1993 => 0.1565, std.dev.: 0.0036)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.27% (0.1114 => 0.0877, std.dev.: 0.0019)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.17% (1.5228 => 1.2157, std.dev.: 0.0036)
  MultiSource/Applications/obsequi/Obsequi: -18.82% (1.4685 => 1.1921, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.79% (0.3576 => 0.2904, std.dev.: 0.0028)
  MultiSource/Applications/hbd/hbd: -17.78% (2.0193 => 1.6602, std.dev.: 0.0053)
  MultiSource/Applications/lua/lua: -17.11% (5.3200 => 4.4096, std.dev.: 0.0065)
  MultiSource/Applications/hexxagon/hexxagon: -16.13% (1.3285 => 1.1142, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.69% (0.2367 => 0.2043, std.dev.: 0.0008)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.42% (1.3985 => 1.2108, std.dev.: 0.0070)
  MultiSource/Applications/sgefa/sgefa: -12.79% (0.4809 => 0.4194, std.dev.: 0.0022)
  MultiSource/Applications/JM/ldecod/ldecod: -11.92% (8.6720 => 7.6387, std.dev.: 0.0054)
  MultiSource/Applications/ClamAV/clamscan: -11.79% (19.4145 => 17.1264, std.dev.: 0.0986)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.50% (0.1870 => 0.1655, std.dev.: 0.0032)
  MultiSource/Applications/lambda-0_1_3/lambda: -10.68% (0.9461 => 0.8451, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.32% (0.3073 => 0.2756, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.79% (0.3655 => 0.3297, std.dev.: 0.0030)
  MultiSource/Applications/sqlite3/sqlite3: -9.22% (19.1635 => 17.3962, std.dev.: 0.0249)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -8.94% (0.1141 => 0.1039, std.dev.: 0.0023)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -7.55% (0.1947 => 0.1800, std.dev.: 0.0008)
  MultiSource/Applications/kimwitu++/kc: -7.15% (21.0770 => 19.5704, std.dev.: 0.0287)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.83% (1.7461 => 1.6268, std.dev.: 0.0067)
  MultiSource/Applications/siod/siod: -6.66% (2.7150 => 2.5343, std.dev.: 0.0011)
  MultiSource/Applications/JM/lencod/lencod: -6.39% (18.5029 => 17.3209, std.dev.: 0.0390)
  MultiSource/Applications/Burg/burg: -6.31% (1.5733 => 1.4741, std.dev.: 0.0075)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.08% (6.1631 => 5.7885, std.dev.: 0.0106)
  MultiSource/Benchmarks/Olden/bh/bh: -5.88% (0.3603 => 0.3391, std.dev.: 0.0050)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.63% (2.6853 => 2.5340, std.dev.: 0.0182)
  MultiSource/Applications/oggenc/oggenc: -5.54% (6.1121 => 5.7736, std.dev.: 0.0057)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -5.47% (0.2432 => 0.2299, std.dev.: 0.0004)
  MultiSource/Applications/minisat/minisat: -5.18% (0.8278 => 0.7849, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.88% (1.4721 => 1.4002, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.87% (1.4166 => 1.3476, std.dev.: 0.0111)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.73% (5.3476 => 5.0944, std.dev.: 0.0408)
  MultiSource/Applications/lemon/lemon: -4.32% (1.2976 => 1.2415, std.dev.: 0.0111)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.28% (5.2851 => 5.0588, std.dev.: 0.0312)
  MultiSource/Applications/SPASS/SPASS: -4.02% (17.9111 => 17.1914, std.dev.: 0.0669)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.58% (1.3780 => 1.3286, std.dev.: 0.0097)
  MultiSource/Benchmarks/McCat/18-imp/imp: -2.99% (0.4153 => 0.4029, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.70% (0.7189 => 0.6995, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.59% (10.3031 => 10.0365, std.dev.: 0.0164)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.06% (0.5634 => 0.5518, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.04% (1.3946 => 1.3661, std.dev.: 0.0069)
  MultiSource/Applications/d/make_dparser: -1.21% (3.7722 => 3.7266, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -50.63% (0.0316 => 0.0156, std.dev.: 0.0040)
  MultiSource/Applications/lemon/lemon: -37.11% (1.4194 => 0.8926, std.dev.: 0.0058)
  MultiSource/Benchmarks/Olden/mst/mst: -36.93% (0.2134 => 0.1346, std.dev.: 0.0275)
  MultiSource/Benchmarks/MallocBench/gs/gs: -35.91% (0.1189 => 0.0762, std.dev.: 0.0044)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.07% (2.1022 => 1.4281, std.dev.: 0.0002)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -30.79% (1.0962 => 0.7587, std.dev.: 0.0492)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.15% (0.0816 => 0.0570, std.dev.: 0.0004)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.74% (0.9545 => 0.6706, std.dev.: 0.0018)
  MultiSource/Applications/viterbi/viterbi: -27.52% (3.4923 => 2.5311, std.dev.: 0.0279)
  MultiSource/Applications/JM/ldecod/ldecod: -25.03% (0.0859 => 0.0644, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.62% (6.9552 => 5.2426, std.dev.: 0.1435)
  MultiSource/Applications/minisat/minisat: -22.57% (8.0162 => 6.2071, std.dev.: 0.0544)
  SingleSource/Benchmarks/Misc/perlin: -21.52% (4.5989 => 3.6094, std.dev.: 0.0041)
  MultiSource/Applications/obsequi/Obsequi: -19.15% (2.6081 => 2.1086, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc/mandel: -14.55% (1.1996 => 1.0251, std.dev.: 0.0030)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.48% (0.0884 => 0.0756, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.21% (6.2627 => 5.4356, std.dev.: 0.3076)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.79% (0.3557 => 0.3102, std.dev.: 0.0012)
  MultiSource/Applications/SPASS/SPASS: -12.61% (9.2220 => 8.0587, std.dev.: 0.0792)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.53% (0.5173 => 0.4680, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout/strcat: -8.91% (0.1593 => 0.1451, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -8.26% (0.2047 => 0.1878, std.dev.: 0.0023)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.22% (1.3148 => 1.2330, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.14% (0.3773 => 0.3579, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.01% (3.8119 => 3.6211, std.dev.: 0.0218)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.89% (0.4969 => 0.4726, std.dev.: 0.0013)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.86% (47.2250 => 44.9281, std.dev.: 0.7781)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.66% (1.1024 => 1.0510, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.63% (0.3479 => 0.3318, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/fbench: -4.55% (4.9602 => 4.7346, std.dev.: 0.0033)
  MultiSource/Applications/lua/lua: -4.52% (31.0707 => 29.6666, std.dev.: 0.0074)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.25% (1.7207 => 1.6476, std.dev.: 0.0115)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.24% (0.7355 => 0.7043, std.dev.: 0.0000)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.76% (2.7049 => 2.6033, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.40% (6.0444 => 5.8389, std.dev.: 0.0594)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.34% (21.6864 => 20.9622, std.dev.: 0.2141)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.28% (0.7806 => 0.7550, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9624, std.dev.: 0.0143)
  MultiSource/Benchmarks/Olden/bh/bh: -2.97% (2.4879 => 2.4140, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.45% (8.6172 => 8.4061, std.dev.: 0.0069)
  MultiSource/Applications/sgefa/sgefa: -2.44% (1.4030 => 1.3687, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/oourafft: -2.16% (3.7891 => 3.7074, std.dev.: 0.0022)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.03% (34.8438 => 34.1381, std.dev.: 0.0493)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.91% (1.8144 => 1.7797, std.dev.: 0.0083)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.58% (2.9568 => 2.9100, std.dev.: 0.0103)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.53% (1.2012 => 1.1828, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.44% (4.5517 => 4.4863, std.dev.: 0.0224)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.43% (16.5294 => 16.2928, std.dev.: 0.0847)
  SingleSource/Benchmarks/Shootout/lists: -1.43% (7.2315 => 7.1282, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.42% (5.8810 => 5.7975, std.dev.: 0.0020)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.25% (1.6737 => 1.6528, std.dev.: 0.0045)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.17% (2.1343 => 2.1094, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.07% (2.8052 => 2.7753, std.dev.: 0.0025)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.15% (0.1378 => 0.1307, std.dev.: 0.0001)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130818/98e0cbc4/attachment.html>


More information about the llvm-testresults mailing list