[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 30 18:31:57 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13940?compare_to=13936&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13940, Order: 187459, Start Time: 2013-07-30 23:39:26, End Time: 2013-07-31 01:33:41
      To: 13936, Order: 187443, Start Time: 2013-07-30 21:19:14, End Time: 2013-07-30 23:14:33
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 15 (33 on baseline)
Performance Improvements: 35 (34 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1057 (1040 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.99% (50.2077 => 57.7351, std.dev.: 1.9155)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.37% (1.3733 => 1.5706, std.dev.: 0.0071)
  MultiSource/Benchmarks/mafft/pairlocalalign: 14.27% (10.9906 => 12.5591, std.dev.: 0.2489)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.54% (1.4451 => 1.6263, std.dev.: 0.0320)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.28% (25.8999 => 28.8207, std.dev.: 0.7962)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.48% (1.4197 => 1.5685, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.48% (1.3972 => 1.5017, std.dev.: 0.0299)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 26.30% (1.8752 => 2.3683, std.dev.: 0.1409)
  MultiSource/Benchmarks/Bullet/bullet: 12.33% (6.9202 => 7.7733, std.dev.: 0.0185)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.50% (90.7400 => 100.2665, std.dev.: 0.7407)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.09% (0.2756 => 0.2979, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 6.15% (0.2161 => 0.2294, std.dev.: 0.0041)
  SingleSource/Benchmarks/Dhrystone/fldry: 4.32% (0.6595 => 0.6880, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.60% (5.7776 => 5.8703, std.dev.: 0.0101)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.38% (51.5359 => 52.2466, std.dev.: 0.0321)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: -57.25% (0.0269 => 0.0115, std.dev.: 0.0056)
  SingleSource/UnitTests/SignlessTypes/div: -42.02% (0.0583 => 0.0338, std.dev.: 0.0017)
  SingleSource/Benchmarks/SmallPT/smallpt: -40.02% (0.2401 => 0.1440, std.dev.: 0.0089)
  SingleSource/UnitTests/member-function-pointers: -39.60% (0.0351 => 0.0212, std.dev.: 0.0045)
  SingleSource/UnitTests/byval-alignment: -36.49% (0.0285 => 0.0181, std.dev.: 0.0032)
  SingleSource/UnitTests/2007-01-04-KNR-Args: -35.28% (0.0309 => 0.0200, std.dev.: 0.0012)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -34.13% (0.0375 => 0.0247, std.dev.: 0.0028)
  MultiSource/Applications/hbd/hbd: -29.01% (2.3016 => 1.6340, std.dev.: 0.0141)
  SingleSource/Benchmarks/Shootout/heapsort: -27.85% (0.0650 => 0.0469, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/ary2: -27.50% (0.4080 => 0.2958, std.dev.: 0.0135)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -23.73% (0.3034 => 0.2314, std.dev.: 0.0064)
  MultiSource/Applications/lua/lua: -23.68% (5.7858 => 4.4159, std.dev.: 0.0523)
  MultiSource/Applications/viterbi/viterbi: -20.46% (0.2312 => 0.1839, std.dev.: 0.0136)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -18.54% (0.1381 => 0.1125, std.dev.: 0.0096)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -16.26% (0.2767 => 0.2317, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -15.21% (0.0802 => 0.0680, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/hash: -14.81% (0.5396 => 0.4597, std.dev.: 0.0200)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -13.13% (0.4987 => 0.4332, std.dev.: 0.0143)
  MultiSource/Applications/hexxagon/hexxagon: -12.93% (1.2817 => 1.1160, std.dev.: 0.0043)
  MultiSource/Applications/lambda-0_1_3/lambda: -12.56% (0.9589 => 0.8385, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -11.39% (0.2433 => 0.2156, std.dev.: 0.0096)
  SingleSource/Benchmarks/Shootout-C++/ary3: -11.32% (0.3260 => 0.2891, std.dev.: 0.0141)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -11.05% (0.1077 => 0.0958, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/matrix: -9.09% (0.2914 => 0.2649, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -7.83% (1.7447 => 1.6081, std.dev.: 0.0239)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.95% (1.4842 => 1.4108, std.dev.: 0.0173)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -37.75% (0.0347 => 0.0216, std.dev.: 0.0015)
  MultiSource/Benchmarks/McCat/08-main/main: -18.22% (0.0988 => 0.0808, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -10.72% (3.3088 => 2.9540, std.dev.: 0.1263)
  MultiSource/Benchmarks/nbench/nbench: -6.44% (22.7306 => 21.2678, std.dev.: 0.1779)
  SingleSource/Benchmarks/Misc/ffbench: -5.91% (1.4799 => 1.3925, std.dev.: 0.0290)
  SingleSource/Benchmarks/Shootout-C++/lists1: -2.05% (0.6106 => 0.5981, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.74% (3.4928 => 3.4321, std.dev.: 0.0197)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.48% (3.8007 => 3.7443, std.dev.: 0.0124)
  SingleSource/Benchmarks/Shootout/matrix: -1.04% (1.7908 => 1.7721, std.dev.: 0.0036)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.34% (0.1367 => 0.1335, std.dev.: 0.0028)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.53% (49.1253 => 57.7351, std.dev.: 1.9155)
  MultiSource/Benchmarks/mafft/pairlocalalign: 15.71% (10.8541 => 12.5591, std.dev.: 0.2489)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.24% (1.3993 => 1.5706, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 5.35% (1.5437 => 1.6263, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.07% (1.5629 => 1.6422, std.dev.: 0.0213)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.70% (2.8867 => 4.2924, std.dev.: 0.0364)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 46.91% (1.6121 => 2.3683, std.dev.: 0.1409)
  MultiSource/Benchmarks/FreeBench/neural/neural: 41.72% (0.3171 => 0.4494, std.dev.: 0.0303)
  SingleSource/Benchmarks/Shootout/hash: 30.76% (4.1846 => 5.4718, std.dev.: 0.2119)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.20% (1.5030 => 1.8817, std.dev.: 0.0103)
  MultiSource/Applications/siod/siod: 14.87% (3.3761 => 3.8782, std.dev.: 0.0443)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.77% (7.0762 => 7.9801, std.dev.: 0.0301)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 11.20% (0.2679 => 0.2979, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.52% (5.4910 => 5.9588, std.dev.: 0.0620)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.38% (1.2557 => 1.3609, std.dev.: 0.0300)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.11% (48.3256 => 52.2466, std.dev.: 0.0321)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.16% (3.2027 => 3.4321, std.dev.: 0.0197)
  MultiSource/Benchmarks/PAQ8p/paq8p: 7.04% (93.6732 => 100.2665, std.dev.: 0.7407)
  MultiSource/Benchmarks/Bullet/bullet: 6.49% (7.2995 => 7.7733, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.12% (5.3042 => 5.6286, std.dev.: 0.0624)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 6.05% (3.5351 => 3.7489, std.dev.: 0.0523)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.94% (3.4085 => 3.6109, std.dev.: 0.0250)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.81% (3.3877 => 3.5845, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.57% (5.5008 => 5.8071, std.dev.: 0.0349)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.96% (5.1471 => 5.4026, std.dev.: 0.0385)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.35% (4.3151 => 4.5026, std.dev.: 0.0038)
  SingleSource/Benchmarks/Dhrystone/fldry: 4.27% (0.6598 => 0.6880, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/whetstone: 3.87% (3.4559 => 3.5897, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.43% (12.8625 => 13.1751, std.dev.: 0.0272)
  SingleSource/Benchmarks/Shootout/matrix: 2.09% (1.7358 => 1.7721, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/flops: 1.59% (9.7664 => 9.9214, std.dev.: 0.0138)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.47% (1.4398 => 1.4609, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.20% (4.9089 => 4.9676, std.dev.: 0.0192)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -20.88% (0.1518 => 0.1201, std.dev.: 0.0038)
  MultiSource/Applications/hbd/hbd: -19.08% (2.0193 => 1.6340, std.dev.: 0.0141)
  MultiSource/Applications/lua/lua: -16.99% (5.3200 => 4.4159, std.dev.: 0.0523)
  MultiSource/Applications/hexxagon/hexxagon: -16.00% (1.3285 => 1.1160, std.dev.: 0.0043)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.83% (0.7091 => 0.6110, std.dev.: 0.0098)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.37% (0.9461 => 0.8385, std.dev.: 0.0050)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.25% (0.2498 => 0.2317, std.dev.: 0.0043)
  MultiSource/Applications/siod/siod: -7.12% (2.7150 => 2.5217, std.dev.: 0.0664)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.02% (1.4853 => 1.4108, std.dev.: 0.0173)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.68% (1.4194 => 0.8846, std.dev.: 0.0767)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.11% (2.1022 => 1.4271, std.dev.: 0.0323)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -31.65% (0.0316 => 0.0216, std.dev.: 0.0015)
  MultiSource/Applications/viterbi/viterbi: -27.51% (3.4923 => 2.5316, std.dev.: 0.0983)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.58% (6.9552 => 5.2457, std.dev.: 0.0645)
  MultiSource/Applications/JM/ldecod/ldecod: -23.63% (0.0859 => 0.0656, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/perlin: -21.36% (4.5989 => 3.6168, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/mandel: -14.60% (1.1996 => 1.0244, std.dev.: 0.0377)
  MultiSource/Applications/sgefa/sgefa: -13.21% (1.4030 => 1.2176, std.dev.: 0.0116)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.61% (3.5791 => 3.2353, std.dev.: 0.1062)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.14% (47.2250 => 44.7978, std.dev.: 0.1678)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.97% (0.4969 => 0.4722, std.dev.: 0.0018)
  MultiSource/Applications/lua/lua: -4.72% (31.0707 => 29.6033, std.dev.: 0.4399)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.61% (3.8119 => 3.6363, std.dev.: 0.0500)
  SingleSource/Benchmarks/Misc/fbench: -4.23% (4.9602 => 4.7502, std.dev.: 0.0275)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.07% (2.7049 => 2.5948, std.dev.: 0.0319)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.53% (1.7207 => 1.6599, std.dev.: 0.0112)
  MultiSource/Benchmarks/nbench/nbench: -3.36% (22.0083 => 21.2678, std.dev.: 0.1779)
  SingleSource/Regression/C/uint64_to_float: -2.77% (1.5184 => 1.4763, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.53% (6.1482 => 5.9925, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.25% (5.2218 => 5.1044, std.dev.: 0.0415)
  SingleSource/Benchmarks/Misc/oourafft: -1.93% (3.7891 => 3.7160, std.dev.: 0.0146)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.53% (34.8438 => 34.3118, std.dev.: 0.0912)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.49% (4.2062 => 4.1435, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.27% (5.8810 => 5.8066, std.dev.: 0.0224)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.12% (0.1378 => 0.1335, std.dev.: 0.0028)

Report Time: 1.12s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130730/e741b3a4/attachment.html>


More information about the llvm-testresults mailing list