[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 24 17:33:34 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13727?compare_to=13723&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13727, Order: 187079, Start Time: 2013-07-24 22:49:05, End Time: 2013-07-25 00:35:11
      To: 13723, Order: 187068, Start Time: 2013-07-24 20:36:13, End Time: 2013-07-24 22:25:01
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 24 (31 on baseline)
Performance Improvements: 10 (73 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1073 (1003 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-31-CastToBool: 76.21% (0.0269 => 0.0474, std.dev.: 0.0003)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 69.67% (0.0244 => 0.0414, std.dev.: 0.0011)
  SingleSource/UnitTests/TestLoop: 65.10% (0.0192 => 0.0317, std.dev.: 0.0005)
  SingleSource/UnitTests/printargs: 63.58% (0.0173 => 0.0283, std.dev.: 0.0029)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 63.54% (0.0192 => 0.0314, std.dev.: 0.0016)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 62.64% (0.0174 => 0.0283, std.dev.: 0.0006)
  SingleSource/UnitTests/2002-10-09-ArrayResolution: 60.23% (0.0176 => 0.0282, std.dev.: 0.0015)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 59.90% (0.0207 => 0.0331, std.dev.: 0.0017)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 58.89% (0.0287 => 0.0456, std.dev.: 0.0004)
  SingleSource/UnitTests/vla: 57.83% (0.0460 => 0.0726, std.dev.: 0.0029)
  SingleSource/UnitTests/AtomicOps: 56.60% (0.0212 => 0.0332, std.dev.: 0.0017)
  SingleSource/UnitTests/2002-12-13-MishaTest: 53.69% (0.0203 => 0.0312, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/sumarray-dbl: 51.11% (0.0225 => 0.0340, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 38.27% (0.1845 => 0.2551, std.dev.: 0.0082)
  SingleSource/UnitTests/Vector/constpool: 27.93% (8.9084 => 11.3969, std.dev.: 0.8555)
  SingleSource/Benchmarks/Shootout-C++/hash2: 9.68% (0.4930 => 0.5407, std.dev.: 0.0095)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 5.34% (0.2358 => 0.2484, std.dev.: 0.0001)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.67% (0.5739 => 0.5892, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.80% (1.3663 => 1.3909, std.dev.: 0.0056)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 48.82% (6.1039 => 9.0837, std.dev.: 0.6192)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 33.03% (3.2233 => 4.2881, std.dev.: 0.0452)
  SingleSource/Benchmarks/Misc/flops: 21.10% (8.0639 => 9.7654, std.dev.: 0.0227)
  SingleSource/Benchmarks/Shootout-C++/lists1: 12.34% (0.6108 => 0.6862, std.dev.: 0.0115)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.06% (46.2466 => 47.2009, std.dev.: 0.2790)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: -4.95% (0.3736 => 0.3551, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -3.08% (0.7168 => 0.6947, std.dev.: 0.0082)
  MultiSource/Benchmarks/McCat/05-eks/eks: -1.86% (0.5577 => 0.5473, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.37% (1.6830 => 1.6599, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -11.81% (23.6933 => 20.8944, std.dev.: 0.6171)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.84% (1.3627 => 1.2422, std.dev.: 0.0258)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.84% (0.4589 => 0.4275, std.dev.: 0.0112)
  MultiSource/Benchmarks/llubenchmark/llu: -2.61% (2.0489 => 1.9955, std.dev.: 0.0106)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.53% (2.4173 => 2.3562, std.dev.: 0.0229)
  MultiSource/Benchmarks/Olden/bh/bh: -1.26% (2.4196 => 2.3891, std.dev.: 0.0101)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.23% (0.1325 => 0.1328, std.dev.: 0.0128)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 168.06% (0.0072 => 0.0193, std.dev.: 0.0046)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 80.79% (0.0229 => 0.0414, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-05-31-CastToBool: 76.21% (0.0269 => 0.0474, std.dev.: 0.0003)
  SingleSource/UnitTests/TestLoop: 73.22% (0.0183 => 0.0317, std.dev.: 0.0005)
  SingleSource/UnitTests/2002-10-09-ArrayResolution: 71.95% (0.0164 => 0.0282, std.dev.: 0.0015)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 68.02% (0.0197 => 0.0331, std.dev.: 0.0017)
  SingleSource/UnitTests/vla: 62.42% (0.0447 => 0.0726, std.dev.: 0.0029)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 61.73% (0.0162 => 0.0262, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/sumarray-dbl: 61.14% (0.0211 => 0.0340, std.dev.: 0.0010)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 59.89% (0.0177 => 0.0283, std.dev.: 0.0006)
  SingleSource/UnitTests/printargs: 58.99% (0.0178 => 0.0283, std.dev.: 0.0029)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 58.33% (0.0288 => 0.0456, std.dev.: 0.0004)
  SingleSource/UnitTests/AtomicOps: 57.35% (0.0211 => 0.0332, std.dev.: 0.0017)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 55.45% (0.0202 => 0.0314, std.dev.: 0.0016)
  SingleSource/UnitTests/2002-12-13-MishaTest: 53.69% (0.0203 => 0.0312, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/simple: 52.73% (0.0220 => 0.0336, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 38.04% (0.1848 => 0.2551, std.dev.: 0.0082)
  SingleSource/UnitTests/Vector/constpool: 28.59% (8.8630 => 11.3969, std.dev.: 0.8555)
  SingleSource/Benchmarks/Shootout-C++/hash2: 9.92% (0.4919 => 0.5407, std.dev.: 0.0095)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2318 => 0.2484, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/hello: 6.06% (0.2046 => 0.2170, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/random: 5.77% (0.2220 => 0.2348, std.dev.: 0.0049)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 4.21% (0.5654 => 0.5892, std.dev.: 0.0033)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.02% (0.3873 => 0.3990, std.dev.: 0.0011)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 56.19% (5.8158 => 9.0837, std.dev.: 0.6192)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 47.70% (2.9033 => 4.2881, std.dev.: 0.0452)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 22.27% (0.0458 => 0.0560, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.46% (29.8131 => 34.4235, std.dev.: 0.3696)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.47% (2.1022 => 2.4064, std.dev.: 0.0146)
  SingleSource/Benchmarks/Shootout-C++/lists1: 13.72% (0.6034 => 0.6862, std.dev.: 0.0115)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.62% (48.3256 => 51.5224, std.dev.: 0.2861)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -36.66% (0.2237 => 0.1417, std.dev.: 0.0054)
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.21% (0.1072 => 0.0716, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -26.22% (0.0675 => 0.0498, std.dev.: 0.0028)
  MultiSource/Benchmarks/Olden/tsp/tsp: -25.08% (0.1818 => 0.1362, std.dev.: 0.0007)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.98% (0.1114 => 0.0858, std.dev.: 0.0005)
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.17% (6.0938 => 4.8039, std.dev.: 0.0873)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.80% (1.5228 => 1.2061, std.dev.: 0.0568)
  MultiSource/Benchmarks/Olden/health/health: -20.42% (0.1993 => 0.1586, std.dev.: 0.0002)
  MultiSource/Applications/obsequi/Obsequi: -19.59% (1.4685 => 1.1808, std.dev.: 0.0012)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.13% (0.3576 => 0.2892, std.dev.: 0.0176)
  MultiSource/Applications/lua/lua: -17.90% (5.3200 => 4.3679, std.dev.: 0.1984)
  MultiSource/Applications/hbd/hbd: -17.67% (2.0193 => 1.6625, std.dev.: 0.0937)
  MultiSource/Applications/hexxagon/hexxagon: -15.52% (1.3285 => 1.1223, std.dev.: 0.0571)
  MultiSource/Benchmarks/Olden/em3d/em3d: -15.25% (0.2367 => 0.2006, std.dev.: 0.0047)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.46% (1.3985 => 1.2103, std.dev.: 0.0475)
  MultiSource/Applications/lambda-0_1_3/lambda: -12.33% (0.9461 => 0.8294, std.dev.: 0.0349)
  MultiSource/Applications/ClamAV/clamscan: -12.14% (19.4145 => 17.0574, std.dev.: 0.5822)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -10.69% (0.1141 => 0.1019, std.dev.: 0.0011)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -10.32% (0.1947 => 0.1746, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.10% (1.7797 => 1.5999, std.dev.: 0.0191)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.38% (0.3655 => 0.3312, std.dev.: 0.0018)
  MultiSource/Applications/sqlite3/sqlite3: -9.27% (19.1635 => 17.3876, std.dev.: 0.5313)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -9.09% (0.1144 => 0.1040, std.dev.: 0.0010)
  MultiSource/Applications/kimwitu++/kc: -8.20% (21.0770 => 19.3479, std.dev.: 0.0748)
  MultiSource/Applications/Burg/burg: -7.43% (1.5733 => 1.4564, std.dev.: 0.0106)
  MultiSource/Benchmarks/Olden/mst/mst: -7.43% (0.1454 => 0.1346, std.dev.: 0.0016)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.29% (1.7461 => 1.6188, std.dev.: 0.0072)
  MultiSource/Benchmarks/Olden/bh/bh: -6.99% (0.3603 => 0.3351, std.dev.: 0.0015)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.50% (2.6853 => 2.5108, std.dev.: 0.0350)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.40% (1.5426 => 1.4438, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.30% (1.5144 => 1.4190, std.dev.: 0.0333)
  MultiSource/Applications/minisat/minisat: -6.29% (0.8278 => 0.7757, std.dev.: 0.0178)
  MultiSource/Applications/JM/lencod/lencod: -6.21% (18.5029 => 17.3539, std.dev.: 0.1102)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -6.17% (0.2432 => 0.2282, std.dev.: 0.0033)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.65% (6.1631 => 5.8150, std.dev.: 0.0988)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (1.5239 => 1.4408, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.11% (1.4333 => 1.3601, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.67% (1.4853 => 1.4160, std.dev.: 0.0087)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.65% (0.4153 => 0.3960, std.dev.: 0.0024)
  MultiSource/Applications/SPASS/SPASS: -4.40% (17.9111 => 17.1234, std.dev.: 0.1344)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.13% (1.4940 => 1.4323, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.11% (1.4783 => 1.4175, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.06% (1.4506 => 1.3917, std.dev.: 0.0125)
  MultiSource/Benchmarks/McCat/09-vor/vor: -3.24% (0.3670 => 0.3551, std.dev.: 0.0033)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.21% (1.3780 => 1.3338, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.20% (1.5479 => 1.4984, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.00% (1.4339 => 1.3909, std.dev.: 0.0056)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.86% (0.5634 => 0.5473, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.85% (0.7189 => 0.6984, std.dev.: 0.0016)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.42% (0.7487 => 0.7381, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -37.72% (0.2134 => 0.1329, std.dev.: 0.0129)
  MultiSource/Applications/lemon/lemon: -36.28% (1.4194 => 0.9045, std.dev.: 0.1003)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.58% (0.0816 => 0.0542, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.50% (0.9545 => 0.6729, std.dev.: 0.0093)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -29.41% (1.0962 => 0.7738, std.dev.: 0.0584)
  MultiSource/Applications/JM/ldecod/ldecod: -28.52% (0.0859 => 0.0614, std.dev.: 0.0029)
  MultiSource/Applications/obsequi/Obsequi: -14.39% (2.6081 => 2.2329, std.dev.: 0.0768)
  MultiSource/Applications/SPASS/SPASS: -12.94% (9.2220 => 8.0290, std.dev.: 0.1875)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.70% (0.3557 => 0.3141, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.76% (0.3649 => 0.3293, std.dev.: 0.0127)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -7.47% (0.2047 => 0.1894, std.dev.: 0.0013)
  MultiSource/Benchmarks/Olden/health/health: -6.61% (0.3556 => 0.3321, std.dev.: 0.0049)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.53% (1.5339 => 1.4338, std.dev.: 0.0141)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.3148 => 1.2355, std.dev.: 0.0287)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.14% (3.5791 => 3.3953, std.dev.: 0.0230)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.66% (0.5173 => 0.4932, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/bh/bh: -3.97% (2.4879 => 2.3891, std.dev.: 0.0101)
  MultiSource/Applications/lua/lua: -3.73% (31.0707 => 29.9108, std.dev.: 0.0117)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.31% (0.3479 => 0.3364, std.dev.: 0.0031)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.03% (0.4783 => 0.4638, std.dev.: 0.0010)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.88% (1.0964 => 1.0648, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.92% (4.9231 => 4.8287, std.dev.: 0.0007)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6480 => 0.6357, std.dev.: 0.0019)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.63% (0.1378 => 0.1328, std.dev.: 0.0128)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130724/b4cfd583/attachment.html>


More information about the llvm-testresults mailing list