[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 21 15:02:22 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16545?compare_to=16542&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16545, Order: 193107, Start Time: 2013-10-21 20:14:42, End Time: 2013-10-21 22:05:38
      To: 16542, Order: 193090, Start Time: 2013-10-21 17:51:57, End Time: 2013-10-21 19:48:15
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 26 (48 on baseline)
Performance Improvements: 37 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1044 (1043 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 80.49% (0.0164 => 0.0296, std.dev.: 0.0008)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 76.88% (0.0173 => 0.0306, std.dev.: 0.0011)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 76.53% (0.0277 => 0.0489, std.dev.: 0.0006)
  SingleSource/UnitTests/byval-alignment: 74.33% (0.0187 => 0.0326, std.dev.: 0.0011)
  SingleSource/Regression/C/badidx: 68.91% (0.0267 => 0.0451, std.dev.: 0.0021)
  SingleSource/UnitTests/2002-12-13-MishaTest: 67.77% (0.0211 => 0.0354, std.dev.: 0.0021)
  SingleSource/Regression/C++/BuiltinTypeInfo: 66.67% (0.0216 => 0.0360, std.dev.: 0.0014)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 64.42% (0.0163 => 0.0268, std.dev.: 0.0026)
  SingleSource/UnitTests/2003-04-22-Switch: 62.50% (0.0192 => 0.0312, std.dev.: 0.0022)
  SingleSource/Benchmarks/CoyoteBench/almabench: 61.79% (0.0814 => 0.1317, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout/random: 56.66% (0.0353 => 0.0553, std.dev.: 0.0020)
  SingleSource/UnitTests/2002-05-02-CastTest: 56.47% (0.0255 => 0.0399, std.dev.: 0.0041)
  SingleSource/Regression/C/2003-05-22-VarSizeArray: 55.80% (0.0181 => 0.0282, std.dev.: 0.0006)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: 54.59% (0.0185 => 0.0286, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/constpool: 54.22% (8.8331 => 13.6223, std.dev.: 0.7426)
  SingleSource/UnitTests/Vector/simple: 52.63% (0.0266 => 0.0406, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/sumarray-dbl: 52.05% (0.0244 => 0.0371, std.dev.: 0.0017)
  SingleSource/Regression/C++/short_circuit_dtor: 51.18% (0.0211 => 0.0319, std.dev.: 0.0031)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 35.68% (1.8046 => 2.4485, std.dev.: 0.2157)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.01% (30.2892 => 34.5322, std.dev.: 0.6568)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.33% (1.3807 => 1.5095, std.dev.: 0.0017)
  MultiSource/Benchmarks/sim/sim: 5.85% (3.8381 => 4.0627, std.dev.: 0.0686)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (1.0094 => 1.0673, std.dev.: 0.0006)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.07% (1.1039 => 1.1599, std.dev.: 0.0013)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.70% (0.7161 => 0.7354, std.dev.: 0.0053)
  MultiSource/Applications/obsequi/Obsequi: 2.55% (2.3184 => 2.3776, std.dev.: 0.0192)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout/methcall: -39.76% (0.0586 => 0.0353, std.dev.: 0.0058)
  MultiSource/Applications/hbd/hbd: -31.25% (2.3528 => 1.6176, std.dev.: 0.0159)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: -31.10% (0.0328 => 0.0226, std.dev.: 0.0033)
  MultiSource/Applications/hexxagon/hexxagon: -22.68% (1.3553 => 1.0479, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -22.00% (0.7414 => 0.5783, std.dev.: 0.0360)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -18.59% (0.8340 => 0.6790, std.dev.: 0.0514)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -17.27% (0.1639 => 0.1356, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -14.91% (1.7563 => 1.4944, std.dev.: 0.0073)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -14.52% (1.0550 => 0.9018, std.dev.: 0.0578)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -13.75% (0.2698 => 0.2327, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -13.51% (0.2435 => 0.2106, std.dev.: 0.0109)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.51% (0.0895 => 0.0792, std.dev.: 0.0007)
  MultiSource/Benchmarks/McCat/08-main/main: -10.99% (0.3549 => 0.3159, std.dev.: 0.0030)
  MultiSource/Applications/kimwitu++/kc: -10.96% (21.3529 => 19.0136, std.dev.: 0.5585)
  SingleSource/Benchmarks/Shootout-C++/lists: -10.09% (0.2915 => 0.2621, std.dev.: 0.0090)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -9.92% (0.2390 => 0.2153, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -9.23% (1.3653 => 1.2393, std.dev.: 0.0400)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: -9.09% (0.1122 => 0.1020, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/lists1: -9.03% (0.3444 => 0.3133, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.60% (1.3310 => 1.2165, std.dev.: 0.0087)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -8.54% (0.3831 => 0.3504, std.dev.: 0.0085)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -7.97% (0.1606 => 0.1478, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.64% (0.3153 => 0.2912, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.86% (0.3040 => 0.2862, std.dev.: 0.0036)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.88% (0.5467 => 0.5200, std.dev.: 0.0038)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.40% (2.6370 => 2.5738, std.dev.: 0.0230)
  MultiSource/Applications/obsequi/Obsequi: -1.02% (1.1881 => 1.1760, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -16.27% (0.1174 => 0.0983, std.dev.: 0.0009)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.39% (47.1099 => 40.8018, std.dev.: 2.2823)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -12.27% (1.4890 => 1.3063, std.dev.: 0.0066)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -7.85% (0.8183 => 0.7541, std.dev.: 0.0153)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -7.51% (10.2966 => 9.5232, std.dev.: 0.2311)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.47% (5.8506 => 5.7059, std.dev.: 0.0080)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.62% (16.5761 => 16.3083, std.dev.: 0.0159)
  SingleSource/Regression/C/uint64_to_float: -1.58% (1.4916 => 1.4680, std.dev.: 0.0069)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.48% (2.5946 => 2.5563, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/flops-6: -1.12% (2.4294 => 2.4023, std.dev.: 0.0086)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.44% (0.1351 => 0.1357, std.dev.: 0.0276)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 97.14% (0.0105 => 0.0207, std.dev.: 0.0009)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 88.08% (0.0260 => 0.0489, std.dev.: 0.0006)
  SingleSource/UnitTests/2008-04-20-LoopBug2: 83.85% (0.0161 => 0.0296, std.dev.: 0.0008)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 81.07% (0.0169 => 0.0306, std.dev.: 0.0011)
  SingleSource/Regression/C/2003-05-22-VarSizeArray: 79.62% (0.0157 => 0.0282, std.dev.: 0.0006)
  SingleSource/UnitTests/byval-alignment: 79.12% (0.0182 => 0.0326, std.dev.: 0.0011)
  SingleSource/UnitTests/2002-12-13-MishaTest: 78.79% (0.0198 => 0.0354, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/simple: 77.29% (0.0229 => 0.0406, std.dev.: 0.0004)
  SingleSource/Regression/C++/BuiltinTypeInfo: 74.76% (0.0206 => 0.0360, std.dev.: 0.0014)
  SingleSource/Regression/C/badidx: 71.48% (0.0263 => 0.0451, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/sumarray-dbl: 70.97% (0.0217 => 0.0371, std.dev.: 0.0017)
  SingleSource/UnitTests/2003-04-22-Switch: 70.49% (0.0183 => 0.0312, std.dev.: 0.0022)
  SingleSource/Benchmarks/CoyoteBench/almabench: 70.16% (0.0774 => 0.1317, std.dev.: 0.0063)
  SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 68.39% (0.0155 => 0.0261, std.dev.: 0.0008)
  SingleSource/Regression/C/2004-03-15-IndirectGoto: 65.84% (0.0161 => 0.0267, std.dev.: 0.0019)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 63.69% (0.0157 => 0.0257, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout/random: 62.65% (0.0340 => 0.0553, std.dev.: 0.0020)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: 62.50% (0.0176 => 0.0286, std.dev.: 0.0024)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 61.45% (0.0166 => 0.0268, std.dev.: 0.0026)
  SingleSource/UnitTests/2002-05-02-CastTest: 59.60% (0.0250 => 0.0399, std.dev.: 0.0041)
  SingleSource/Regression/C++/short_circuit_dtor: 57.92% (0.0202 => 0.0319, std.dev.: 0.0031)
  SingleSource/UnitTests/Vector/constpool: 53.20% (8.8921 => 13.6223, std.dev.: 0.7426)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 42.34% (0.1651 => 0.2350, std.dev.: 0.0260)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.60% (4.0397 => 4.5486, std.dev.: 0.1851)
  MultiSource/Benchmarks/McCat/08-main/main: 10.07% (0.2870 => 0.3159, std.dev.: 0.0030)
  MultiSource/Applications/hbd/hbd: 3.06% (1.5696 => 1.6176, std.dev.: 0.0159)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.05% (0.5046 => 0.5200, std.dev.: 0.0038)
  MultiSource/Applications/hexxagon/hexxagon: 1.98% (1.0276 => 1.0479, std.dev.: 0.0049)
  MultiSource/Applications/obsequi/Obsequi: 1.81% (1.1551 => 1.1760, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.77% (7.6426 => 12.5165, std.dev.: 0.0482)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 42.38% (1.7197 => 2.4485, std.dev.: 0.2157)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 32.05% (1.1431 => 1.5095, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout/heapsort: 23.41% (3.5900 => 4.4303, std.dev.: 0.2888)
  SingleSource/Benchmarks/Shootout/ary3: 22.75% (4.6972 => 5.7658, std.dev.: 0.2006)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.41% (30.1838 => 34.5322, std.dev.: 0.6568)
  MultiSource/Applications/obsequi/Obsequi: 8.65% (2.1884 => 2.3776, std.dev.: 0.0192)
  SingleSource/UnitTests/Vector/multiplies: 7.79% (0.5561 => 0.5994, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout/hash: 6.60% (5.2009 => 5.5440, std.dev.: 0.0951)
  MultiSource/Benchmarks/sim/sim: 6.04% (3.8312 => 4.0627, std.dev.: 0.0686)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.43% (3.1730 => 3.3454, std.dev.: 0.0262)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.34% (1.2516 => 1.3184, std.dev.: 0.0169)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.32% (1.1013 => 1.1599, std.dev.: 0.0013)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.74% (2.5368 => 2.6570, std.dev.: 0.0423)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.23% (89.7126 => 92.6113, std.dev.: 0.2684)
  MultiSource/Applications/siod/siod: 2.03% (3.5310 => 3.6027, std.dev.: 0.0085)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.49% (8.1346 => 8.2556, std.dev.: 0.0115)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.42% (16.7972 => 17.0354, std.dev.: 0.0364)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.17% (2.4920 => 2.5211, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.63% (0.5226 => 0.2319, std.dev.: 0.0138)
  MultiSource/Applications/sgefa/sgefa: -41.85% (1.5790 => 0.9182, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.75% (0.0400 => 0.0273, std.dev.: 0.0042)
  SingleSource/Benchmarks/Linpack/linpack-pc: -19.99% (57.2347 => 45.7960, std.dev.: 3.2871)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.44% (50.0284 => 40.8018, std.dev.: 2.2823)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.72% (15.9508 => 13.4428, std.dev.: 0.2922)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.86% (20.8247 => 18.3544, std.dev.: 0.2065)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.40% (3.4956 => 3.1322, std.dev.: 0.0897)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.3304 => 0.2977, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.39% (2.5938 => 2.4800, std.dev.: 0.0242)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.60% (3.7437 => 3.6090, std.dev.: 0.0454)
  SingleSource/Benchmarks/Misc/oourafft: -3.17% (3.7484 => 3.6295, std.dev.: 0.0325)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.05% (1.1075 => 1.0737, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.86% (17.1431 => 16.6520, std.dev.: 0.0744)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.20% (4.3592 => 4.2631, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.97% (5.4473 => 5.3398, std.dev.: 0.0410)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.67% (0.1348 => 0.1357, std.dev.: 0.0276)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131021/1373b7d9/attachment.html>


More information about the llvm-testresults mailing list