[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Oct 3 18:47:22 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15945?compare_to=15941&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15945, Order: 191932, Start Time: 2013-10-04 00:02:24, End Time: 2013-10-04 01:50:19
      To: 15941, Order: 191929, Start Time: 2013-10-03 21:55:20, End Time: 2013-10-03 23:39:34
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 64 (80 on baseline)
Performance Improvements: 2 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1041 (1014 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2009-12-07-StructReturn: 104.84% (0.0124 => 0.0254, std.dev.: 0.0004)
  SingleSource/UnitTests/2002-08-02-CastTest2: 102.83% (0.0106 => 0.0215, std.dev.: 0.0014)
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 95.31% (0.0128 => 0.0250, std.dev.: 0.0005)
  SingleSource/UnitTests/stmtexpr: 95.19% (0.0187 => 0.0365, std.dev.: 0.0016)
  SingleSource/UnitTests/2004-02-02-NegativeZero: 90.09% (0.0111 => 0.0211, std.dev.: 0.0005)
  SingleSource/UnitTests/2006-02-04-DivRem: 90.00% (0.0170 => 0.0323, std.dev.: 0.0008)
  SingleSource/UnitTests/2003-05-31-CastToBool: 89.45% (0.0256 => 0.0485, std.dev.: 0.0006)
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 88.24% (0.0204 => 0.0384, std.dev.: 0.0004)
  SingleSource/Regression/C/globalrefs: 88.14% (0.0194 => 0.0365, std.dev.: 0.0009)
  SingleSource/Regression/C/DuffsDevice: 88.05% (0.0251 => 0.0472, std.dev.: 0.0020)
  SingleSource/UnitTests/FloatPrecision: 87.97% (0.0158 => 0.0297, std.dev.: 0.0007)
  SingleSource/Regression/C/2003-05-22-VarSizeArray: 87.68% (0.0138 => 0.0259, std.dev.: 0.0026)
  SingleSource/UnitTests/TestLoop: 85.56% (0.0180 => 0.0334, std.dev.: 0.0014)
  SingleSource/UnitTests/2008-04-20-LoopBug2: 83.01% (0.0153 => 0.0280, std.dev.: 0.0024)
  SingleSource/UnitTests/2006-12-01-float_varg: 82.64% (0.0144 => 0.0263, std.dev.: 0.0006)
  SingleSource/UnitTests/AtomicOps: 82.13% (0.0207 => 0.0377, std.dev.: 0.0012)
  SingleSource/Regression/C/compare: 81.82% (0.0231 => 0.0420, std.dev.: 0.0024)
  SingleSource/UnitTests/2008-04-18-LoopBug: 81.46% (0.0151 => 0.0274, std.dev.: 0.0024)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 80.72% (0.0166 => 0.0300, std.dev.: 0.0008)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 78.16% (0.0206 => 0.0367, std.dev.: 0.0033)
  SingleSource/UnitTests/2005-11-29-LongSwitch: 77.42% (0.0155 => 0.0275, std.dev.: 0.0009)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 75.94% (0.0187 => 0.0329, std.dev.: 0.0018)
  SingleSource/Regression/C/test_indvars: 74.19% (0.0279 => 0.0486, std.dev.: 0.0024)
  SingleSource/UnitTests/2007-03-02-VaCopy: 74.10% (0.0166 => 0.0289, std.dev.: 0.0013)
  SingleSource/Regression/C++/EH/inlined_cleanup: 72.68% (0.0183 => 0.0316, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 72.22% (0.0162 => 0.0279, std.dev.: 0.0018)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 71.92% (0.0146 => 0.0251, std.dev.: 0.0007)
  SingleSource/UnitTests/vla: 71.58% (0.0461 => 0.0791, std.dev.: 0.0076)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 70.86% (0.0151 => 0.0258, std.dev.: 0.0023)
  SingleSource/Regression/C/PR491: 70.83% (0.0144 => 0.0246, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-04-22-Switch: 69.19% (0.0172 => 0.0291, std.dev.: 0.0024)
  SingleSource/UnitTests/2002-12-13-MishaTest: 68.00% (0.0200 => 0.0336, std.dev.: 0.0022)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 67.89% (0.0218 => 0.0366, std.dev.: 0.0025)
  SingleSource/UnitTests/2006-01-23-UnionInit: 66.06% (0.0274 => 0.0455, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/heapsort: 64.77% (0.0457 => 0.0753, std.dev.: 0.0027)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 64.13% (0.0421 => 0.0691, std.dev.: 0.0024)
  SingleSource/Regression/C++/pointer_method2: 63.49% (0.0252 => 0.0412, std.dev.: 0.0018)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 62.13% (0.0169 => 0.0274, std.dev.: 0.0015)
  SingleSource/Regression/C/bigstack: 57.46% (0.0637 => 0.1003, std.dev.: 0.0098)
  SingleSource/Regression/C/uint64_to_float: 55.40% (0.0417 => 0.0648, std.dev.: 0.0067)
  SingleSource/UnitTests/2002-05-03-NotTest: 54.31% (0.0197 => 0.0304, std.dev.: 0.0033)
  SingleSource/Regression/C++/fixups: 51.84% (0.0245 => 0.0372, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/oourafft: 24.95% (0.2321 => 0.2900, std.dev.: 0.0054)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 10.17% (0.1072 => 0.1181, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 8.13% (0.2067 => 0.2235, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.85% (4.1680 => 4.2866, std.dev.: 0.0248)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.97% (1.0050 => 1.0248, std.dev.: 0.0057)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.37% (2.5680 => 2.6031, std.dev.: 0.0121)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 64.86% (1.4528 => 2.3951, std.dev.: 0.0925)
  SingleSource/Benchmarks/Shootout/heapsort: 63.33% (2.9302 => 4.7860, std.dev.: 0.2208)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 43.95% (3.7206 => 5.3559, std.dev.: 0.1173)
  SingleSource/Benchmarks/Misc/pi: 41.84% (1.6485 => 2.3383, std.dev.: 0.1288)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 38.86% (0.1441 => 0.2001, std.dev.: 0.0170)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.93% (28.5741 => 32.5559, std.dev.: 1.0374)
  SingleSource/Regression/C/uint64_to_float: 4.59% (1.4093 => 1.4740, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.71% (5.7828 => 5.9973, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.27% (3.5272 => 3.6425, std.dev.: 0.0367)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (3.1333 => 3.2185, std.dev.: 0.0129)
  MultiSource/Applications/obsequi/Obsequi: 2.54% (2.2842 => 2.3422, std.dev.: 0.0122)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.25% (1.5878 => 1.6235, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.99% (11.8049 => 12.0400, std.dev.: 0.0240)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (4.1937 => 4.2755, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.58% (4.0502 => 4.1142, std.dev.: 0.0191)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.15% (35.0999 => 35.5040, std.dev.: 0.0279)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.52% (1.2514 => 1.2324, std.dev.: 0.0013)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.75% (23.8052 => 23.3887, std.dev.: 0.0171)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.30% (0.1345 => 0.1341, std.dev.: 0.0015)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 87.32% (0.0205 => 0.0384, std.dev.: 0.0004)
  SingleSource/UnitTests/2009-12-07-StructReturn: 86.76% (0.0136 => 0.0254, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 83.82% (0.0136 => 0.0250, std.dev.: 0.0005)
  SingleSource/UnitTests/stmtexpr: 82.50% (0.0200 => 0.0365, std.dev.: 0.0016)
  SingleSource/UnitTests/2003-05-31-CastToBool: 82.33% (0.0266 => 0.0485, std.dev.: 0.0006)
  SingleSource/UnitTests/AtomicOps: 82.13% (0.0207 => 0.0377, std.dev.: 0.0012)
  SingleSource/Regression/C/DuffsDevice: 80.84% (0.0261 => 0.0472, std.dev.: 0.0020)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 80.72% (0.0166 => 0.0300, std.dev.: 0.0008)
  SingleSource/UnitTests/2007-03-02-VaCopy: 80.62% (0.0160 => 0.0289, std.dev.: 0.0013)
  SingleSource/UnitTests/TestLoop: 79.57% (0.0186 => 0.0334, std.dev.: 0.0014)
  SingleSource/UnitTests/2006-02-04-DivRem: 77.47% (0.0182 => 0.0323, std.dev.: 0.0008)
  SingleSource/Regression/C/globalrefs: 77.18% (0.0206 => 0.0365, std.dev.: 0.0009)
  SingleSource/UnitTests/FloatPrecision: 76.79% (0.0168 => 0.0297, std.dev.: 0.0007)
  SingleSource/UnitTests/2006-12-01-float_varg: 75.33% (0.0150 => 0.0263, std.dev.: 0.0006)
  SingleSource/UnitTests/2008-04-20-LoopBug2: 73.91% (0.0161 => 0.0280, std.dev.: 0.0024)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 73.29% (0.0161 => 0.0279, std.dev.: 0.0018)
  SingleSource/UnitTests/vla: 71.96% (0.0460 => 0.0791, std.dev.: 0.0076)
  SingleSource/Regression/C/compare: 71.43% (0.0245 => 0.0420, std.dev.: 0.0024)
  SingleSource/UnitTests/2002-12-13-MishaTest: 69.70% (0.0198 => 0.0336, std.dev.: 0.0022)
  SingleSource/UnitTests/2005-11-29-LongSwitch: 67.68% (0.0164 => 0.0275, std.dev.: 0.0009)
  SingleSource/Regression/C++/EH/inlined_cleanup: 67.20% (0.0189 => 0.0316, std.dev.: 0.0011)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 67.12% (0.0219 => 0.0366, std.dev.: 0.0025)
  SingleSource/UnitTests/2006-01-23-UnionInit: 66.67% (0.0273 => 0.0455, std.dev.: 0.0016)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 65.64% (0.0163 => 0.0270, std.dev.: 0.0027)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 65.38% (0.0156 => 0.0258, std.dev.: 0.0023)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 65.33% (0.0199 => 0.0329, std.dev.: 0.0018)
  SingleSource/UnitTests/2008-04-18-LoopBug: 65.06% (0.0166 => 0.0274, std.dev.: 0.0024)
  SingleSource/Regression/C/2003-05-22-VarSizeArray: 64.97% (0.0157 => 0.0259, std.dev.: 0.0026)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 64.52% (0.0420 => 0.0691, std.dev.: 0.0024)
  SingleSource/Regression/C/bigstack: 63.09% (0.0615 => 0.1003, std.dev.: 0.0098)
  SingleSource/UnitTests/2003-04-22-Switch: 59.02% (0.0183 => 0.0291, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/heapsort: 58.86% (0.0474 => 0.0753, std.dev.: 0.0027)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 58.38% (0.0173 => 0.0274, std.dev.: 0.0015)
  SingleSource/Regression/C/uint64_to_float: 58.05% (0.0410 => 0.0648, std.dev.: 0.0067)
  SingleSource/Regression/C/test_indvars: 56.77% (0.0310 => 0.0486, std.dev.: 0.0024)
  SingleSource/Regression/C++/pointer_method2: 56.06% (0.0264 => 0.0412, std.dev.: 0.0018)
  SingleSource/UnitTests/2002-05-03-NotTest: 55.90% (0.0195 => 0.0304, std.dev.: 0.0033)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 47.98% (0.0248 => 0.0367, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/oourafft: 26.42% (0.2294 => 0.2900, std.dev.: 0.0054)
  SingleSource/Benchmarks/Linpack/linpack-pc: 15.29% (0.2949 => 0.3400, std.dev.: 0.0111)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.11% (4.0397 => 4.2866, std.dev.: 0.0248)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.28% (0.2123 => 0.2235, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/football/football: 4.27% (0.9828 => 1.0248, std.dev.: 0.0057)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.5185 => 0.5330, std.dev.: 0.0024)
  MultiSource/Applications/SPASS/SPASS: 2.63% (16.1646 => 16.5895, std.dev.: 0.0630)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.58% (1.5333 => 1.5729, std.dev.: 0.0052)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.45% (1.2728 => 1.3040, std.dev.: 0.0077)
  MultiSource/Applications/oggenc/oggenc: 2.21% (5.3339 => 5.4520, std.dev.: 0.0153)
  MultiSource/Applications/ClamAV/clamscan: 2.01% (16.5398 => 16.8728, std.dev.: 0.0696)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.97% (1.2086 => 1.2324, std.dev.: 0.0013)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.86% (1.0935 => 1.1138, std.dev.: 0.0006)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.42% (2.5666 => 2.6031, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.09% (1.3042 => 1.3184, std.dev.: 0.0037)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.48% (7.6426 => 12.4943, std.dev.: 0.0755)
  SingleSource/Benchmarks/Misc/pi: 41.08% (1.6574 => 2.3383, std.dev.: 0.1288)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 39.27% (1.7197 => 2.3951, std.dev.: 0.0925)
  SingleSource/Benchmarks/Shootout/heapsort: 33.31% (3.5900 => 4.7860, std.dev.: 0.2208)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 30.62% (4.1004 => 5.3559, std.dev.: 0.1173)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.49% (1.1013 => 1.2168, std.dev.: 0.0066)
  MultiSource/Applications/obsequi/Obsequi: 7.03% (2.1884 => 2.3422, std.dev.: 0.0122)
  MultiSource/Benchmarks/sim/sim: 6.35% (3.8312 => 4.0743, std.dev.: 0.0110)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.28% (8.1346 => 8.6457, std.dev.: 0.0425)
  MultiSource/Applications/spiff/spiff: 5.61% (2.8194 => 2.9776, std.dev.: 0.0119)
  SingleSource/UnitTests/Vector/multiplies: 5.57% (0.5561 => 0.5871, std.dev.: 0.0075)
  SingleSource/Benchmarks/McGill/misr: 5.20% (0.3771 => 0.3967, std.dev.: 0.0069)
  MultiSource/Applications/hexxagon/hexxagon: 4.81% (14.7810 => 15.4919, std.dev.: 0.1304)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.84% (5.7757 => 5.9973, std.dev.: 0.0056)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.27% (5.3716 => 5.5470, std.dev.: 0.0477)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.66% (1.7652 => 1.8122, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.41% (5.4925 => 5.6246, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.39% (4.0181 => 4.1142, std.dev.: 0.0191)
  MultiSource/Benchmarks/Olden/power/power: 2.38% (1.2170 => 1.2460, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.33% (11.7654 => 12.0400, std.dev.: 0.0240)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.85% (1.5940 => 1.6235, std.dev.: 0.0058)
  MultiSource/Applications/lua/lua: 1.83% (29.5202 => 30.0612, std.dev.: 0.0120)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (2.4920 => 2.5351, std.dev.: 0.0038)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.57% (1.8519 => 1.8810, std.dev.: 0.0094)
  SingleSource/Regression/C/uint64_to_float: 1.46% (1.4528 => 1.4740, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.33% (1.0477 => 1.0616, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/methcall: 1.26% (8.5434 => 8.6514, std.dev.: 0.0108)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.86% (0.5226 => 0.2359, std.dev.: 0.0023)
  MultiSource/Applications/sgefa/sgefa: -47.11% (1.5790 => 0.8352, std.dev.: 0.0026)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.22% (15.9508 => 12.8858, std.dev.: 0.4601)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.36% (20.8247 => 18.4581, std.dev.: 0.2366)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.20% (0.3304 => 0.2934, std.dev.: 0.0046)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.93% (3.4956 => 3.2185, std.dev.: 0.0129)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.58% (50.0284 => 46.2358, std.dev.: 0.1456)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (2.5938 => 2.4932, std.dev.: 0.0239)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.69% (0.6563 => 0.6321, std.dev.: 0.0092)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.16% (3.7437 => 3.6254, std.dev.: 0.0155)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.81% (2.4471 => 2.3784, std.dev.: 0.0228)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.92% (4.3592 => 4.2755, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.79% (17.1431 => 16.8354, std.dev.: 0.0894)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.52% (0.1348 => 0.1341, std.dev.: 0.0015)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131003/89237d4e/attachment.html>


More information about the llvm-testresults mailing list