[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Oct 31 10:06:23 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16872?compare_to=16868&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16872, Order: 193750, Start Time: 2013-10-31 15:15:37, End Time: 2013-10-31 17:09:51
      To: 16868, Order: 193742, Start Time: 2013-10-31 12:51:51, End Time: 2013-10-31 14:48:47
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 29 (46 on baseline)
Performance Improvements: 37 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1041 (1045 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/PR491: 95.57% (0.0158 => 0.0309, std.dev.: 0.0006)
  SingleSource/Regression/C++/2003-05-14-array-init: 92.80% (0.0125 => 0.0241, std.dev.: 0.0045)
  SingleSource/Regression/C++/pointer_member: 86.11% (0.0180 => 0.0335, std.dev.: 0.0010)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 81.39% (0.0231 => 0.0419, std.dev.: 0.0015)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 76.92% (0.0273 => 0.0483, std.dev.: 0.0014)
  SingleSource/Regression/C/matrixTranspose: 75.17% (0.0290 => 0.0508, std.dev.: 0.0030)
  SingleSource/Regression/C/testtrace: 75.00% (0.0264 => 0.0462, std.dev.: 0.0026)
  SingleSource/Regression/C/uint64_to_float: 74.63% (0.0410 => 0.0716, std.dev.: 0.0031)
  SingleSource/Regression/C++/pointer_method: 74.54% (0.0216 => 0.0377, std.dev.: 0.0010)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 66.52% (0.0224 => 0.0373, std.dev.: 0.0015)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 60.57% (0.0771 => 0.1238, std.dev.: 0.0032)
  SingleSource/UnitTests/2003-08-11-VaListArg: 59.29% (0.0312 => 0.0497, std.dev.: 0.0036)
  SingleSource/Regression/C/2004-03-15-IndirectGoto: 58.89% (0.0180 => 0.0286, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/mandel: 52.19% (0.0525 => 0.0799, std.dev.: 0.0045)
  SingleSource/Regression/C/sumarray: 27.29% (0.0436 => 0.0555, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.50% (6.4211 => 7.4806, std.dev.: 0.3726)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 14.60% (0.1123 => 0.1287, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/lists: 13.51% (0.2649 => 0.3007, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.78% (0.1298 => 0.1412, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/moments: 10.23% (0.1095 => 0.1207, std.dev.: 0.0023)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.45% (1.3896 => 1.5070, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.35% (6.1867 => 6.6417, std.dev.: 0.1384)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.99% (3.5451 => 3.7221, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.36% (4.1202 => 4.2998, std.dev.: 0.0454)
  MultiSource/Benchmarks/sim/sim: 3.38% (3.8507 => 3.9810, std.dev.: 0.0457)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.03% (4.0364 => 4.1184, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.98% (5.5161 => 5.6255, std.dev.: 0.0194)
  SingleSource/Benchmarks/Misc/oourafft: 1.36% (3.6577 => 3.7075, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.11% (5.3457 => 5.4051, std.dev.: 0.0214)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/obsequi/Obsequi: -35.75% (1.8192 => 1.1688, std.dev.: 0.1842)
  SingleSource/Benchmarks/Misc/salsa20: -32.79% (0.0802 => 0.0539, std.dev.: 0.0023)
  MultiSource/Applications/hbd/hbd: -30.59% (2.2947 => 1.5928, std.dev.: 0.0881)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -29.79% (1.6540 => 1.1612, std.dev.: 0.0411)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -26.27% (1.5804 => 1.1652, std.dev.: 0.0382)
  MultiSource/Applications/lua/lua: -25.66% (5.8713 => 4.3649, std.dev.: 0.0524)
  SingleSource/Benchmarks/Shootout-C++/lists1: -18.81% (0.3855 => 0.3130, std.dev.: 0.0235)
  SingleSource/Benchmarks/Shootout-C++/methcall: -17.86% (0.2503 => 0.2056, std.dev.: 0.0144)
  MultiSource/Applications/kimwitu++/kc: -16.00% (22.9591 => 19.2855, std.dev.: 1.0953)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -15.41% (1.5818 => 1.3380, std.dev.: 0.0513)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -14.19% (1.5711 => 1.3482, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -13.95% (1.4882 => 1.2806, std.dev.: 0.0713)
  MultiSource/Applications/minisat/minisat: -13.72% (0.8791 => 0.7585, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -13.66% (1.4079 => 1.2156, std.dev.: 0.0553)
  MultiSource/Applications/hexxagon/hexxagon: -13.50% (1.2046 => 1.0420, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -13.42% (1.7112 => 1.4815, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -12.77% (1.4634 => 1.2765, std.dev.: 0.0313)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -12.42% (1.4068 => 1.2321, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.34% (1.4388 => 1.2612, std.dev.: 0.0083)
  MultiSource/Benchmarks/Bullet/bullet: -11.29% (38.2248 => 33.9078, std.dev.: 1.4424)
  MultiSource/Applications/ClamAV/clamscan: -10.54% (18.6998 => 16.7280, std.dev.: 0.2220)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.23% (1.3430 => 1.2191, std.dev.: 0.0191)
  MultiSource/Applications/sqlite3/sqlite3: -9.13% (18.0252 => 16.3799, std.dev.: 0.5967)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.51% (1.3171 => 1.2182, std.dev.: 0.0132)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: -47.80% (0.0387 => 0.0202, std.dev.: 0.0054)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -35.22% (0.0335 => 0.0217, std.dev.: 0.0001)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -35.03% (0.0825 => 0.0536, std.dev.: 0.0072)
  MultiSource/Applications/minisat/minisat: -33.00% (9.5155 => 6.3753, std.dev.: 0.4399)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -26.69% (3.3921 => 2.4868, std.dev.: 0.3317)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -20.70% (0.4247 => 0.3368, std.dev.: 0.0217)
  SingleSource/Benchmarks/Stanford/Treesort: -18.39% (0.0794 => 0.0648, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/health/health: -12.18% (0.3833 => 0.3366, std.dev.: 0.0172)
  SingleSource/Benchmarks/Dhrystone/fldry: -7.56% (0.7301 => 0.6749, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.79% (5.9219 => 5.6976, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.35% (3.6830 => 3.5595, std.dev.: 0.0366)
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.04% (46.6076 => 45.1929, std.dev.: 0.5243)
  SingleSource/Benchmarks/Misc/flops-1: -1.55% (2.3173 => 2.2814, std.dev.: 0.0038)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -11.05% (0.1557 => 0.1385, std.dev.: 0.0024)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2005-05-06-LongLongSignedShift: 171.43% (0.0063 => 0.0171, std.dev.: 0.0018)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 103.80% (0.0237 => 0.0483, std.dev.: 0.0014)
  SingleSource/Regression/C/PR491: 99.35% (0.0155 => 0.0309, std.dev.: 0.0006)
  SingleSource/Regression/C++/pointer_method: 95.34% (0.0193 => 0.0377, std.dev.: 0.0010)
  SingleSource/Regression/C++/pointer_member: 93.64% (0.0173 => 0.0335, std.dev.: 0.0010)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 91.32% (0.0219 => 0.0419, std.dev.: 0.0015)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 84.65% (0.0202 => 0.0373, std.dev.: 0.0015)
  SingleSource/Regression/C/testtrace: 84.06% (0.0251 => 0.0462, std.dev.: 0.0026)
  SingleSource/Regression/C/matrixTranspose: 84.06% (0.0276 => 0.0508, std.dev.: 0.0030)
  SingleSource/Regression/C/sumarray: 82.57% (0.0304 => 0.0555, std.dev.: 0.0016)
  SingleSource/Regression/C/2004-03-15-IndirectGoto: 77.64% (0.0161 => 0.0286, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/mandel: 75.99% (0.0454 => 0.0799, std.dev.: 0.0045)
  SingleSource/Regression/C/uint64_to_float: 74.63% (0.0410 => 0.0716, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 67.98% (0.0737 => 0.1238, std.dev.: 0.0032)
  SingleSource/UnitTests/2003-08-11-VaListArg: 67.34% (0.0297 => 0.0497, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 24.09% (6.0284 => 7.4806, std.dev.: 0.3726)
  SingleSource/Benchmarks/Misc/oourafft: 16.70% (0.2294 => 0.2677, std.dev.: 0.0095)
  SingleSource/Benchmarks/Shootout-C++/lists: 16.69% (0.2577 => 0.3007, std.dev.: 0.0045)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 16.37% (0.1106 => 0.1287, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.63% (0.2069 => 0.2351, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 12.60% (0.1254 => 0.1412, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/Altivec/test1: 9.00% (0.1222 => 0.1332, std.dev.: 0.0027)
  MultiSource/Applications/lua/lua: 3.33% (4.2242 => 4.3649, std.dev.: 0.0524)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.18% (1.0756 => 1.0991, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.94% (1.2086 => 1.2321, std.dev.: 0.0052)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.75% (7.6426 => 12.2853, std.dev.: 0.0481)
  SingleSource/Benchmarks/Shootout-C++/matrix: 45.85% (2.8554 => 4.1645, std.dev.: 0.0629)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 37.49% (4.5479 => 6.2529, std.dev.: 0.5595)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 31.83% (1.1431 => 1.5070, std.dev.: 0.0007)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.34% (2.1111 => 2.3716, std.dev.: 0.0752)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 9.17% (2.3365 => 2.5508, std.dev.: 0.0511)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.72% (6.1088 => 6.6417, std.dev.: 0.1384)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.88% (3.9856 => 4.2998, std.dev.: 0.0454)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.81% (3.5550 => 3.7614, std.dev.: 0.0505)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.55% (3.1730 => 3.3490, std.dev.: 0.0482)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.43% (3.5642 => 3.7221, std.dev.: 0.0007)
  MultiSource/Benchmarks/sim/sim: 3.91% (3.8312 => 3.9810, std.dev.: 0.0457)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.21% (89.7126 => 92.5920, std.dev.: 0.5703)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.62% (0.6563 => 0.6735, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.57% (5.7757 => 5.9240, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.50% (4.0181 => 4.1184, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.42% (5.4925 => 5.6255, std.dev.: 0.0194)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (1.7652 => 1.8062, std.dev.: 0.0085)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.12% (1.0477 => 1.0699, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (5.3022 => 5.4051, std.dev.: 0.0214)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: -12.56% (0.1194 => 0.1044, std.dev.: 0.0011)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.59% (0.5226 => 0.2321, std.dev.: 0.0069)
  MultiSource/Applications/sgefa/sgefa: -43.03% (1.5790 => 0.8995, std.dev.: 0.0066)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.69% (15.9508 => 12.9694, std.dev.: 0.4897)
  SingleSource/Benchmarks/Linpack/linpack-pc: -18.25% (57.2347 => 46.7901, std.dev.: 2.8874)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.04% (0.3304 => 0.2708, std.dev.: 0.0053)
  MultiSource/Applications/SIBsim4/SIBsim4: -11.99% (3.7437 => 3.2947, std.dev.: 0.0830)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.21% (20.8247 => 18.4894, std.dev.: 0.1243)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.67% (50.0284 => 45.1929, std.dev.: 0.5243)
  SingleSource/Benchmarks/Shootout/sieve: -6.75% (7.2254 => 6.7376, std.dev.: 0.0304)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.10% (8.1346 => 7.6380, std.dev.: 0.0587)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (2.5938 => 2.4926, std.dev.: 0.0203)
  MultiSource/Benchmarks/Olden/power/power: -2.67% (1.2170 => 1.1845, std.dev.: 0.0115)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.59% (4.3592 => 4.2461, std.dev.: 0.0271)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.09% (17.1431 => 16.7845, std.dev.: 0.0076)
  SingleSource/Benchmarks/Misc/oourafft: -1.09% (3.7484 => 3.7075, std.dev.: 0.0136)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.74% (0.1348 => 0.1385, std.dev.: 0.0024)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131031/34412b2b/attachment.html>


More information about the llvm-testresults mailing list