[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 23 12:44:26 PST 2013


http://llvm.org/perf/db_default/v4/nts/18899?compare_to=18889&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18899, Order: 197915, Start Time: 2013-12-23 19:07:08, End Time: 2013-12-23 20:48:54
      To: 18889, Order: 197911, Start Time: 2013-12-23 17:00:11, End Time: 2013-12-23 18:44:46
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 30 (43 on baseline)
Performance Improvements: 35 (35 on baseline)
Unchanged Tests: 1045 (1032 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.63% (1.3167 => 1.3381, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.61% (1.3191 => 1.3403, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.56% (1.2743 => 1.2942, std.dev.: 0.0074)
  MultiSource/Applications/siod/siod: 1.28% (2.5534 => 2.5860, std.dev.: 0.0124)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 58.20% (1.6477 => 2.6066, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.60% (0.1646 => 0.1985, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/matrix: 15.73% (1.8209 => 2.1073, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.27% (6.5672 => 7.4386, std.dev.: 0.1171)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.56% (4.5142 => 4.9911, std.dev.: 0.1274)
  SingleSource/Benchmarks/McGill/misr: 10.43% (0.3757 => 0.4149, std.dev.: 0.0004)
  MultiSource/Applications/JM/lencod/lencod: 8.80% (7.8529 => 8.5438, std.dev.: 0.0089)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.83% (1.1079 => 1.1946, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.73% (0.3559 => 0.3763, std.dev.: 0.0029)
  MultiSource/Applications/SPASS/SPASS: 5.32% (8.0581 => 8.4864, std.dev.: 0.1133)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.03% (0.6941 => 0.7290, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/fp-convert: 4.01% (7.5560 => 7.8587, std.dev.: 0.0132)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (4.2572 => 4.4034, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.11% (1.2455 => 1.2842, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout/lists: 2.73% (7.1437 => 7.3390, std.dev.: 0.0662)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.30% (3.7486 => 3.8349, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.90% (3.5924 => 3.6607, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.74% (1.6167 => 1.6448, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout/fib2: 1.72% (3.5928 => 3.6546, std.dev.: 0.0080)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.69% (2.4957 => 2.5379, std.dev.: 0.0010)
  MultiSource/Applications/sgefa/sgefa: 1.66% (0.8918 => 0.9066, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.64% (15.8378 => 16.0974, std.dev.: 0.0259)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.63% (6.0052 => 6.1032, std.dev.: 0.0083)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.29% (6.7565 => 6.8438, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.18% (7.1419 => 7.2264, std.dev.: 0.0208)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.11% (8.8324 => 8.9303, std.dev.: 0.0140)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/PR1386: -43.98% (0.0266 => 0.0149, std.dev.: 0.0006)
  SingleSource/Regression/C/test_indvars: -42.98% (0.0484 => 0.0276, std.dev.: 0.0007)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: -42.72% (0.0309 => 0.0177, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/flops-8: -38.09% (0.0512 => 0.0317, std.dev.: 0.0001)
  SingleSource/Regression/C/PR10189: -35.90% (0.0390 => 0.0250, std.dev.: 0.0024)
  SingleSource/Regression/C/PR640: -34.31% (0.0341 => 0.0224, std.dev.: 0.0004)
  SingleSource/Regression/C/compare: -31.61% (0.0329 => 0.0225, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/flops-2: -26.73% (0.0419 => 0.0307, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.28% (5.8919 => 5.4042, std.dev.: 0.0179)
  SingleSource/UnitTests/Vector/constpool: -6.23% (9.8023 => 9.1915, std.dev.: 0.2359)
  MultiSource/Applications/kimwitu++/kc: -5.34% (19.5194 => 18.4772, std.dev.: 0.3838)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -5.15% (0.2232 => 0.2117, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/oourafft: -5.04% (0.2639 => 0.2506, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/matrix: -4.53% (0.2473 => 0.2361, std.dev.: 0.0006)
  MultiSource/Applications/hexxagon/hexxagon: -4.24% (1.0859 => 1.0399, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/moments: -2.84% (0.3909 => 0.3798, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc-C++/bigfib: -2.78% (0.6842 => 0.6652, std.dev.: 0.0010)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.48% (0.5209 => 0.5080, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.54% (0.9043 => 0.8904, std.dev.: 0.0003)
  MultiSource/Applications/JM/ldecod/ldecod: -1.51% (7.6647 => 7.5487, std.dev.: 0.0130)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -31.05% (2.1298 => 1.4684, std.dev.: 0.0391)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -20.13% (5.7156 => 4.5652, std.dev.: 0.0097)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -16.71% (4.8400 => 4.0310, std.dev.: 0.0801)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -15.38% (3.3485 => 2.8336, std.dev.: 0.0538)
  SingleSource/Benchmarks/Dhrystone/dry: -11.06% (0.5469 => 0.4864, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/ary3: -9.98% (5.2995 => 4.7705, std.dev.: 0.0644)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.70% (29.7120 => 28.6132, std.dev.: 0.4177)
  SingleSource/Benchmarks/Shootout-C++/lists1: -3.61% (0.6061 => 0.5842, std.dev.: 0.0008)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.66% (2.5260 => 2.4589, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout-C++/fibo: -2.58% (5.1355 => 5.0032, std.dev.: 0.0172)
  SingleSource/Regression/C/uint64_to_float: -2.49% (1.5050 => 1.4676, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.44% (4.1057 => 4.0465, std.dev.: 0.0084)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.29% (4.8928 => 4.8299, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.28% (12.1418 => 11.9865, std.dev.: 0.0394)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -1.08% (2.3499 => 2.3246, std.dev.: 0.0090)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 39.37% (15.7419 => 21.9402, std.dev.: 0.0818)
  MultiSource/Applications/lemon/lemon: 9.25% (1.2200 => 1.3329, std.dev.: 0.0014)
  MultiSource/Benchmarks/McCat/08-main/main: 5.09% (0.3007 => 0.3160, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.6412 => 0.6652, std.dev.: 0.0010)
  MultiSource/Applications/oggenc/oggenc: 2.47% (5.4968 => 5.6325, std.dev.: 0.0299)
  MultiSource/Applications/siod/siod: 1.45% (2.5491 => 2.5860, std.dev.: 0.0124)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.33% (0.8787 => 0.8904, std.dev.: 0.0003)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.22% (1.6685 => 2.6066, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/matrix: 17.33% (1.7960 => 2.1073, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.05% (5.9583 => 6.9149, std.dev.: 0.1304)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 15.85% (6.4210 => 7.4386, std.dev.: 0.1171)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 12.14% (4.4509 => 4.9911, std.dev.: 0.1274)
  SingleSource/Benchmarks/Stanford/Puzzle: 11.09% (0.1668 => 0.1853, std.dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.41% (1.1019 => 1.1946, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.21% (3.3810 => 3.6586, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.87% (3.5771 => 3.8586, std.dev.: 0.0075)
  MultiSource/Applications/JM/lencod/lencod: 7.54% (7.9450 => 8.5438, std.dev.: 0.0089)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 6.48% (0.3534 => 0.3763, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/fp-convert: 6.35% (7.3892 => 7.8587, std.dev.: 0.0132)
  MultiSource/Applications/siod/siod: 5.47% (3.4258 => 3.6132, std.dev.: 0.0046)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.43% (1.2278 => 1.2945, std.dev.: 0.0187)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.24% (4.1840 => 4.4034, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 5.22% (3.8883 => 4.0911, std.dev.: 0.0433)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.06% (0.6939 => 0.7290, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/lists: 4.95% (6.9930 => 7.3390, std.dev.: 0.0662)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.27% (3.4043 => 3.5496, std.dev.: 0.0081)
  MultiSource/Applications/sgefa/sgefa: 3.67% (0.8745 => 0.9066, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.46% (5.7952 => 5.9957, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.22% (5.9126 => 6.1032, std.dev.: 0.0083)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.04% (1.2463 => 1.2842, std.dev.: 0.0047)
  SingleSource/Benchmarks/McGill/misr: 2.98% (0.4029 => 0.4149, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.89% (1.5986 => 1.6448, std.dev.: 0.0014)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.77% (3.7315 => 3.8349, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.66% (15.6810 => 16.0974, std.dev.: 0.0259)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.31% (6.5291 => 6.6797, std.dev.: 0.0530)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.95% (2.4894 => 2.5379, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.67% (11.7894 => 11.9865, std.dev.: 0.0394)
  SingleSource/Benchmarks/Shootout/fib2: 1.63% (3.5960 => 3.6546, std.dev.: 0.0080)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.40% (8.8073 => 8.9303, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.16% (3.5451 => 3.5862, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.10% (4.9365 => 4.9908, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.09% (5.3463 => 5.4044, std.dev.: 0.0019)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.01% (6.7756 => 6.8438, std.dev.: 0.0036)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.60% (0.0688 => 0.0505, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.01% (5.8749 => 5.4042, std.dev.: 0.0179)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.83% (0.6882 => 0.6343, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -7.25% (1.3676 => 1.2684, std.dev.: 0.0357)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.37% (0.2824 => 0.2644, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.72% (1.4277 => 1.3460, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.26% (1.3146 => 1.2454, std.dev.: 0.0189)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.60% (0.3714 => 0.3543, std.dev.: 0.0040)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.52% (1.4449 => 1.3796, std.dev.: 0.0233)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.17% (1.3505 => 1.2942, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.38% (1.2914 => 1.2478, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.27% (1.3608 => 1.3163, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.12% (1.2544 => 1.2153, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.90% (1.2724 => 1.2355, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.90% (1.3460 => 1.3070, std.dev.: 0.0098)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.80% (1.1767 => 1.1438, std.dev.: 0.0085)
  MultiSource/Applications/d/make_dparser: -2.60% (3.6428 => 3.5481, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.60% (1.3024 => 1.2686, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.50% (1.2785 => 1.2466, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.32% (1.3182 => 1.2876, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.20% (1.4074 => 1.3765, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.18% (1.3702 => 1.3403, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.67% (1.3457 => 1.3232, std.dev.: 0.0044)
  MultiSource/Applications/JM/ldecod/ldecod: -1.40% (7.6560 => 7.5487, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.25% (1.3551 => 1.3381, std.dev.: 0.0034)
  MultiSource/Applications/hexxagon/hexxagon: -1.13% (1.0518 => 1.0399, std.dev.: 0.0032)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.60% (1.4335 => 1.3102, std.dev.: 0.0404)
  MultiSource/Benchmarks/Bullet/bullet: -6.30% (7.4226 => 6.9547, std.dev.: 0.1808)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (2.9945 => 2.8336, std.dev.: 0.0538)
  MultiSource/Applications/lemon/lemon: -3.79% (0.8632 => 0.8305, std.dev.: 0.0113)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.42% (2.5200 => 2.4589, std.dev.: 0.0090)
  MultiSource/Applications/sqlite3/sqlite3: -2.21% (4.2978 => 4.2030, std.dev.: 0.0074)
  SingleSource/Benchmarks/Misc/salsa20: -1.44% (7.5947 => 7.4853, std.dev.: 0.0091)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.41% (3.6583 => 3.6066, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.10% (4.1462 => 4.1005, std.dev.: 0.0049)

Report Time: 1.18s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131223/33b2ef08/attachment.html>


More information about the llvm-testresults mailing list