[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 20 12:02:52 PST 2013


http://llvm.org/perf/db_default/v4/nts/18732?compare_to=18721&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18732, Order: 197820, Start Time: 2013-12-20 18:18:17, End Time: 2013-12-20 20:07:18
      To: 18721, Order: 197814, Start Time: 2013-12-20 16:08:40, End Time: 2013-12-20 17:51:08
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 60 (63 on baseline)
Performance Improvements: 8 (13 on baseline)
Unchanged Tests: 1042 (1034 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: 69.17% (0.0665 => 0.1125, std.dev.: 0.0020)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 67.47% (0.0747 => 0.1251, std.dev.: 0.0039)
  SingleSource/Benchmarks/Stanford/RealMM: 49.21% (0.0441 => 0.0658, std.dev.: 0.0031)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 42.14% (0.1343 => 0.1909, std.dev.: 0.0191)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 40.61% (0.1044 => 0.1468, std.dev.: 0.0148)
  SingleSource/Benchmarks/Shootout/methcall: 38.83% (0.0358 => 0.0497, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/bh/bh: 37.20% (0.3277 => 0.4496, std.dev.: 0.0083)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.99% (0.2601 => 0.3511, std.dev.: 0.0278)
  MultiSource/Benchmarks/Olden/em3d/em3d: 30.23% (0.2001 => 0.2606, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 29.76% (0.2611 => 0.3388, std.dev.: 0.0248)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 29.64% (0.9069 => 1.1757, std.dev.: 0.0831)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 27.83% (0.2630 => 0.3362, std.dev.: 0.0193)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.27% (7.3589 => 8.5565, std.dev.: 0.3226)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.36% (5.5177 => 6.3100, std.dev.: 0.1435)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.29% (0.6909 => 0.7896, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 12.26% (1.2883 => 1.4463, std.dev.: 0.0564)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.15% (1.2421 => 1.3558, std.dev.: 0.0263)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.48% (0.2854 => 0.3096, std.dev.: 0.0073)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.61% (2.7650 => 2.9754, std.dev.: 0.0119)
  MultiSource/Applications/kimwitu++/kc: 7.39% (18.5828 => 19.9566, std.dev.: 0.4467)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (4.2795 => 4.5732, std.dev.: 0.0427)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.41% (27.6000 => 29.3697, std.dev.: 0.1645)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (14.7485 => 15.4248, std.dev.: 0.2031)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.72% (1.2299 => 1.2756, std.dev.: 0.0074)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.46% (1.1016 => 1.1397, std.dev.: 0.0090)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.02% (0.8323 => 0.8574, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.56% (0.8219 => 0.8429, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.98% (1.3352 => 1.3617, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.64% (1.3230 => 1.3447, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.49% (1.2861 => 1.3053, std.dev.: 0.0037)
  MultiSource/Applications/Burg/burg: 1.08% (1.4332 => 1.4487, std.dev.: 0.0054)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 90.66% (0.1339 => 0.2553, std.dev.: 0.0167)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 59.53% (0.7707 => 1.2295, std.dev.: 0.0316)
  MultiSource/Benchmarks/Olden/bisort/bisort: 37.36% (0.6710 => 0.9217, std.dev.: 0.0185)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 30.63% (1.2536 => 1.6376, std.dev.: 0.0491)
  SingleSource/Benchmarks/Shootout/heapsort: 29.94% (2.8899 => 3.7550, std.dev.: 0.2633)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 26.25% (4.5988 => 5.8061, std.dev.: 0.1809)
  MultiSource/Benchmarks/FreeBench/mason/mason: 22.02% (0.2929 => 0.3574, std.dev.: 0.0132)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 21.59% (1.4610 => 1.7764, std.dev.: 0.0733)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.20% (2.3884 => 2.8470, std.dev.: 0.0430)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.80% (1.2927 => 1.4711, std.dev.: 0.0312)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.35% (2.1037 => 2.3845, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.46% (35.8019 => 39.5466, std.dev.: 0.9255)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.21% (0.3301 => 0.3605, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/ary3: 8.69% (4.7123 => 5.1218, std.dev.: 0.0968)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.66% (6.3478 => 6.8973, std.dev.: 0.2065)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.10% (59.7782 => 64.0216, std.dev.: 0.5406)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.88% (2.8588 => 3.0556, std.dev.: 0.0104)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 5.96% (3.8307 => 4.0589, std.dev.: 0.0767)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.92% (2.6688 => 2.8269, std.dev.: 0.0305)
  MultiSource/Benchmarks/Olden/tsp/tsp: 5.90% (1.5439 => 1.6350, std.dev.: 0.0084)
  MultiSource/Applications/aha/aha: 5.11% (3.5564 => 3.7380, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.89% (4.5737 => 4.7974, std.dev.: 0.0196)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.76% (2.2858 => 2.3945, std.dev.: 0.0278)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.15% (5.4777 => 5.6500, std.dev.: 0.0169)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.00% (3.9907 => 4.1103, std.dev.: 0.0415)
  SingleSource/Benchmarks/Dhrystone/dry: 2.74% (0.4812 => 0.4944, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/bh/bh: 2.63% (2.3885 => 2.4514, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.34% (7.0651 => 7.2305, std.dev.: 0.0556)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.07% (1.7571 => 1.7759, std.dev.: 0.0059)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.06% (1.1353 => 1.0211, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.90% (3.8462 => 3.5810, std.dev.: 0.1009)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.58% (0.4607 => 0.4350, std.dev.: 0.0040)
  MultiSource/Benchmarks/sim/sim: -5.14% (4.0133 => 3.8072, std.dev.: 0.0251)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -3.10% (2.5490 => 2.4699, std.dev.: 0.0091)
  MultiSource/Applications/JM/lencod/lencod: -2.07% (7.8983 => 7.7352, std.dev.: 0.0530)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.48% (3.8677 => 3.8105, std.dev.: 0.0005)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.11% (51.5385 => 50.9666, std.dev.: 0.1349)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/n-body: 66.58% (0.0751 => 0.1251, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/bisort/bisort: 56.69% (0.0718 => 0.1125, std.dev.: 0.0020)
  MultiSource/Applications/sqlite3/sqlite3: 46.46% (15.7419 => 23.0550, std.dev.: 0.5502)
  SingleSource/Benchmarks/Stanford/RealMM: 43.98% (0.0457 => 0.0658, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout/methcall: 39.61% (0.0356 => 0.0497, std.dev.: 0.0026)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 39.28% (0.1054 => 0.1468, std.dev.: 0.0148)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.04% (0.1393 => 0.1909, std.dev.: 0.0191)
  MultiSource/Benchmarks/Olden/bh/bh: 36.70% (0.3289 => 0.4496, std.dev.: 0.0083)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 29.07% (0.3859 => 0.4981, std.dev.: 0.0318)
  MultiSource/Benchmarks/Olden/em3d/em3d: 29.07% (0.2019 => 0.2606, std.dev.: 0.0017)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 28.89% (0.2724 => 0.3511, std.dev.: 0.0278)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.93% (0.2691 => 0.3362, std.dev.: 0.0193)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.58% (0.9437 => 1.1757, std.dev.: 0.0831)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.90% (7.5124 => 8.5565, std.dev.: 0.3226)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.83% (5.5433 => 6.3100, std.dev.: 0.1435)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.11% (25.9661 => 29.3697, std.dev.: 0.1645)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.88% (0.6995 => 0.7896, std.dev.: 0.0178)
  MultiSource/Applications/lemon/lemon: 11.27% (1.2200 => 1.3575, std.dev.: 0.0171)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.36% (0.2831 => 0.3096, std.dev.: 0.0073)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.91% (2.7572 => 2.9754, std.dev.: 0.0119)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.06% (4.2717 => 4.5732, std.dev.: 0.0427)
  MultiSource/Applications/kimwitu++/kc: 6.80% (18.6861 => 19.9566, std.dev.: 0.4467)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.46% (1.1016 => 1.1397, std.dev.: 0.0090)
  MultiSource/Applications/lua/lua: 3.12% (4.2737 => 4.4069, std.dev.: 0.0487)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.92% (0.8331 => 0.8574, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.49% (0.8224 => 0.8429, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.09% (1.2495 => 1.2756, std.dev.: 0.0074)
  MultiSource/Applications/Burg/burg: 1.56% (1.4265 => 1.4487, std.dev.: 0.0054)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 89.81% (0.1345 => 0.2553, std.dev.: 0.0167)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 60.30% (0.7670 => 1.2295, std.dev.: 0.0316)
  MultiSource/Benchmarks/Olden/bisort/bisort: 36.91% (0.6732 => 0.9217, std.dev.: 0.0185)
  SingleSource/Benchmarks/Shootout/heapsort: 27.32% (2.9492 => 3.7550, std.dev.: 0.2633)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 26.86% (4.5769 => 5.8061, std.dev.: 0.1809)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 20.71% (1.4716 => 1.7764, std.dev.: 0.0733)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.82% (1.2278 => 1.4711, std.dev.: 0.0312)
  MultiSource/Benchmarks/FreeBench/mason/mason: 19.53% (0.2990 => 0.3574, std.dev.: 0.0132)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.05% (5.9583 => 6.9744, std.dev.: 0.0743)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 14.24% (1.4335 => 1.6376, std.dev.: 0.0491)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.44% (2.1020 => 2.3845, std.dev.: 0.0057)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.39% (2.5559 => 2.8470, std.dev.: 0.0430)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.95% (35.9684 => 39.5466, std.dev.: 0.9255)
  SingleSource/Benchmarks/Shootout-C++/ary3: 9.45% (4.6797 => 5.1218, std.dev.: 0.0968)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.36% (0.3358 => 0.3605, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.96% (2.8568 => 3.0556, std.dev.: 0.0104)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.04% (2.6658 => 2.8269, std.dev.: 0.0305)
  MultiSource/Benchmarks/Olden/tsp/tsp: 6.00% (1.5425 => 1.6350, std.dev.: 0.0084)
  MultiSource/Applications/siod/siod: 5.36% (3.4258 => 3.6093, std.dev.: 0.0090)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.98% (40.5530 => 42.5718, std.dev.: 0.7823)
  MultiSource/Applications/aha/aha: 4.87% (3.5645 => 3.7380, std.dev.: 0.0196)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.82% (61.0792 => 64.0216, std.dev.: 0.5406)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.56% (4.5883 => 4.7974, std.dev.: 0.0196)
  MultiSource/Applications/lua/lua: 4.48% (29.1357 => 30.4410, std.dev.: 0.2630)
  SingleSource/Benchmarks/Dhrystone/dry: 3.71% (0.4767 => 0.4944, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.39% (3.9755 => 4.1103, std.dev.: 0.0415)
  MultiSource/Applications/sgefa/sgefa: 2.85% (0.8745 => 0.8994, std.dev.: 0.0079)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.74% (5.4994 => 5.6500, std.dev.: 0.0169)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.59% (1.5986 => 1.6400, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.56% (5.2486 => 5.3829, std.dev.: 0.0260)
  SingleSource/Benchmarks/Shootout/matrix: 2.23% (1.7960 => 1.8360, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.20% (5.9126 => 6.0429, std.dev.: 0.0331)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.01% (1.7409 => 1.7759, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.81% (11.7894 => 12.0032, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.13% (5.5032 => 5.5652, std.dev.: 0.0120)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.16% (0.0688 => 0.0508, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.85% (1.3127 => 1.2490, std.dev.: 0.0234)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.42% (1.4277 => 1.3646, std.dev.: 0.0205)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.99% (0.2758 => 0.2648, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.07% (1.3660 => 1.3240, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.54% (1.5305 => 1.4917, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.88% (1.3702 => 1.3445, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.07% (2.8850 => 2.4501, std.dev.: 0.1185)
  MultiSource/Benchmarks/sim/sim: -5.14% (4.0134 => 3.8072, std.dev.: 0.0251)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.89% (0.4526 => 0.4350, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.73% (0.3970 => 0.3822, std.dev.: 0.0053)
  MultiSource/Applications/JM/lencod/lencod: -2.64% (7.9450 => 7.7352, std.dev.: 0.0530)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.30% (2.5025 => 2.4699, std.dev.: 0.0091)

Report Time: 0.86s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131220/f1791665/attachment.html>


More information about the llvm-testresults mailing list