[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 21 17:18:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16549?compare_to=16545&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16549, Order: 193120, Start Time: 2013-10-21 22:26:49, End Time: 2013-10-22 00:21:32
      To: 16545, Order: 193107, Start Time: 2013-10-21 20:14:42, End Time: 2013-10-21 22:05:38
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 33 (47 on baseline)
Performance Improvements: 12 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1062 (1045 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 57.81% (0.1012 => 0.1597, std.dev.: 0.0124)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 50.63% (0.0792 => 0.1193, std.dev.: 0.0146)
  MultiSource/Benchmarks/Olden/em3d/em3d: 30.37% (0.2038 => 0.2657, std.dev.: 0.0159)
  MultiSource/Applications/obsequi/Obsequi: 29.77% (1.1760 => 1.5261, std.dev.: 0.1078)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.81% (1.3652 => 1.6083, std.dev.: 0.0707)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.09% (1.3099 => 1.4945, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.50% (1.2337 => 1.4003, std.dev.: 0.0266)
  MultiSource/Applications/aha/aha: 12.60% (0.1310 => 0.1475, std.dev.: 0.0029)
  MultiSource/Applications/JM/ldecod/ldecod: 11.94% (7.7644 => 8.6913, std.dev.: 0.2445)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.63% (1.2387 => 1.3827, std.dev.: 0.0282)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.33% (1.2755 => 1.4200, std.dev.: 0.0297)
  MultiSource/Applications/kimwitu++/kc: 9.66% (19.0136 => 20.8505, std.dev.: 0.3522)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.61% (1.2184 => 1.3355, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.63% (1.2252 => 1.3309, std.dev.: 0.0297)
  MultiSource/Applications/JM/lencod/lencod: 8.42% (17.6577 => 19.1443, std.dev.: 0.3441)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.77% (1.2348 => 1.3308, std.dev.: 0.0294)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.2862 => 0.3062, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.37% (1.2393 => 1.3182, std.dev.: 0.0177)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 108.19% (0.1379 => 0.2871, std.dev.: 0.0211)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 30.71% (1.3762 => 1.7988, std.dev.: 0.0898)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.48% (2.6644 => 3.1834, std.dev.: 0.1519)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.20% (1.3063 => 1.5571, std.dev.: 0.0810)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.00% (96.4760 => 104.1923, std.dev.: 0.9147)
  SingleSource/Benchmarks/Misc/salsa20: 6.14% (7.5336 => 7.9962, std.dev.: 0.1000)
  SingleSource/Benchmarks/McGill/misr: 6.12% (0.3873 => 0.4110, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 6.09% (1.5043 => 1.5959, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.00% (4.1018 => 4.3480, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.20% (4.5748 => 4.8126, std.dev.: 0.0776)
  MultiSource/Applications/lua/lua: 3.01% (29.1015 => 29.9780, std.dev.: 0.1641)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.65% (5.5480 => 5.6951, std.dev.: 0.0328)
  MultiSource/Applications/sqlite3/sqlite3: 2.06% (4.3426 => 4.4321, std.dev.: 0.0143)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.91% (4.8525 => 4.9450, std.dev.: 0.0246)
  SingleSource/Benchmarks/Shootout/methcall: 1.33% (8.5053 => 8.6181, std.dev.: 0.0092)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: -44.26% (0.0296 => 0.0165, std.dev.: 0.0028)
  SingleSource/Regression/C/2003-05-22-VarSizeArray: -43.97% (0.0282 => 0.0158, std.dev.: 0.0039)
  SingleSource/Regression/C/2008-01-07-LongDouble: -43.37% (0.0249 => 0.0141, std.dev.: 0.0020)
  SingleSource/UnitTests/Vector/sumarray-dbl: -40.97% (0.0371 => 0.0219, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/random: -40.33% (0.0553 => 0.0330, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -29.11% (0.2350 => 0.1666, std.dev.: 0.0188)
  SingleSource/Benchmarks/Misc/ffbench: -15.57% (0.0925 => 0.0781, std.dev.: 0.0038)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -12.16% (0.4449 => 0.3908, std.dev.: 0.0195)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.75% (1.1599 => 1.1164, std.dev.: 0.0118)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.59% (2.4488 => 2.3608, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.91% (3.6423 => 3.5728, std.dev.: 0.0112)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.11% (2.6570 => 2.6276, std.dev.: 0.0009)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.59% (0.1357 => 0.1365, std.dev.: 0.0069)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 57.34% (0.1015 => 0.1597, std.dev.: 0.0124)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 54.33% (0.0773 => 0.1193, std.dev.: 0.0146)
  MultiSource/Benchmarks/McCat/08-main/main: 52.61% (0.2870 => 0.4380, std.dev.: 0.0538)
  MultiSource/Benchmarks/Olden/em3d/em3d: 34.74% (0.1972 => 0.2657, std.dev.: 0.0159)
  MultiSource/Applications/obsequi/Obsequi: 32.12% (1.1551 => 1.5261, std.dev.: 0.1078)
  MultiSource/Benchmarks/Olden/bisort/bisort: 28.06% (0.0695 => 0.0890, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.15% (1.3498 => 1.6083, std.dev.: 0.0707)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.25% (1.2639 => 1.4945, std.dev.: 0.0161)
  MultiSource/Applications/JM/ldecod/ldecod: 17.41% (7.4026 => 8.6913, std.dev.: 0.2445)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.86% (1.2086 => 1.4003, std.dev.: 0.0266)
  MultiSource/Applications/JM/lencod/lencod: 15.40% (16.5902 => 19.1443, std.dev.: 0.3441)
  MultiSource/Applications/aha/aha: 15.32% (0.1279 => 0.1475, std.dev.: 0.0029)
  MultiSource/Applications/kimwitu++/kc: 13.56% (18.3608 => 20.8505, std.dev.: 0.3522)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 13.12% (1.2553 => 1.4200, std.dev.: 0.0297)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.09% (24.6139 => 27.8370, std.dev.: 0.8602)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.55% (4.0397 => 4.5062, std.dev.: 0.1438)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.62% (1.2499 => 1.3827, std.dev.: 0.0282)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.85% (1.2116 => 1.3309, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.15% (1.2235 => 1.3355, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.07% (1.2201 => 1.3308, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.48% (1.2152 => 1.3182, std.dev.: 0.0177)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.55% (0.2847 => 0.3062, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.02% (0.1467 => 0.1570, std.dev.: 0.0029)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 108.50% (0.1377 => 0.2871, std.dev.: 0.0211)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.27% (7.6426 => 12.4777, std.dev.: 0.0928)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 36.86% (1.3143 => 1.7988, std.dev.: 0.0898)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 28.61% (2.4753 => 3.1834, std.dev.: 0.1519)
  MultiSource/Applications/obsequi/Obsequi: 22.86% (2.1884 => 2.6886, std.dev.: 0.1420)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 22.78% (1.1431 => 1.4035, std.dev.: 0.0483)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.70% (1.3008 => 1.5571, std.dev.: 0.0810)
  SingleSource/Benchmarks/McGill/misr: 8.99% (0.3771 => 0.4110, std.dev.: 0.0019)
  MultiSource/Benchmarks/PAQ8p/paq8p: 7.66% (96.7834 => 104.1923, std.dev.: 0.9147)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 7.12% (1.4898 => 1.5959, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0104)
  MultiSource/Benchmarks/BitBench/five11/five11: 6.02% (5.3716 => 5.6951, std.dev.: 0.0328)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.02% (4.1011 => 4.3480, std.dev.: 0.0178)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.24% (3.1730 => 3.3393, std.dev.: 0.0197)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.21% (4.5744 => 4.8126, std.dev.: 0.0776)
  MultiSource/Applications/sqlite3/sqlite3: 3.72% (4.2733 => 4.4321, std.dev.: 0.0143)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.58% (2.5368 => 2.6276, std.dev.: 0.0009)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.34% (89.7126 => 92.7087, std.dev.: 0.1317)
  MultiSource/Benchmarks/Olden/power/power: 3.12% (1.2170 => 1.2550, std.dev.: 0.0078)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.16% (1.7652 => 1.8033, std.dev.: 0.0052)
  MultiSource/Applications/siod/siod: 2.07% (3.5310 => 3.6040, std.dev.: 0.0198)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.85% (16.7972 => 17.1078, std.dev.: 0.0181)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (2.4920 => 2.5322, std.dev.: 0.0091)
  MultiSource/Applications/lua/lua: 1.55% (29.5202 => 29.9780, std.dev.: 0.1641)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -52.81% (0.5226 => 0.2466, std.dev.: 0.0268)
  MultiSource/Applications/sgefa/sgefa: -43.02% (1.5790 => 0.8997, std.dev.: 0.0209)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.00% (0.0400 => 0.0272, std.dev.: 0.0003)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.84% (15.9508 => 13.2648, std.dev.: 0.2807)
  MultiSource/Benchmarks/mafft/pairlocalalign: -16.60% (50.0284 => 41.7231, std.dev.: 1.8534)
  SingleSource/Benchmarks/Linpack/linpack-pc: -13.52% (57.2347 => 49.4992, std.dev.: 1.7681)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.15% (20.8247 => 18.5028, std.dev.: 0.2484)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.87% (3.4956 => 3.1156, std.dev.: 0.0327)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.75% (0.3304 => 0.2982, std.dev.: 0.0094)
  MultiSource/Benchmarks/Olden/em3d/em3d: -9.70% (5.0288 => 4.5412, std.dev.: 0.0361)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.48% (2.5938 => 2.4777, std.dev.: 0.0188)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.77% (3.7874 => 3.6824, std.dev.: 0.0063)
  SingleSource/Benchmarks/Misc/oourafft: -2.69% (3.7484 => 3.6475, std.dev.: 0.0255)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.51% (17.1431 => 16.7132, std.dev.: 0.0774)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.04% (4.3592 => 4.2703, std.dev.: 0.0147)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.26% (0.1348 => 0.1365, std.dev.: 0.0069)

Report Time: 1.17s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131021/c71a7e76/attachment.html>


More information about the llvm-testresults mailing list