[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jan 2 10:45:57 PST 2014


http://llvm.org/perf/db_default/v4/nts/19531?compare_to=19520&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19531, Order: 198313, Start Time: 2014-01-02 17:02:39, End Time: 2014-01-02 18:50:37
      To: 19520, Order: 198308, Start Time: 2014-01-02 14:47:42, End Time: 2014-01-02 16:35:13
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 21 (33 on baseline)
Performance Improvements: 22 (10 on baseline)
Unchanged Tests: 1067 (1067 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.76% (1.2883 => 1.3367, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.65% (1.2326 => 1.2653, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.60% (1.3024 => 1.3362, std.dev.: 0.0064)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: 64.58% (0.0240 => 0.0395, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 39.42% (0.1413 => 0.1970, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 23.30% (3.1255 => 3.8537, std.dev.: 0.2492)
  SingleSource/Benchmarks/Shootout/heapsort: 22.61% (3.3777 => 4.1413, std.dev.: 0.1691)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 11.01% (3.8560 => 4.2804, std.dev.: 0.0321)
  SingleSource/Benchmarks/Misc/salsa20: 7.44% (7.4987 => 8.0567, std.dev.: 0.0518)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.41% (6.4381 => 6.9154, std.dev.: 0.0611)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.30% (0.3533 => 0.3791, std.dev.: 0.0015)
  MultiSource/Benchmarks/Bullet/bullet: 7.09% (6.9635 => 7.4569, std.dev.: 0.0844)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.24% (95.9620 => 100.9861, std.dev.: 1.0454)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.26% (1.8213 => 1.8989, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/flops: 3.80% (9.2727 => 9.6246, std.dev.: 0.0161)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.15% (1.2967 => 1.3376, std.dev.: 0.0064)
  SingleSource/Benchmarks/McGill/chomp: 2.46% (1.0194 => 1.0445, std.dev.: 0.0070)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.27% (1.6515 => 1.6890, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.07% (1.6007 => 1.6339, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.56% (5.0948 => 5.1743, std.dev.: 0.0196)
  SingleSource/Benchmarks/Shootout/methcall: 1.23% (8.5580 => 8.6629, std.dev.: 0.0038)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2002-10-12-StructureArgs: -43.46% (0.0306 => 0.0173, std.dev.: 0.0035)
  SingleSource/Regression/C++/EH/ConditionalExpr: -41.63% (0.0406 => 0.0237, std.dev.: 0.0022)
  SingleSource/UnitTests/FloatPrecision: -40.99% (0.0283 => 0.0167, std.dev.: 0.0039)
  SingleSource/Regression/C/badidx: -40.58% (0.0451 => 0.0268, std.dev.: 0.0060)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: -38.66% (0.0344 => 0.0211, std.dev.: 0.0008)
  SingleSource/Regression/C++/EH/dead_try_block: -38.27% (0.0277 => 0.0171, std.dev.: 0.0004)
  SingleSource/Regression/C++/EH/inlined_cleanup: -37.62% (0.0303 => 0.0189, std.dev.: 0.0030)
  SingleSource/UnitTests/2003-05-02-DependentPHI: -35.82% (0.0282 => 0.0181, std.dev.: 0.0037)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -33.98% (0.0309 => 0.0204, std.dev.: 0.0009)
  SingleSource/Regression/C++/EH/exception_spec_test: -31.92% (0.0520 => 0.0354, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -31.14% (0.1127 => 0.0776, std.dev.: 0.0050)
  SingleSource/Regression/C++/fixups: -30.98% (0.0368 => 0.0254, std.dev.: 0.0038)
  MultiSource/Applications/Burg/burg: -14.12% (1.6581 => 1.4239, std.dev.: 0.0202)
  MultiSource/Benchmarks/sim/sim: -10.37% (0.4099 => 0.3674, std.dev.: 0.0067)
  MultiSource/Applications/siod/siod: -8.40% (2.8334 => 2.5954, std.dev.: 0.0835)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Dhrystone/dry: -11.58% (0.5683 => 0.5025, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/ReedSolomon: -8.03% (9.2494 => 8.5068, std.dev.: 0.0105)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.68% (2.9971 => 2.8269, std.dev.: 0.0456)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.39% (38.6981 => 36.6109, std.dev.: 0.6455)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.74% (5.6364 => 5.4254, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.45% (5.9974 => 5.7907, std.dev.: 0.0088)
  SingleSource/Benchmarks/Misc/fp-convert: -2.31% (7.7114 => 7.5331, std.dev.: 0.0555)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 40.33% (15.7419 => 22.0899, std.dev.: 0.9035)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.36% (25.9661 => 29.1746, std.dev.: 0.6721)
  MultiSource/Applications/lemon/lemon: 9.40% (1.2200 => 1.3347, std.dev.: 0.0381)
  SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.2578 => 0.2681, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.48% (0.3366 => 0.3483, std.dev.: 0.0039)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.07% (0.6322 => 0.6516, std.dev.: 0.0059)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: 50.76% (0.0262 => 0.0395, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/heapsort: 40.42% (2.9492 => 4.1413, std.dev.: 0.1691)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 28.69% (2.9945 => 3.8537, std.dev.: 0.2492)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.79% (5.9583 => 6.9587, std.dev.: 0.1485)
  SingleSource/Benchmarks/Shootout-C++/ary3: 12.52% (4.6797 => 5.2658, std.dev.: 0.1893)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 10.08% (3.8883 => 4.2804, std.dev.: 0.0321)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.46% (3.3810 => 3.6669, std.dev.: 0.0800)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.27% (0.3534 => 0.3791, std.dev.: 0.0015)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.53% (1.2556 => 1.3376, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc/salsa20: 6.08% (7.5947 => 8.0567, std.dev.: 0.0518)
  MultiSource/Applications/lua/lua: 5.43% (29.1357 => 30.7178, std.dev.: 0.1054)
  SingleSource/Benchmarks/Dhrystone/dry: 5.41% (0.4767 => 0.5025, std.dev.: 0.0009)
  MultiSource/Applications/siod/siod: 4.95% (3.4258 => 3.5953, std.dev.: 0.0288)
  SingleSource/Benchmarks/Misc/flops: 3.86% (9.2673 => 9.6246, std.dev.: 0.0161)
  SingleSource/Benchmarks/McGill/chomp: 3.43% (1.0099 => 1.0445, std.dev.: 0.0070)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.35% (1.2463 => 1.2881, std.dev.: 0.0072)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.15% (1.8409 => 1.8989, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.21% (1.5986 => 1.6339, std.dev.: 0.0070)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.17% (2.6658 => 2.7237, std.dev.: 0.0199)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.15% (4.0593 => 4.1464, std.dev.: 0.0322)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.12% (5.9126 => 6.0381, std.dev.: 0.0191)
  SingleSource/Benchmarks/Misc/fp-convert: 1.95% (7.3892 => 7.5331, std.dev.: 0.0555)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.91% (1.5797 => 1.6098, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.82% (4.4509 => 4.5320, std.dev.: 0.0266)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.73% (11.7894 => 11.9931, std.dev.: 0.0217)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.14% (1.6699 => 1.6890, std.dev.: 0.0029)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.14% (1.7409 => 1.7607, std.dev.: 0.0058)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.81% (0.3247 => 0.3026, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.38% (1.3146 => 1.2439, std.dev.: 0.0241)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.26% (0.6882 => 0.6520, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.35% (1.1409 => 1.1027, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.26% (1.3676 => 1.3367, std.dev.: 0.0069)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.25% (5.9456 => 5.5740, std.dev.: 0.0308)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -4.66% (0.3970 => 0.3785, std.dev.: 0.0066)
  MultiSource/Applications/sqlite3/sqlite3: -4.46% (4.2978 => 4.1063, std.dev.: 0.0477)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.38% (3.6583 => 3.6079, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.08% (5.1117 => 5.0567, std.dev.: 0.0213)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140102/dfe74a19/attachment.html>


More information about the llvm-testresults mailing list