[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Oct 3 12:16:03 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15933?compare_to=15930&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15933, Order: 191907, Start Time: 2013-10-03 17:23:35, End Time: 2013-10-03 19:18:59
      To: 15930, Order: 191901, Start Time: 2013-10-03 15:11:13, End Time: 2013-10-03 16:58:54
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 43 (49 on baseline)
Performance Improvements: 6 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1058 (1041 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/lowercase: 53.91% (0.0243 => 0.0374, std.dev.: 0.0046)
  SingleSource/UnitTests/Vector/constpool: 36.09% (8.8316 => 12.0189, std.dev.: 0.8331)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.12% (0.1351 => 0.1785, std.dev.: 0.0052)
  MultiSource/Applications/kimwitu++/kc: 15.92% (18.8247 => 21.8216, std.dev.: 0.5155)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.89% (2.0071 => 2.2859, std.dev.: 0.0392)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.10% (4.1983 => 4.7483, std.dev.: 0.0116)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.52% (2.7347 => 3.0772, std.dev.: 0.0200)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.46% (1.2187 => 1.3705, std.dev.: 0.0428)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 10.96% (1.4803 => 1.6425, std.dev.: 0.0350)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.71% (1.3233 => 1.4650, std.dev.: 0.0350)
  SingleSource/Benchmarks/Shootout-C++/objinst: 10.51% (0.2103 => 0.2324, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.49% (0.8943 => 0.9881, std.dev.: 0.0086)
  SingleSource/Benchmarks/Shootout-C++/hash2: 10.27% (0.4344 => 0.4790, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.95% (1.3617 => 1.4972, std.dev.: 0.0315)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.45% (1.2345 => 1.3512, std.dev.: 0.0227)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.69% (2.5981 => 2.8238, std.dev.: 0.0634)
  SingleSource/Benchmarks/Stanford/Puzzle: 8.42% (0.1294 => 0.1403, std.dev.: 0.0037)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.31% (0.1240 => 0.1343, std.dev.: 0.0026)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.95% (0.1668 => 0.1784, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2367 => 0.2527, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.55% (6.3305 => 6.7453, std.dev.: 0.0942)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 63.19% (0.0163 => 0.0266, std.dev.: 0.0028)
  MultiSource/Applications/minisat/minisat: 34.40% (6.3684 => 8.5592, std.dev.: 0.4424)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.66% (4.5430 => 5.9359, std.dev.: 0.4419)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 28.26% (28.5045 => 36.5603, std.dev.: 0.1703)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 27.40% (1.3239 => 1.6866, std.dev.: 0.1015)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.57% (0.4245 => 0.5288, std.dev.: 0.0387)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.97% (35.6114 => 42.3661, std.dev.: 2.5657)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 17.24% (1.5016 => 1.7605, std.dev.: 0.0204)
  MultiSource/Applications/obsequi/Obsequi: 13.42% (2.3571 => 2.6734, std.dev.: 0.0392)
  SingleSource/Benchmarks/Shootout-C++/lists1: 10.04% (0.5876 => 0.6466, std.dev.: 0.0079)
  SingleSource/Benchmarks/McGill/chomp: 8.34% (1.0220 => 1.1072, std.dev.: 0.0308)
  SingleSource/Benchmarks/Misc/salsa20: 7.74% (7.5899 => 8.1770, std.dev.: 0.0220)
  MultiSource/Applications/lua/lua: 5.67% (29.1252 => 30.7756, std.dev.: 0.4330)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.66% (4.3736 => 4.5336, std.dev.: 0.0274)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.60% (3.6370 => 3.7679, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.41% (5.0934 => 5.2673, std.dev.: 0.0465)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (4.0792 => 4.2053, std.dev.: 0.0254)
  SingleSource/Benchmarks/Misc/flops: 1.85% (9.4140 => 9.5877, std.dev.: 0.0290)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.72% (4.0259 => 4.0953, std.dev.: 0.0103)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (3.6206 => 3.6692, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.28% (6.7929 => 6.8798, std.dev.: 0.0225)
  SingleSource/Benchmarks/Misc/flops-7: 1.13% (1.7164 => 1.7358, std.dev.: 0.0050)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -9.87% (1.4656 => 1.3209, std.dev.: 0.0539)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Puzzle: -8.89% (0.1867 => 0.1701, std.dev.: 0.0028)
  SingleSource/Regression/C/uint64_to_float: -5.16% (1.4794 => 1.4030, std.dev.: 0.0239)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.84% (5.6515 => 5.4344, std.dev.: 0.0743)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.56% (5.4376 => 5.2441, std.dev.: 0.0584)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.68% (2.5435 => 2.4754, std.dev.: 0.0160)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.88% (0.1368 => 0.1356, std.dev.: 0.0393)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/lowercase: 53.91% (0.0243 => 0.0374, std.dev.: 0.0046)
  SingleSource/UnitTests/Vector/constpool: 35.16% (8.8921 => 12.0189, std.dev.: 0.8331)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 33.91% (0.1333 => 0.1785, std.dev.: 0.0052)
  MultiSource/Applications/kimwitu++/kc: 18.85% (18.3608 => 21.8216, std.dev.: 0.5155)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.54% (4.0397 => 4.7483, std.dev.: 0.0116)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 17.37% (1.9476 => 2.2859, std.dev.: 0.0392)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.16% (2.6492 => 3.0772, std.dev.: 0.0200)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.11% (1.2116 => 1.3705, std.dev.: 0.0428)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.51% (1.4599 => 1.6425, std.dev.: 0.0350)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.26% (0.8802 => 0.9881, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.89% (6.0284 => 6.7453, std.dev.: 0.0942)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.71% (0.1597 => 0.1784, std.dev.: 0.0029)
  SingleSource/Benchmarks/Stanford/Puzzle: 11.70% (0.1256 => 0.1403, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.64% (1.3123 => 1.4650, std.dev.: 0.0350)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.92% (1.3498 => 1.4972, std.dev.: 0.0315)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.84% (14.4764 => 16.0451, std.dev.: 0.5824)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.44% (1.2235 => 1.3512, std.dev.: 0.0227)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.02% (2.5666 => 2.8238, std.dev.: 0.0634)
  SingleSource/Benchmarks/Shootout-C++/hash2: 9.64% (0.4369 => 0.4790, std.dev.: 0.0094)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.57% (0.1237 => 0.1343, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.81% (0.3096 => 0.3276, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 106.20% (0.0129 => 0.0266, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.18% (7.6426 => 12.4711, std.dev.: 0.0164)
  SingleSource/Benchmarks/Stanford/Perm: 37.81% (0.0320 => 0.0441, std.dev.: 0.0022)
  MultiSource/Applications/minisat/minisat: 36.38% (6.2760 => 8.5592, std.dev.: 0.4424)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.52% (4.5479 => 5.9359, std.dev.: 0.4419)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 28.33% (1.3143 => 1.6866, std.dev.: 0.1015)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.19% (0.4258 => 0.5288, std.dev.: 0.0387)
  MultiSource/Applications/obsequi/Obsequi: 22.16% (2.1884 => 2.6734, std.dev.: 0.0392)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 21.13% (30.1838 => 36.5603, std.dev.: 0.1703)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 10.50% (0.8273 => 0.9142, std.dev.: 0.0121)
  SingleSource/Benchmarks/McGill/chomp: 8.97% (1.0161 => 1.1072, std.dev.: 0.0308)
  SingleSource/Benchmarks/Shootout-C++/lists1: 8.64% (0.5952 => 0.6466, std.dev.: 0.0079)
  SingleSource/UnitTests/Vector/multiplies: 7.91% (0.5561 => 0.6001, std.dev.: 0.0139)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.62% (8.1346 => 8.6731, std.dev.: 0.0658)
  SingleSource/Benchmarks/Misc/salsa20: 4.88% (7.7964 => 8.1770, std.dev.: 0.0220)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.26% (6.5990 => 6.8798, std.dev.: 0.0225)
  MultiSource/Applications/lua/lua: 4.25% (29.5202 => 30.7756, std.dev.: 0.4330)
  MultiSource/Applications/siod/siod: 3.82% (3.5310 => 3.6659, std.dev.: 0.0301)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.59% (4.0596 => 4.2053, std.dev.: 0.0254)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.51% (3.6401 => 3.7679, std.dev.: 0.0243)
  MultiSource/Applications/spiff/spiff: 3.44% (2.8194 => 2.9163, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.32% (5.0980 => 5.2673, std.dev.: 0.0465)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.24% (0.5182 => 0.5350, std.dev.: 0.0011)
  MultiSource/Applications/hexxagon/hexxagon: 2.55% (14.7810 => 15.1581, std.dev.: 0.0971)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.92% (4.0181 => 4.0953, std.dev.: 0.0103)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.71% (3.8582 => 3.9243, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/flops: 1.53% (9.4433 => 9.5877, std.dev.: 0.0290)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.18% (16.7972 => 16.9947, std.dev.: 0.0319)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -48.16% (0.5226 => 0.2709, std.dev.: 0.0177)
  MultiSource/Applications/sgefa/sgefa: -47.09% (1.5790 => 0.8355, std.dev.: 0.0335)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.81% (15.9508 => 13.2699, std.dev.: 0.2693)
  SingleSource/Benchmarks/Linpack/linpack-pc: -15.72% (57.2347 => 48.2393, std.dev.: 2.9067)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.72% (20.8247 => 18.5933, std.dev.: 0.2388)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.48% (3.4956 => 3.1292, std.dev.: 0.0045)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.63% (50.0284 => 46.2090, std.dev.: 0.1742)
  SingleSource/Benchmarks/Stanford/Puzzle: -7.25% (0.1834 => 0.1701, std.dev.: 0.0028)
  MultiSource/Applications/JM/lencod/lencod: -6.95% (8.1785 => 7.6102, std.dev.: 0.1941)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.77% (2.5938 => 2.4961, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.73% (5.4473 => 5.2441, std.dev.: 0.0584)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.17% (4.3592 => 4.2209, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.73% (17.1431 => 16.6748, std.dev.: 0.1079)
  SingleSource/Benchmarks/Misc/fp-convert: -2.35% (7.5877 => 7.4092, std.dev.: 0.0669)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.99% (3.7437 => 3.6692, std.dev.: 0.0133)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.56% (3.6646 => 3.6074, std.dev.: 0.0190)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.12% (89.7126 => 88.7045, std.dev.: 0.1435)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.59% (0.1348 => 0.1356, std.dev.: 0.0393)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131003/1ed90563/attachment.html>


More information about the llvm-testresults mailing list