[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Oct 24 18:57:42 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16650?compare_to=16646&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16650, Order: 193382, Start Time: 2013-10-25 00:10:00, End Time: 2013-10-25 02:01:00
      To: 16646, Order: 193371, Start Time: 2013-10-24 21:43:24, End Time: 2013-10-24 23:42:57
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 10 (23 on baseline)
Performance Improvements: 40 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1057 (1066 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.35% (1.4910 => 1.8689, std.dev.: 0.0219)
  SingleSource/Benchmarks/Linpack/linpack-pc: 22.54% (36.2922 => 44.4735, std.dev.: 2.6456)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2624 => 1.3542, std.dev.: 0.0128)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.45% (0.3599 => 0.3795, std.dev.: 0.0024)
  MultiSource/Applications/aha/aha: 5.21% (3.5878 => 3.7747, std.dev.: 0.0084)
  SingleSource/Regression/C/uint64_to_float: 1.87% (1.4585 => 1.4858, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.61% (4.0692 => 4.1349, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.60% (0.9618 => 0.9772, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.27% (16.6174 => 16.8292, std.dev.: 0.0248)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.09% (1.7906 => 1.8101, std.dev.: 0.0072)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: -43.32% (0.4017 => 0.2277, std.dev.: 0.0028)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -35.88% (0.0825 => 0.0529, std.dev.: 0.0052)
  MultiSource/Benchmarks/FreeBench/neural/neural: -35.88% (0.2921 => 0.1873, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/perlin: -35.75% (0.0923 => 0.0593, std.dev.: 0.0066)
  SingleSource/Benchmarks/Shootout/ackermann: -32.06% (0.0340 => 0.0231, std.dev.: 0.0006)
  MultiSource/Benchmarks/McCat/05-eks/eks: -31.35% (0.7834 => 0.5378, std.dev.: 0.0560)
  MultiSource/Benchmarks/McCat/18-imp/imp: -25.17% (0.5602 => 0.4192, std.dev.: 0.0387)
  MultiSource/Benchmarks/Olden/tsp/tsp: -25.03% (0.1854 => 0.1390, std.dev.: 0.0113)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -24.44% (0.3630 => 0.2743, std.dev.: 0.0115)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -23.25% (0.1329 => 0.1020, std.dev.: 0.0062)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -22.69% (0.3715 => 0.2872, std.dev.: 0.0066)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -20.15% (1.6518 => 1.3189, std.dev.: 0.0079)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.41% (12.5073 => 10.2047, std.dev.: 0.6046)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.21% (1.6458 => 1.3626, std.dev.: 0.0799)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -16.01% (0.2093 => 0.1758, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -14.81% (5.8201 => 4.9580, std.dev.: 0.1461)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -13.97% (0.3392 => 0.2918, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -12.93% (1.4589 => 1.2702, std.dev.: 0.0712)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -12.23% (0.1300 => 0.1141, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.77% (1.2863 => 1.2121, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.29% (1.3201 => 1.2635, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.24% (1.3267 => 1.2705, std.dev.: 0.0145)
  MultiSource/Applications/siod/siod: -2.65% (2.6198 => 2.5503, std.dev.: 0.0121)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: -49.52% (1.5344 => 0.7746, std.dev.: 0.0576)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -36.89% (0.0908 => 0.0573, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -29.66% (0.1224 => 0.0861, std.dev.: 0.0128)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -21.79% (52.4177 => 40.9937, std.dev.: 1.7114)
  SingleSource/Benchmarks/Shootout/ary3: -19.20% (5.8125 => 4.6965, std.dev.: 0.0346)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.74% (0.1107 => 0.0966, std.dev.: 0.0001)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -11.13% (1.8582 => 1.6513, std.dev.: 0.0556)
  SingleSource/Benchmarks/Shootout/nestedloop: -10.98% (0.1685 => 0.1500, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout/hash: -9.19% (5.7579 => 5.2289, std.dev.: 0.0985)
  MultiSource/Benchmarks/Olden/tsp/tsp: -8.62% (1.6947 => 1.5486, std.dev.: 0.0524)
  MultiSource/Applications/JM/lencod/lencod: -8.44% (7.9566 => 7.2851, std.dev.: 0.1171)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.39% (0.3600 => 0.3406, std.dev.: 0.0015)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.18% (0.4884 => 0.4631, std.dev.: 0.0001)
  MultiSource/Applications/siod/siod: -3.88% (3.6510 => 3.5095, std.dev.: 0.0495)
  SingleSource/Benchmarks/Dhrystone/dry: -2.58% (0.5001 => 0.4872, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/flops-5: -1.24% (2.8154 => 2.7806, std.dev.: 0.0128)
  SingleSource/Benchmarks/Shootout/methcall: -1.21% (8.6966 => 8.5911, std.dev.: 0.0305)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.61% (0.1369 => 0.1347, std.dev.: 0.0045)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/d/make_dparser: 5.03% (3.4962 => 3.6720, std.dev.: 0.0482)
  MultiSource/Applications/siod/siod: 4.18% (2.4480 => 2.5503, std.dev.: 0.0121)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.62% (1.2728 => 1.3189, std.dev.: 0.0079)
  MultiSource/Applications/sgefa/sgefa: 3.46% (0.3848 => 0.3981, std.dev.: 0.0041)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.36% (7.6426 => 12.4850, std.dev.: 0.0664)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.02% (1.4830 => 1.8689, std.dev.: 0.0219)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 21.27% (1.1431 => 1.3862, std.dev.: 0.0526)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 9.85% (23.4704 => 25.7815, std.dev.: 0.1299)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.2516 => 1.3542, std.dev.: 0.0128)
  SingleSource/UnitTests/Vector/multiplies: 6.71% (0.5561 => 0.5934, std.dev.: 0.0113)
  MultiSource/Benchmarks/sim/sim: 5.85% (3.8312 => 4.0554, std.dev.: 0.0473)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.68% (3.1730 => 3.3533, std.dev.: 0.0459)
  SingleSource/Benchmarks/McGill/misr: 5.67% (0.3771 => 0.3985, std.dev.: 0.0081)
  MultiSource/Applications/aha/aha: 5.64% (3.5731 => 3.7747, std.dev.: 0.0084)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.50% (89.7126 => 92.8483, std.dev.: 0.2951)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.91% (4.0181 => 4.1349, std.dev.: 0.0038)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.54% (1.7652 => 1.8101, std.dev.: 0.0072)
  SingleSource/Regression/C/uint64_to_float: 2.27% (1.4528 => 1.4858, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.00% (3.1569 => 3.2200, std.dev.: 0.0010)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.85% (8.1346 => 8.2849, std.dev.: 0.0418)
  SingleSource/Benchmarks/Shootout/fib2: 1.79% (3.5966 => 3.6609, std.dev.: 0.0005)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.38% (16.7972 => 17.0291, std.dev.: 0.0544)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.25% (6.6028 => 6.6855, std.dev.: 0.0254)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.29% (0.1195 => 0.1084, std.dev.: 0.0043)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.15% (0.5226 => 0.2344, std.dev.: 0.0149)
  MultiSource/Applications/sgefa/sgefa: -41.99% (1.5790 => 0.9159, std.dev.: 0.0021)
  SingleSource/Benchmarks/Linpack/linpack-pc: -22.30% (57.2347 => 44.4735, std.dev.: 2.6456)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.55% (15.9508 => 12.8319, std.dev.: 0.5644)
  MultiSource/Benchmarks/FreeBench/mason/mason: -17.77% (0.3304 => 0.2717, std.dev.: 0.0011)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.22% (50.0284 => 43.4145, std.dev.: 0.5184)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.55% (20.8247 => 18.4203, std.dev.: 0.1521)
  MultiSource/Applications/JM/lencod/lencod: -10.92% (8.1785 => 7.2851, std.dev.: 0.1171)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.62% (3.4956 => 3.1244, std.dev.: 0.0303)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.63% (1.0695 => 0.9772, std.dev.: 0.0007)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.93% (3.7437 => 3.5216, std.dev.: 0.0604)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.75% (2.5938 => 2.4705, std.dev.: 0.0291)
  SingleSource/Benchmarks/Misc/oourafft: -3.43% (3.7484 => 3.6197, std.dev.: 0.0375)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.62% (5.4473 => 5.3045, std.dev.: 0.0546)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.86% (4.3592 => 4.2782, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.83% (17.1431 => 16.8292, std.dev.: 0.0248)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.55% (4.5344 => 4.4643, std.dev.: 0.0187)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1348 => 0.1347, std.dev.: 0.0045)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131024/eabc54a6/attachment.html>


More information about the llvm-testresults mailing list