[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Oct 3 14:28:50 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15937?compare_to=15933&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15937, Order: 191922, Start Time: 2013-10-03 19:42:55, End Time: 2013-10-03 21:31:46
      To: 15933, Order: 191907, Start Time: 2013-10-03 17:23:35, End Time: 2013-10-03 19:18:59
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 14 (28 on baseline)
Performance Improvements: 48 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1045 (1063 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 33.09% (0.1484 => 0.1975, std.dev.: 0.0006)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 11.48% (0.4549 => 0.5071, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.17% (0.3737 => 0.4005, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.61% (4.5764 => 4.7876, std.dev.: 0.0531)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.33% (0.6256 => 0.6527, std.dev.: 0.0010)
  SingleSource/Regression/C/uint64_to_float: 4.13% (1.4030 => 1.4609, std.dev.: 0.0114)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.71% (5.4344 => 5.6360, std.dev.: 0.0373)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.12% (1.6434 => 1.6946, std.dev.: 0.0009)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (3.1292 => 3.2149, std.dev.: 0.0020)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.53% (2.4754 => 2.5380, std.dev.: 0.0153)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (2.4961 => 2.5402, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.46% (1.5933 => 1.6166, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.26% (6.7366 => 6.8216, std.dev.: 0.0017)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.20% (2.3752 => 2.4036, std.dev.: 0.0106)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/lowercase: -34.49% (0.0374 => 0.0245, std.dev.: 0.0008)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -23.98% (0.1785 => 0.1357, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/ffbench: -21.61% (0.1004 => 0.0787, std.dev.: 0.0081)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -18.22% (0.1284 => 0.1050, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -18.19% (0.2160 => 0.1767, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/em3d/em3d: -15.79% (0.2362 => 0.1989, std.dev.: 0.0025)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -14.43% (1.2872 => 1.1014, std.dev.: 0.0164)
  MultiSource/Benchmarks/Bullet/bullet: -14.34% (38.9849 => 33.3926, std.dev.: 0.5879)
  MultiSource/Applications/kimwitu++/kc: -14.14% (21.8216 => 18.7356, std.dev.: 1.0481)
  SingleSource/Benchmarks/McGill/chomp: -12.74% (0.2582 => 0.2253, std.dev.: 0.0111)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -12.48% (1.0693 => 0.9358, std.dev.: 0.0180)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -12.05% (2.2859 => 2.0104, std.dev.: 0.0082)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.48% (0.0958 => 0.0848, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -11.47% (4.7483 => 4.2037, std.dev.: 0.0599)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -10.52% (0.2368 => 0.2119, std.dev.: 0.0085)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -10.39% (3.0772 => 2.7576, std.dev.: 0.0106)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -10.26% (0.1004 => 0.0901, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/bh/bh: -8.05% (0.3577 => 0.3289, std.dev.: 0.0030)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.60% (0.3145 => 0.2906, std.dev.: 0.0077)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.27% (0.6943 => 0.6438, std.dev.: 0.0108)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -7.02% (1.3949 => 1.2970, std.dev.: 0.0202)
  MultiSource/Benchmarks/Olden/power/power: -6.85% (0.1563 => 0.1456, std.dev.: 0.0013)
  MultiSource/Benchmarks/Prolangs-C/football/football: -6.48% (1.0840 => 1.0138, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.05% (0.7208 => 0.6772, std.dev.: 0.0137)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.91% (0.5690 => 0.5354, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.35% (1.7094 => 1.6180, std.dev.: 0.0200)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.97% (0.3056 => 0.2904, std.dev.: 0.0013)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.94% (0.3606 => 0.3428, std.dev.: 0.0033)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.23% (5.8746 => 5.6262, std.dev.: 0.0911)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.12% (0.7377 => 0.7073, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.85% (0.5033 => 0.4839, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -41.83% (0.2357 => 0.1371, std.dev.: 0.0300)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -37.13% (1.1814 => 0.7428, std.dev.: 0.0791)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -21.57% (36.5603 => 28.6740, std.dev.: 1.5710)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -19.63% (0.5288 => 0.4250, std.dev.: 0.0167)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.65% (0.1271 => 0.1034, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -16.48% (42.3661 => 35.3829, std.dev.: 1.8033)
  MultiSource/Applications/obsequi/Obsequi: -12.09% (2.6734 => 2.3501, std.dev.: 0.1159)
  MultiSource/Benchmarks/FreeBench/neural/neural: -11.55% (0.2709 => 0.2396, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/tsp/tsp: -10.95% (1.7491 => 1.5576, std.dev.: 0.0158)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.85% (0.3382 => 0.3184, std.dev.: 0.0022)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -4.72% (1.1786 => 1.1230, std.dev.: 0.0098)
  SingleSource/Benchmarks/Shootout-C++/ary3: -3.62% (5.1060 => 4.9214, std.dev.: 0.0699)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -3.50% (3.7679 => 3.6360, std.dev.: 0.0146)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.14% (0.3503 => 0.3393, std.dev.: 0.0013)
  MultiSource/Benchmarks/Bullet/bullet: -2.90% (7.2721 => 7.0610, std.dev.: 0.0457)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -2.89% (2.1744 => 2.1115, std.dev.: 0.0025)
  MultiSource/Benchmarks/Olden/bh/bh: -1.29% (2.4086 => 2.3775, std.dev.: 0.0116)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.52% (0.1356 => 0.1349, std.dev.: 0.0331)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.91% (0.3096 => 0.3279, std.dev.: 0.0062)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.65% (0.4624 => 0.4839, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.09% (2.6492 => 2.7576, std.dev.: 0.0106)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.06% (4.0397 => 4.2037, std.dev.: 0.0599)
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.71% (0.3480 => 0.3609, std.dev.: 0.0033)
  MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.5185 => 0.5354, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.22% (1.9476 => 2.0104, std.dev.: 0.0082)
  MultiSource/Benchmarks/Prolangs-C/football/football: 3.15% (0.9828 => 1.0138, std.dev.: 0.0108)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.86% (1.8775 => 1.9312, std.dev.: 0.0077)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.37% (1.0952 => 1.1212, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.22% (0.6296 => 0.6436, std.dev.: 0.0027)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.03% (7.6426 => 12.4598, std.dev.: 0.0879)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0027)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.41% (8.1346 => 8.6559, std.dev.: 0.0887)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.56% (0.1871 => 0.1975, std.dev.: 0.0006)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.92% (5.3716 => 5.6360, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.66% (4.5744 => 4.7876, std.dev.: 0.0531)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.41% (0.3836 => 0.4005, std.dev.: 0.0014)
  MultiSource/Applications/spiff/spiff: 3.42% (2.8194 => 2.9157, std.dev.: 0.0299)
  MultiSource/Applications/siod/siod: 2.91% (3.5310 => 3.6336, std.dev.: 0.0375)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.50% (1.7652 => 1.8094, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/power/power: 2.03% (1.2170 => 1.2417, std.dev.: 0.0022)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.85% (2.4920 => 2.5380, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.68% (3.1569 => 3.2099, std.dev.: 0.0046)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (1.6707 => 1.6946, std.dev.: 0.0009)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.37% (16.7972 => 17.0266, std.dev.: 0.0338)
  SingleSource/Benchmarks/Misc/flops: 1.31% (9.4433 => 9.5672, std.dev.: 0.0208)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.17% (6.7429 => 6.8216, std.dev.: 0.0017)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -22.59% (0.1483 => 0.1148, std.dev.: 0.0035)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.32% (0.1956 => 0.1852, std.dev.: 0.0031)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.15% (0.5226 => 0.2396, std.dev.: 0.0019)
  MultiSource/Applications/sgefa/sgefa: -46.94% (1.5790 => 0.8378, std.dev.: 0.0321)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.25% (0.0400 => 0.0279, std.dev.: 0.0030)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.54% (15.9508 => 12.9929, std.dev.: 0.4749)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.14% (20.8247 => 18.7125, std.dev.: 0.1158)
  SingleSource/Benchmarks/Linpack/linpack-pc: -8.34% (57.2347 => 52.4590, std.dev.: 1.8498)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.03% (3.4956 => 3.2149, std.dev.: 0.0020)
  MultiSource/Applications/JM/lencod/lencod: -7.87% (8.1785 => 7.5347, std.dev.: 0.2110)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.39% (50.0284 => 46.8291, std.dev.: 0.4176)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.96% (4.3592 => 4.1867, std.dev.: 0.0623)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.08% (3.7437 => 3.6284, std.dev.: 0.0402)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.96% (17.1431 => 16.6354, std.dev.: 0.1262)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.07% (2.5938 => 2.5402, std.dev.: 0.0016)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.78% (2.4471 => 2.4036, std.dev.: 0.0106)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1348 => 0.1349, std.dev.: 0.0331)

Report Time: 1.00s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131003/b192df41/attachment.html>


More information about the llvm-testresults mailing list