[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Sep 19 20:44:02 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15472?compare_to=15470&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15472, Order: 191065, Start Time: 2013-09-20 02:01:43, End Time: 2013-09-20 03:46:44
      To: 15470, Order: 191046, Start Time: 2013-09-19 23:26:46, End Time: 2013-09-20 01:16:57
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 21 (31 on baseline)
Performance Improvements: 16 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1070 (1058 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.25% (0.8848 => 0.8959, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 26.62% (0.1559 => 0.1974, std.dev.: 0.0011)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 10.69% (0.4576 => 0.5065, std.dev.: 0.0002)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.19% (0.4202 => 0.4630, std.dev.: 0.0003)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.15% (1.2631 => 1.3534, std.dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.10% (2.8533 => 3.0560, std.dev.: 0.0107)
  SingleSource/Benchmarks/Shootout-C++/random: 5.91% (2.3397 => 2.4780, std.dev.: 0.0232)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.38% (0.3633 => 0.3792, std.dev.: 0.0020)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.09% (0.6264 => 0.6520, std.dev.: 0.0020)
  SingleSource/Regression/C/uint64_to_float: 4.03% (1.4254 => 1.4828, std.dev.: 0.0021)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.71% (2.1290 => 2.2080, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.42% (1.8351 => 1.8979, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.85% (3.1282 => 3.2174, std.dev.: 0.0004)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.58% (1.6492 => 1.6918, std.dev.: 0.0025)
  SingleSource/Benchmarks/Linpack/linpack-pc: 2.54% (45.3666 => 46.5174, std.dev.: 0.2709)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.35% (1.2628 => 1.2925, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.88% (1.6011 => 1.6312, std.dev.: 0.0042)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.70% (1.0505 => 1.0684, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.63% (6.7066 => 6.8157, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.51% (5.9164 => 6.0056, std.dev.: 0.0237)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.38% (3.8116 => 3.8641, std.dev.: 0.0011)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2003-07-06-IntOverflow: -46.34% (0.0382 => 0.0205, std.dev.: 0.0011)
  SingleSource/UnitTests/2002-08-19-CodegenBug: -36.45% (0.0299 => 0.0190, std.dev.: 0.0013)
  SingleSource/UnitTests/SignlessTypes/shr: -27.62% (0.0391 => 0.0283, std.dev.: 0.0036)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.39% (0.1935 => 0.1676, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/whetstone: -12.61% (0.1031 => 0.0901, std.dev.: 0.0024)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -9.66% (0.1097 => 0.0991, std.dev.: 0.0034)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.69% (0.1612 => 0.1488, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/bh/bh: -5.03% (0.3460 => 0.3286, std.dev.: 0.0021)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.25% (2.0829 => 1.9943, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/lists: -3.99% (0.2729 => 0.2620, std.dev.: 0.0040)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.89% (4.2838 => 4.1598, std.dev.: 0.0322)
  SingleSource/Benchmarks/Shootout-C++/moments: -2.81% (0.3920 => 0.3810, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -20.82% (1.8700 => 1.4806, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.61% (4.0393 => 3.9744, std.dev.: 0.0175)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.57% (1.5097 => 1.4860, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.12% (16.3388 => 16.1564, std.dev.: 0.0421)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.73% (0.1363 => 0.1353, std.dev.: 0.0116)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.11% (0.4624 => 0.4814, std.dev.: 0.0045)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3707 => 0.3840, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.56% (0.3822 => 0.3958, std.dev.: 0.0007)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.37% (0.8667 => 0.8959, std.dev.: 0.0019)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.97% (4.0397 => 4.1598, std.dev.: 0.0322)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.78% (0.5185 => 0.5329, std.dev.: 0.0037)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.59% (2.6492 => 2.7177, std.dev.: 0.0143)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.9476 => 1.9943, std.dev.: 0.0056)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.30% (4.5883 => 4.6939, std.dev.: 0.0169)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.07% (1.5333 => 1.5651, std.dev.: 0.0060)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.83% (0.6297 => 0.6412, std.dev.: 0.0023)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.11% (9.7354 => 9.8439, std.dev.: 0.0203)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.49% (0.1374 => 0.1628, std.dev.: 0.0001)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.55% (0.8273 => 0.8980, std.dev.: 0.0195)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.13% (1.2516 => 1.3534, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.51% (0.1871 => 0.1974, std.dev.: 0.0011)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.96% (0.3836 => 0.3988, std.dev.: 0.0025)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.83% (2.1472 => 2.2080, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.49% (1.7652 => 1.8091, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.48% (1.8519 => 1.8979, std.dev.: 0.0028)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.43% (0.5182 => 0.5308, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/power/power: 2.40% (1.2170 => 1.2462, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.33% (1.5940 => 1.6312, std.dev.: 0.0042)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (2.4920 => 2.5448, std.dev.: 0.0012)
  SingleSource/Regression/C/uint64_to_float: 2.06% (1.4528 => 1.4828, std.dev.: 0.0021)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.03% (3.7874 => 3.8641, std.dev.: 0.0011)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0005)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.38% (16.7972 => 17.0296, std.dev.: 0.0305)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (1.6707 => 1.6918, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.08% (6.7429 => 6.8157, std.dev.: 0.0030)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.98% (0.1483 => 0.1157, std.dev.: 0.0018)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.75% (0.5226 => 0.2365, std.dev.: 0.0013)
  MultiSource/Applications/sgefa/sgefa: -47.44% (1.5790 => 0.8299, std.dev.: 0.0295)
  SingleSource/Benchmarks/Linpack/linpack-pc: -18.73% (57.2347 => 46.5174, std.dev.: 0.2709)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.32% (15.9508 => 13.0279, std.dev.: 0.3096)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.08% (20.8247 => 18.5176, std.dev.: 0.1896)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.96% (0.3304 => 0.2975, std.dev.: 0.0003)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.96% (3.4956 => 3.2174, std.dev.: 0.0004)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.44% (50.0284 => 46.8059, std.dev.: 0.9973)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.24% (3.7437 => 3.5102, std.dev.: 0.0531)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.63% (0.3501 => 0.3304, std.dev.: 0.0006)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.39% (0.7474 => 0.7071, std.dev.: 0.0150)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.09% (2.5938 => 2.4878, std.dev.: 0.0259)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.84% (2.4471 => 2.3777, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.54% (17.1431 => 16.7072, std.dev.: 0.0707)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.22% (3.8582 => 3.8113, std.dev.: 0.0002)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.21% (89.7126 => 88.6266, std.dev.: 0.1787)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.04% (4.3592 => 4.3137, std.dev.: 0.0062)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.37% (0.1348 => 0.1353, std.dev.: 0.0116)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130919/c301675e/attachment.html>


More information about the llvm-testresults mailing list