[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 21 21:41:39 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16556?compare_to=16553&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16556, Order: 193137, Start Time: 2013-10-22 03:00:40, End Time: 2013-10-22 04:44:57
      To: 16553, Order: 193134, Start Time: 2013-10-22 00:47:29, End Time: 2013-10-22 02:34:42
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 25 (54 on baseline)
Performance Improvements: 0 (21 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1082 (1032 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.56% (1.2280 => 1.2594, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.93% (1.2635 => 1.2879, std.dev.: 0.0034)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: 20.34% (7.0588 => 8.4943, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout/matrix: 14.97% (1.8369 => 2.1119, std.dev.: 0.0015)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.55% (43.3587 => 47.0677, std.dev.: 0.1008)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.70% (2.8822 => 3.0465, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.19% (0.4623 => 0.4863, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout/lists: 4.52% (7.1844 => 7.5088, std.dev.: 0.0087)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.04% (2.1270 => 2.2130, std.dev.: 0.0007)
  MultiSource/Applications/hexxagon/hexxagon: 3.56% (15.2254 => 15.7674, std.dev.: 0.0101)
  SingleSource/Benchmarks/Shootout-C++/lists: 3.48% (15.6697 => 16.2153, std.dev.: 0.0371)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.42% (0.7097 => 0.7340, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.52% (2.4703 => 2.5325, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (6.7022 => 6.8452, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.93% (3.1282 => 3.1886, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout/fib2: 1.90% (3.5870 => 3.6552, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.83% (40.0332 => 40.7647, std.dev.: 0.0618)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.71% (23.4100 => 23.8113, std.dev.: 0.0382)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.71% (5.5303 => 5.6247, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (4.2408 => 4.3106, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.57% (1.0487 => 1.0652, std.dev.: 0.0001)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.57% (2.3780 => 2.4153, std.dev.: 0.0051)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.49% (1.6632 => 1.6880, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.47% (1.5996 => 1.6231, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.44% (12.4588 => 12.6376, std.dev.: 0.0250)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.71% (0.1349 => 0.1299, std.dev.: 0.0052)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.06% (4.0397 => 4.3248, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/oourafft: 6.93% (0.2294 => 0.2453, std.dev.: 0.0052)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.05% (2.6492 => 2.7830, std.dev.: 0.0312)
  MultiSource/Applications/JM/lencod/lencod: 4.88% (16.5902 => 17.4002, std.dev.: 0.1094)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.3096 => 0.3228, std.dev.: 0.0016)
  MultiSource/Applications/JM/ldecod/ldecod: 3.92% (7.4026 => 7.6931, std.dev.: 0.0315)
  MultiSource/Applications/d/make_dparser: 3.54% (3.4962 => 3.6200, std.dev.: 0.0232)
  MultiSource/Applications/siod/siod: 3.43% (2.4480 => 2.5319, std.dev.: 0.0159)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.89% (1.9476 => 2.0039, std.dev.: 0.0010)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.88% (1.5333 => 1.5775, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.84% (1.2523 => 1.2879, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.81% (1.2250 => 1.2594, std.dev.: 0.0012)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.73% (0.5705 => 0.5861, std.dev.: 0.0035)
  MultiSource/Applications/spiff/spiff: 2.47% (0.8911 => 0.9131, std.dev.: 0.0042)
  MultiSource/Applications/Burg/burg: 2.45% (1.3994 => 1.4337, std.dev.: 0.0114)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.12% (9.9903 => 10.2022, std.dev.: 0.0757)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.08% (0.6297 => 0.6428, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.02% (0.6439 => 0.6569, std.dev.: 0.0029)
  MultiSource/Applications/hbd/hbd: 2.01% (1.5696 => 1.6011, std.dev.: 0.0119)
  MultiSource/Applications/SPASS/SPASS: 1.76% (16.1646 => 16.4483, std.dev.: 0.0922)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.74% (1.4746 => 1.5002, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.66% (1.8775 => 1.9087, std.dev.: 0.0089)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.61% (1.0952 => 1.1128, std.dev.: 0.0066)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.31% (0.8233 => 0.8341, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.00% (1.3499 => 1.3634, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 65.36% (7.6426 => 12.6376, std.dev.: 0.0250)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 25.19% (1.1431 => 1.4310, std.dev.: 0.0389)
  SingleSource/Benchmarks/Shootout/matrix: 18.59% (1.7809 => 2.1119, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/sieve: 17.56% (7.2254 => 8.4943, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.87% (6.4425 => 7.2716, std.dev.: 0.2525)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 6.68% (0.1871 => 0.1996, std.dev.: 0.0002)
  MultiSource/Applications/hexxagon/hexxagon: 6.67% (14.7810 => 15.7674, std.dev.: 0.0101)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0075)
  MultiSource/Applications/aha/aha: 5.73% (3.5731 => 3.7778, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.27% (3.1730 => 3.3401, std.dev.: 0.0062)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.65% (1.2516 => 1.3098, std.dev.: 0.0189)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.04% (0.3836 => 0.3991, std.dev.: 0.0005)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.16% (89.7126 => 92.5463, std.dev.: 0.1225)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (2.1472 => 2.2130, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.74% (4.0181 => 4.1283, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.46% (1.8519 => 1.8974, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.41% (5.4925 => 5.6247, std.dev.: 0.0011)
  MultiSource/Benchmarks/Olden/power/power: 2.39% (1.2170 => 1.2461, std.dev.: 0.0022)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.93% (1.7652 => 1.7993, std.dev.: 0.0073)
  SingleSource/Benchmarks/Shootout/lists: 1.88% (7.3703 => 7.5088, std.dev.: 0.0087)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.83% (1.5940 => 1.6231, std.dev.: 0.0040)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (8.1346 => 8.2805, std.dev.: 0.0107)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.76% (3.5683 => 3.6311, std.dev.: 0.0204)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.67% (1.0477 => 1.0652, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/fib2: 1.63% (3.5966 => 3.6552, std.dev.: 0.0029)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (2.4920 => 2.5318, std.dev.: 0.0088)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.52% (6.7429 => 6.8452, std.dev.: 0.0005)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.45% (23.4704 => 23.8113, std.dev.: 0.0382)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (1.6707 => 1.6880, std.dev.: 0.0035)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.04% (0.1483 => 0.1171, std.dev.: 0.0022)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.43% (0.5226 => 0.2329, std.dev.: 0.0752)
  MultiSource/Applications/sgefa/sgefa: -42.08% (1.5790 => 0.9145, std.dev.: 0.0027)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.93% (15.9508 => 12.9315, std.dev.: 0.2127)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.38% (50.0284 => 40.8333, std.dev.: 0.6911)
  SingleSource/Benchmarks/Shootout/heapsort: -17.79% (3.5900 => 2.9512, std.dev.: 0.1585)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.76% (57.2347 => 47.0677, std.dev.: 0.1008)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.96% (0.3304 => 0.2909, std.dev.: 0.0032)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.22% (20.8247 => 18.4885, std.dev.: 0.1404)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.78% (3.4956 => 3.1886, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.43% (0.3501 => 0.3311, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/oourafft: -3.29% (3.7484 => 3.6252, std.dev.: 0.0385)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.23% (1.1075 => 1.0717, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.85% (17.1431 => 16.6547, std.dev.: 0.0849)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.36% (2.5938 => 2.5325, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.34% (3.7874 => 3.6987, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.25% (36.8417 => 36.0128, std.dev.: 0.0748)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.79% (0.7474 => 0.7340, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.47% (4.9459 => 4.8731, std.dev.: 0.0072)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.4471 => 2.4153, std.dev.: 0.0051)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.11% (4.3592 => 4.3106, std.dev.: 0.0006)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.64% (0.1348 => 0.1299, std.dev.: 0.0052)

Report Time: 1.16s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131021/7e5a9317/attachment.html>


More information about the llvm-testresults mailing list