[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 11 01:27:17 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16206?compare_to=16202&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16206, Order: 192421, Start Time: 2013-10-11 06:46:47, End Time: 2013-10-11 08:30:23
      To: 16202, Order: 192417, Start Time: 2013-10-11 04:37:22, End Time: 2013-10-11 06:25:43
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 27 (58 on baseline)
Performance Improvements: 3 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1077 (1034 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 1.46% (16.6791 => 16.9227, std.dev.: 0.0787)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.35% (0.9967 => 1.0102, std.dev.: 0.0008)
  MultiSource/Applications/lemon/lemon: 1.30% (1.2090 => 1.2247, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.27% (4.9153 => 4.9775, std.dev.: 0.0236)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 53.97% (1.6956 => 2.6108, std.dev.: 0.0006)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.80% (1.1076 => 1.2161, std.dev.: 0.0005)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 9.44% (0.4628 => 0.5065, std.dev.: 0.0003)
  MultiSource/Applications/JM/lencod/lencod: 8.40% (7.8401 => 8.4989, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.13% (3.5767 => 3.8675, std.dev.: 0.0013)
  MultiSource/Applications/aha/aha: 5.58% (3.5730 => 3.7723, std.dev.: 0.0627)
  MultiSource/Benchmarks/sim/sim: 5.57% (3.8529 => 4.0674, std.dev.: 0.0048)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (1.0153 => 1.0689, std.dev.: 0.0005)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (3.4760 => 3.6242, std.dev.: 0.0038)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.72% (1.2510 => 1.2975, std.dev.: 0.0063)
  MultiSource/Benchmarks/llubenchmark/llu: 2.53% (1.9693 => 2.0191, std.dev.: 0.0054)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.34% (5.5178 => 5.6468, std.dev.: 0.0107)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (2.4951 => 2.5422, std.dev.: 0.0015)
  MultiSource/Applications/sqlite3/sqlite3: 1.88% (4.2831 => 4.3638, std.dev.: 0.0027)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.85% (2.4977 => 2.5438, std.dev.: 0.0025)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.77% (18.3654 => 18.6899, std.dev.: 0.0374)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.75% (23.4222 => 23.8310, std.dev.: 0.0100)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (4.2439 => 4.3145, std.dev.: 0.0250)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.47% (5.9277 => 6.0147, std.dev.: 0.0075)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.23% (43.4592 => 43.9952, std.dev.: 0.0943)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 1.21% (1.1292 => 1.1429, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.21% (3.5437 => 3.5866, std.dev.: 0.0063)
  MultiSource/Applications/minisat/minisat: 1.01% (6.3170 => 6.3810, std.dev.: 0.0160)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.18% (1.6256 => 1.6064, std.dev.: 0.0063)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.04% (0.4441 => 0.4217, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/lists: -2.28% (16.3139 => 15.9415, std.dev.: 0.1115)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.90% (0.1286 => 0.1349, std.dev.: 0.0019)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.55% (2.6492 => 2.7963, std.dev.: 0.0089)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.92% (0.8014 => 0.8328, std.dev.: 0.0010)
  MultiSource/Applications/sqlite3/sqlite3: 3.89% (16.2888 => 16.9227, std.dev.: 0.0787)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.40% (0.4624 => 0.4781, std.dev.: 0.0030)
  MultiSource/Applications/lemon/lemon: 3.25% (1.1862 => 1.2247, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.03% (1.2932 => 1.3324, std.dev.: 0.0107)
  MultiSource/Applications/JM/lencod/lencod: 2.91% (16.5902 => 17.0731, std.dev.: 0.0199)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 2.86% (0.3707 => 0.3813, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.9828 => 1.0102, std.dev.: 0.0008)
  MultiSource/Applications/kimwitu++/kc: 2.74% (18.3608 => 18.8647, std.dev.: 0.1500)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.64% (9.9903 => 10.2536, std.dev.: 0.0757)
  MultiSource/Applications/SPASS/SPASS: 2.60% (16.1646 => 16.5856, std.dev.: 0.0570)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.56% (7.2661 => 7.4519, std.dev.: 0.0058)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.55% (1.2728 => 1.3052, std.dev.: 0.0074)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.42% (1.5333 => 1.5704, std.dev.: 0.0041)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.41% (0.5185 => 0.5310, std.dev.: 0.0035)
  MultiSource/Applications/oggenc/oggenc: 2.30% (5.3339 => 5.4565, std.dev.: 0.0013)
  MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.4026 => 7.5720, std.dev.: 0.0228)
  MultiSource/Applications/Burg/burg: 2.29% (1.3994 => 1.4314, std.dev.: 0.0072)
  MultiSource/Applications/minisat/minisat: 2.29% (0.7439 => 0.7609, std.dev.: 0.0018)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.12% (1.1393 => 1.1634, std.dev.: 0.0071)
  MultiSource/Applications/treecc/treecc: 2.07% (2.2516 => 2.2983, std.dev.: 0.0155)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.05% (1.0756 => 1.0976, std.dev.: 0.0008)
  MultiSource/Applications/d/make_dparser: 2.04% (3.4962 => 3.5675, std.dev.: 0.0116)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.01% (4.5883 => 4.6803, std.dev.: 0.0335)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 1.82% (0.5609 => 0.5711, std.dev.: 0.0021)
  MultiSource/Applications/lua/lua: 1.75% (4.2242 => 4.2981, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.71% (1.2550 => 1.2764, std.dev.: 0.0073)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.49% (5.5014 => 5.5835, std.dev.: 0.0210)
  MultiSource/Applications/ClamAV/clamscan: 1.49% (16.5398 => 16.7862, std.dev.: 0.0440)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.27% (1.4746 => 1.4934, std.dev.: 0.0065)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.23% (1.4041 => 1.4214, std.dev.: 0.0032)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.72% (7.6426 => 12.5891, std.dev.: 1.2034)
  SingleSource/Benchmarks/Misc/pi: 57.52% (1.6574 => 2.6108, std.dev.: 0.0006)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.42% (1.1013 => 1.2161, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.79% (3.5550 => 3.8675, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.01% (1.2516 => 1.3518, std.dev.: 0.0004)
  MultiSource/Applications/obsequi/Obsequi: 7.48% (2.1884 => 2.3520, std.dev.: 0.0037)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0104)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (8.1346 => 8.6421, std.dev.: 0.0129)
  MultiSource/Benchmarks/sim/sim: 6.17% (3.8312 => 4.0674, std.dev.: 0.0048)
  MultiSource/Applications/aha/aha: 5.57% (3.5731 => 3.7723, std.dev.: 0.0627)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.12% (5.3716 => 5.6468, std.dev.: 0.0107)
  MultiSource/Applications/JM/lencod/lencod: 3.92% (8.1785 => 8.4989, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.59% (0.2842 => 0.2944, std.dev.: 0.0002)
  SingleSource/Benchmarks/McGill/misr: 3.02% (0.3771 => 0.3885, std.dev.: 0.0038)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.02% (2.1472 => 2.2121, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.42% (5.4925 => 5.6255, std.dev.: 0.0401)
  MultiSource/Benchmarks/Olden/power/power: 2.38% (1.2170 => 1.2460, std.dev.: 0.0002)
  MultiSource/Applications/sqlite3/sqlite3: 2.12% (4.2733 => 4.3638, std.dev.: 0.0027)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (2.4920 => 2.5438, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.08% (1.5940 => 1.6271, std.dev.: 0.0082)
  SingleSource/Regression/C/uint64_to_float: 1.99% (1.4528 => 1.4817, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (5.3022 => 5.4048, std.dev.: 0.0336)
  MultiSource/Applications/minisat/minisat: 1.67% (6.2760 => 6.3810, std.dev.: 0.0160)
  MultiSource/Applications/siod/siod: 1.55% (3.5310 => 3.5859, std.dev.: 0.0210)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.54% (23.4704 => 23.8310, std.dev.: 0.0100)
  MultiSource/Benchmarks/llubenchmark/llu: 1.52% (1.9889 => 2.0191, std.dev.: 0.0054)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.50% (0.1483 => 0.1179, std.dev.: 0.0107)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.42% (0.1956 => 0.1850, std.dev.: 0.0010)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.17% (0.5226 => 0.2343, std.dev.: 0.0036)
  MultiSource/Applications/sgefa/sgefa: -47.06% (1.5790 => 0.8360, std.dev.: 0.0026)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.13% (57.2347 => 43.9952, std.dev.: 0.0943)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.57% (15.9508 => 12.9884, std.dev.: 0.1128)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.25% (20.8247 => 18.6899, std.dev.: 0.0374)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0000)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.98% (3.4956 => 3.2166, std.dev.: 0.0864)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.37% (50.0284 => 46.3391, std.dev.: 0.1528)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.83% (0.3501 => 0.3332, std.dev.: 0.0014)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.65% (0.6563 => 0.6258, std.dev.: 0.0111)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.19% (3.7437 => 3.6242, std.dev.: 0.0038)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.99% (2.5938 => 2.5422, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.49% (5.4473 => 5.3664, std.dev.: 0.0291)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1348 => 0.1349, std.dev.: 0.0019)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131011/217d9c57/attachment.html>


More information about the llvm-testresults mailing list