[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Sep 25 09:21:41 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15656?compare_to=15652&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15656, Order: 191370, Start Time: 2013-09-25 14:32:34, End Time: 2013-09-25 16:24:28
      To: 15652, Order: 191369, Start Time: 2013-09-25 12:23:10, End Time: 2013-09-25 14:06:39
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 41 (56 on baseline)
Performance Improvements: 11 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1055 (1038 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 68.70% (0.1016 => 0.1714, std.dev.: 0.0116)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 57.44% (0.1687 => 0.2656, std.dev.: 0.0133)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 53.66% (0.1763 => 0.2709, std.dev.: 0.0261)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 37.65% (0.7118 => 0.9798, std.dev.: 0.0380)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 34.59% (1.1557 => 1.5554, std.dev.: 0.0646)
  SingleSource/Regression/C/uint64_to_float: 33.33% (0.0315 => 0.0420, std.dev.: 0.0023)
  MultiSource/Applications/obsequi/Obsequi: 31.57% (1.1655 => 1.5335, std.dev.: 0.1202)
  MultiSource/Applications/lua/lua: 31.43% (4.2679 => 5.6093, std.dev.: 0.2140)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.91% (0.1039 => 0.1277, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 21.57% (9.8218 => 11.9408, std.dev.: 0.4987)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 17.05% (1.2772 => 1.4950, std.dev.: 0.0029)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.32% (0.7084 => 0.8240, std.dev.: 0.0339)
  MultiSource/Applications/kimwitu++/kc: 15.17% (18.7206 => 21.5598, std.dev.: 0.7383)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.34% (1.3373 => 1.4889, std.dev.: 0.0540)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.10% (2.5873 => 2.8486, std.dev.: 0.0548)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.01% (1.3241 => 1.4566, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.77% (1.2667 => 1.3904, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.33% (1.2342 => 1.3494, std.dev.: 0.0381)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.99% (1.2135 => 1.3226, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.66% (1.2634 => 1.3728, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.99% (1.3192 => 1.3718, std.dev.: 0.0172)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 81.44% (0.7361 => 1.3356, std.dev.: 0.0358)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 37.75% (1.3068 => 1.8001, std.dev.: 0.0170)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 37.35% (0.0514 => 0.0706, std.dev.: 0.0042)
  MultiSource/Applications/minisat/minisat: 33.84% (6.3563 => 8.5072, std.dev.: 0.2530)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 32.91% (0.0860 => 0.1143, std.dev.: 0.0079)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.82% (0.0423 => 0.0528, std.dev.: 0.0022)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.49% (1.2974 => 1.5892, std.dev.: 0.0236)
  MultiSource/Benchmarks/llubenchmark/llu: 20.88% (1.9626 => 2.3724, std.dev.: 0.0747)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.28% (9.4493 => 10.5152, std.dev.: 0.1960)
  MultiSource/Applications/obsequi/Obsequi: 10.64% (2.3524 => 2.6027, std.dev.: 0.0536)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.88% (5.9595 => 6.3698, std.dev.: 0.1114)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.75% (4.1011 => 4.3371, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.72% (5.9009 => 6.2387, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.68% (4.5739 => 4.7878, std.dev.: 0.0310)
  MultiSource/Applications/lua/lua: 4.40% (29.6206 => 30.9239, std.dev.: 0.3170)
  MultiSource/Applications/sqlite3/sqlite3: 2.74% (4.3664 => 4.4860, std.dev.: 0.0180)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.69% (5.0308 => 5.1663, std.dev.: 0.0449)
  MultiSource/Applications/aha/aha: 2.44% (3.6915 => 3.7816, std.dev.: 0.0039)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.22% (45.9882 => 47.0108, std.dev.: 0.2407)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.58% (6.7133 => 6.8192, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/ReedSolomon: -13.36% (9.8062 => 8.4959, std.dev.: 0.2955)
  MultiSource/Applications/JM/lencod/lencod: -8.99% (8.4338 => 7.6752, std.dev.: 0.0774)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.54% (3.0560 => 2.8560, std.dev.: 0.0512)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.32% (0.4887 => 0.4627, std.dev.: 0.0095)
  MultiSource/Benchmarks/sim/sim: -4.85% (4.0608 => 3.8638, std.dev.: 0.0529)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.18% (2.2130 => 2.1204, std.dev.: 0.0236)
  SingleSource/Benchmarks/Shootout/lists: -4.12% (7.5027 => 7.1934, std.dev.: 0.1122)
  MultiSource/Applications/hexxagon/hexxagon: -3.74% (15.7623 => 15.1721, std.dev.: 0.0975)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.39% (1.2176 => 1.1763, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.54% (4.1352 => 4.0300, std.dev.: 0.0099)
  MultiSource/Benchmarks/nbench/nbench: -2.04% (22.6698 => 22.2079, std.dev.: 0.1137)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.81% (0.1352 => 0.1363, std.dev.: 0.0376)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 69.20% (0.1013 => 0.1714, std.dev.: 0.0116)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 60.29% (0.1657 => 0.2656, std.dev.: 0.0133)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 56.05% (0.1736 => 0.2709, std.dev.: 0.0261)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 39.24% (0.7037 => 0.9798, std.dev.: 0.0380)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 36.52% (1.1393 => 1.5554, std.dev.: 0.0646)
  MultiSource/Applications/lua/lua: 32.79% (4.2242 => 5.6093, std.dev.: 0.2140)
  MultiSource/Applications/obsequi/Obsequi: 32.76% (1.1551 => 1.5335, std.dev.: 0.1202)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.71% (0.1024 => 0.1277, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 22.65% (9.7354 => 11.9408, std.dev.: 0.4987)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.09% (1.2660 => 1.4950, std.dev.: 0.0029)
  MultiSource/Applications/kimwitu++/kc: 17.42% (18.3608 => 21.5598, std.dev.: 0.7383)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.70% (0.7184 => 0.8240, std.dev.: 0.0339)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.50% (1.3235 => 1.4889, std.dev.: 0.0540)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.52% (1.2468 => 1.3904, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.04% (1.2152 => 1.3494, std.dev.: 0.0381)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.00% (1.3123 => 1.4566, std.dev.: 0.0326)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.99% (2.5666 => 2.8486, std.dev.: 0.0548)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.91% (1.3514 => 1.4989, std.dev.: 0.0544)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.48% (1.3278 => 1.4669, std.dev.: 0.0505)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.15% (1.2007 => 1.3226, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.76% (1.2622 => 1.3728, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.48% (1.4304 => 1.5231, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.08% (1.2932 => 1.3718, std.dev.: 0.0172)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.99% (1.9476 => 2.0059, std.dev.: 0.0128)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 80.24% (0.7410 => 1.3356, std.dev.: 0.0358)
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.19% (7.6426 => 12.5485, std.dev.: 0.0622)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 42.05% (0.0497 => 0.0706, std.dev.: 0.0042)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 36.96% (1.3143 => 1.8001, std.dev.: 0.0170)
  MultiSource/Applications/minisat/minisat: 35.55% (6.2760 => 8.5072, std.dev.: 0.2530)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 32.44% (0.0863 => 0.1143, std.dev.: 0.0079)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.17% (1.3008 => 1.5892, std.dev.: 0.0236)
  MultiSource/Benchmarks/llubenchmark/llu: 19.28% (1.9889 => 2.3724, std.dev.: 0.0747)
  MultiSource/Applications/obsequi/Obsequi: 18.93% (2.1884 => 2.6027, std.dev.: 0.0536)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.17% (9.4586 => 10.5152, std.dev.: 0.1960)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 6.81% (1.1013 => 1.1763, std.dev.: 0.0153)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0005)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.26% (8.1346 => 8.6441, std.dev.: 0.0666)
  MultiSource/Benchmarks/BitBench/five11/five11: 6.03% (5.3716 => 5.6955, std.dev.: 0.0295)
  MultiSource/Applications/aha/aha: 5.84% (3.5731 => 3.7816, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.75% (4.1011 => 4.3371, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.63% (5.9061 => 6.2387, std.dev.: 0.0115)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.56% (0.1871 => 0.1975, std.dev.: 0.0010)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.51% (96.7834 => 102.1147, std.dev.: 1.0690)
  MultiSource/Applications/sqlite3/sqlite3: 4.98% (4.2733 => 4.4860, std.dev.: 0.0180)
  MultiSource/Applications/lua/lua: 4.76% (29.5202 => 30.9239, std.dev.: 0.3170)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.67% (4.5744 => 4.7878, std.dev.: 0.0310)
  MultiSource/Applications/siod/siod: 2.94% (3.5310 => 3.6348, std.dev.: 0.0378)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.73% (5.0288 => 5.1663, std.dev.: 0.0449)
  MultiSource/Applications/hexxagon/hexxagon: 2.65% (14.7810 => 15.1721, std.dev.: 0.0975)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.08% (1.7652 => 1.8020, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.66% (3.5683 => 3.6277, std.dev.: 0.0177)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.55% (1.5940 => 1.6187, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout/methcall: 1.45% (8.5434 => 8.6671, std.dev.: 0.0094)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.20% (2.4920 => 2.5218, std.dev.: 0.0107)
  SingleSource/Benchmarks/Shootout/fib2: 1.19% (3.5966 => 3.6394, std.dev.: 0.0080)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.13% (6.7429 => 6.8192, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -51.82% (0.5226 => 0.2518, std.dev.: 0.0230)
  MultiSource/Applications/sgefa/sgefa: -46.79% (1.5790 => 0.8402, std.dev.: 0.0281)
  SingleSource/Benchmarks/Linpack/linpack-pc: -38.98% (57.2347 => 34.9241, std.dev.: 3.9249)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.85% (15.9508 => 13.4221, std.dev.: 0.4572)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.68% (20.8247 => 18.6007, std.dev.: 0.1093)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.64% (3.4956 => 3.1238, std.dev.: 0.0428)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.55% (3.0561 => 2.8560, std.dev.: 0.0512)
  MultiSource/Applications/JM/lencod/lencod: -6.15% (8.1785 => 7.6752, std.dev.: 0.0774)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.03% (50.0284 => 47.0108, std.dev.: 0.2407)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.96% (2.5938 => 2.4912, std.dev.: 0.0064)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.89% (3.7437 => 3.6354, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.33% (17.1431 => 16.7435, std.dev.: 0.0655)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.51% (2.4471 => 2.4102, std.dev.: 0.0071)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1348 => 0.1363, std.dev.: 0.0376)

Report Time: 1.25s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130925/a15b94f3/attachment.html>


More information about the llvm-testresults mailing list