[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 11 10:25:12 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16219?compare_to=16215&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16219, Order: 192451, Start Time: 2013-10-11 15:35:09, End Time: 2013-10-11 17:28:16
      To: 16215, Order: 192445, Start Time: 2013-10-11 13:22:36, End Time: 2013-10-11 15:13:54
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 32 (49 on baseline)
Performance Improvements: 4 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1071 (1045 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 51.72% (0.2415 => 0.3664, std.dev.: 0.0331)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 50.47% (0.6824 => 1.0268, std.dev.: 0.0780)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 45.75% (0.5786 => 0.8433, std.dev.: 0.0630)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.40% (1.4384 => 2.0052, std.dev.: 0.0723)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 38.30% (1.1289 => 1.5613, std.dev.: 0.0254)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 36.61% (0.7413 => 1.0127, std.dev.: 0.0577)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 34.34% (0.6945 => 0.9330, std.dev.: 0.0849)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 28.67% (1.4933 => 1.9214, std.dev.: 0.0257)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 27.97% (1.6388 => 2.0972, std.dev.: 0.0695)
  MultiSource/Benchmarks/Bullet/bullet: 17.60% (33.3921 => 39.2675, std.dev.: 0.4674)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.37% (0.3964 => 0.4613, std.dev.: 0.0219)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.48% (45.0324 => 52.0038, std.dev.: 1.0022)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.67% (25.1492 => 28.8391, std.dev.: 0.1222)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.42% (1.2431 => 1.3354, std.dev.: 0.0221)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.48% (1.1203 => 1.1817, std.dev.: 0.0174)
  MultiSource/Applications/spiff/spiff: 2.34% (0.9091 => 0.9304, std.dev.: 0.0025)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 51.74% (0.0288 => 0.0437, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 46.06% (0.0584 => 0.0853, std.dev.: 0.0029)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 39.72% (2.3978 => 3.3502, std.dev.: 0.0304)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 39.61% (0.0669 => 0.0934, std.dev.: 0.0040)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.43% (9.6042 => 11.2784, std.dev.: 0.0315)
  MultiSource/Benchmarks/Bullet/bullet: 10.10% (7.0733 => 7.7879, std.dev.: 0.0243)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.18% (0.5087 => 0.5554, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/health/health: 6.81% (0.3303 => 0.3528, std.dev.: 0.0032)
  MultiSource/Applications/spiff/spiff: 5.08% (2.8362 => 2.9802, std.dev.: 0.0162)
  SingleSource/Benchmarks/Shootout/lists: 3.66% (7.2481 => 7.5135, std.dev.: 0.0092)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.73% (3.5638 => 3.6610, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.58% (5.7036 => 5.8507, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.36% (5.0942 => 5.2142, std.dev.: 0.0243)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.80% (2.5091 => 2.5543, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/fib2: 1.32% (3.6069 => 3.6546, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.16% (3.1609 => 3.1976, std.dev.: 0.0127)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-8: -26.82% (0.0384 => 0.0281, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -12.44% (22.7103 => 19.8850, std.dev.: 0.8778)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.71% (3.0572 => 2.8521, std.dev.: 0.0287)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.55% (1.6951 => 1.6519, std.dev.: 0.0161)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.68% (0.1357 => 0.1407, std.dev.: 0.0225)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 56.92% (0.2335 => 0.3664, std.dev.: 0.0331)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 55.18% (0.6617 => 1.0268, std.dev.: 0.0780)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 50.35% (0.5609 => 0.8433, std.dev.: 0.0630)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.81% (1.4041 => 2.0052, std.dev.: 0.0723)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 42.78% (1.0935 => 1.5613, std.dev.: 0.0254)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 35.85% (0.6868 => 0.9330, std.dev.: 0.0849)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 35.73% (0.7461 => 1.0127, std.dev.: 0.0577)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 30.69% (1.6047 => 2.0972, std.dev.: 0.0695)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 30.30% (1.4746 => 1.9214, std.dev.: 0.0257)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.70% (0.3822 => 0.4613, std.dev.: 0.0219)
  MultiSource/Benchmarks/Bullet/bullet: 19.88% (32.7552 => 39.2675, std.dev.: 0.4674)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.44% (44.2807 => 52.0038, std.dev.: 1.0022)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 17.17% (24.6139 => 28.8391, std.dev.: 0.1222)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 13.57% (1.4792 => 1.6800, std.dev.: 0.0770)
  MultiSource/Applications/sqlite3/sqlite3: 12.79% (16.2888 => 18.3728, std.dev.: 0.6481)
  MultiSource/Applications/kimwitu++/kc: 12.02% (18.3608 => 20.5676, std.dev.: 0.7754)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.39% (1.2695 => 1.4141, std.dev.: 0.0555)
  MultiSource/Applications/ClamAV/clamscan: 11.08% (16.5398 => 18.3720, std.dev.: 0.5930)
  MultiSource/Applications/SIBsim4/SIBsim4: 9.78% (1.5333 => 1.6833, std.dev.: 0.0471)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.90% (1.0952 => 1.1817, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.73% (1.2639 => 1.3616, std.dev.: 0.0325)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.80% (1.2622 => 1.3354, std.dev.: 0.0221)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.68% (0.3328 => 0.3517, std.dev.: 0.0068)
  MultiSource/Applications/oggenc/oggenc: 5.52% (5.3339 => 5.6281, std.dev.: 0.0728)
  MultiSource/Applications/spiff/spiff: 4.41% (0.8911 => 0.9304, std.dev.: 0.0025)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.72% (7.6426 => 12.5890, std.dev.: 0.0518)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 51.21% (0.0289 => 0.0437, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 45.07% (0.0588 => 0.0853, std.dev.: 0.0029)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 43.25% (0.0652 => 0.0934, std.dev.: 0.0040)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 39.53% (2.4010 => 3.3502, std.dev.: 0.0304)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 19.24% (9.4586 => 11.2784, std.dev.: 0.0315)
  MultiSource/Benchmarks/Bullet/bullet: 10.73% (7.0333 => 7.7879, std.dev.: 0.0243)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.18% (0.5182 => 0.5554, std.dev.: 0.0020)
  SingleSource/UnitTests/Vector/multiplies: 6.62% (0.5561 => 0.5929, std.dev.: 0.0050)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.30% (8.1346 => 8.6468, std.dev.: 0.0631)
  MultiSource/Applications/spiff/spiff: 5.70% (2.8194 => 2.9802, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.31% (6.5990 => 6.9495, std.dev.: 0.1147)
  MultiSource/Benchmarks/Olden/health/health: 4.04% (0.3391 => 0.3528, std.dev.: 0.0032)
  MultiSource/Applications/hexxagon/hexxagon: 3.05% (14.7810 => 15.2323, std.dev.: 0.1698)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.73% (5.6951 => 5.8507, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.28% (5.0980 => 5.2142, std.dev.: 0.0243)
  SingleSource/Benchmarks/Shootout/lists: 1.94% (7.3703 => 7.5135, std.dev.: 0.0092)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.79% (1.8519 => 1.8850, std.dev.: 0.0072)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.74% (3.5683 => 3.6305, std.dev.: 0.0201)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.62% (16.7972 => 17.0686, std.dev.: 0.0127)
  SingleSource/Benchmarks/Shootout/fib2: 1.61% (3.5966 => 3.6546, std.dev.: 0.0081)
  SingleSource/Benchmarks/Shootout/methcall: 1.40% (8.5434 => 8.6631, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.29% (3.1569 => 3.1976, std.dev.: 0.0127)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.07% (3.8582 => 3.8996, std.dev.: 0.0133)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -51.99% (0.5226 => 0.2509, std.dev.: 0.0639)
  MultiSource/Applications/sgefa/sgefa: -47.04% (1.5790 => 0.8363, std.dev.: 0.0330)
  SingleSource/Benchmarks/Linpack/linpack-pc: -19.73% (57.2347 => 45.9400, std.dev.: 3.0858)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.49% (15.9508 => 13.3211, std.dev.: 0.2881)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.68% (20.8247 => 18.3927, std.dev.: 0.1703)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.32% (3.4956 => 3.1348, std.dev.: 0.0368)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.75% (50.0284 => 46.1535, std.dev.: 0.3398)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.68% (3.0561 => 2.8521, std.dev.: 0.0287)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.14% (2.5938 => 2.4863, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.95% (17.1431 => 16.6382, std.dev.: 0.1541)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.21% (3.7437 => 3.6610, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.91% (3.5642 => 3.4962, std.dev.: 0.0121)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.4471 => 2.4146, std.dev.: 0.0087)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.38% (0.1348 => 0.1407, std.dev.: 0.0225)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131011/8e1f0688/attachment.html>


More information about the llvm-testresults mailing list