[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 2 10:30:00 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15897?compare_to=15894&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15897, Order: 191831, Start Time: 2013-10-02 15:40:41, End Time: 2013-10-02 17:32:55
      To: 15894, Order: 191818, Start Time: 2013-10-02 13:26:09, End Time: 2013-10-02 15:15:09
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 32 (41 on baseline)
Performance Improvements: 3 (12 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1072 (1054 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 82.75% (0.0371 => 0.0678, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 43.23% (0.3317 => 0.4751, std.dev.: 0.0414)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 41.40% (0.1657 => 0.2343, std.dev.: 0.0088)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.94% (1.9099 => 2.3098, std.dev.: 0.0804)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 18.69% (1.2421 => 1.4742, std.dev.: 0.0581)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 13.18% (1.2938 => 1.4643, std.dev.: 0.0372)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.57% (1.2301 => 1.3847, std.dev.: 0.0250)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.78% (1.3166 => 1.4717, std.dev.: 0.0367)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.46% (1.2391 => 1.3811, std.dev.: 0.0358)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.69% (1.4450 => 1.5994, std.dev.: 0.0351)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.36% (1.2330 => 1.3608, std.dev.: 0.0352)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 10.13% (1.4734 => 1.6226, std.dev.: 0.0305)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.07% (25.1731 => 27.7089, std.dev.: 0.3143)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.21% (1.2768 => 1.3944, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.09% (1.3064 => 1.4252, std.dev.: 0.0205)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.17% (0.3402 => 0.3510, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.6475 => 0.6619, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 63.30% (0.0575 => 0.0939, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.78% (1.4821 => 1.8790, std.dev.: 0.0081)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 10.82% (3.5721 => 3.9585, std.dev.: 0.1422)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.08% (13.0016 => 13.7922, std.dev.: 0.0873)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 5.50% (39.4164 => 41.5861, std.dev.: 0.1879)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.46% (4.1039 => 4.3281, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.03% (4.5733 => 4.8035, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.82% (5.9019 => 6.1861, std.dev.: 0.0672)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.52% (3.5018 => 3.6600, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.44% (6.6502 => 6.8789, std.dev.: 0.0636)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.99% (3.5284 => 3.6339, std.dev.: 0.0224)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.69% (2.4873 => 2.5543, std.dev.: 0.0027)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.23% (1.8332 => 1.8741, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.46% (3.5693 => 3.6215, std.dev.: 0.0063)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.01% (8.8923 => 8.9819, std.dev.: 0.0220)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -9.36% (0.4799 => 0.4350, std.dev.: 0.0134)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.77% (2.6340 => 2.5348, std.dev.: 0.0267)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.66% (5.6406 => 5.4343, std.dev.: 0.0568)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.44% (0.1354 => 0.1321, std.dev.: 0.0361)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 84.24% (0.0368 => 0.0678, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 53.46% (0.3096 => 0.4751, std.dev.: 0.0414)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 42.17% (0.1648 => 0.2343, std.dev.: 0.0088)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 23.03% (1.8775 => 2.3098, std.dev.: 0.0804)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 16.80% (1.2622 => 1.4742, std.dev.: 0.0581)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 13.49% (1.2201 => 1.3847, std.dev.: 0.0250)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.57% (24.6139 => 27.7089, std.dev.: 0.3143)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 12.15% (1.3123 => 1.4717, std.dev.: 0.0367)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.05% (1.3068 => 1.4643, std.dev.: 0.0372)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.81% (1.4304 => 1.5994, std.dev.: 0.0351)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.22% (1.2235 => 1.3608, std.dev.: 0.0352)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.14% (1.4599 => 1.6226, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.79% (1.3036 => 1.4443, std.dev.: 0.0545)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.50% (1.2499 => 1.3811, std.dev.: 0.0358)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.21% (1.2652 => 1.3944, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.07% (1.2948 => 1.4252, std.dev.: 0.0205)
  MultiSource/Benchmarks/Bullet/bullet: 8.78% (32.7552 => 35.6308, std.dev.: 0.9194)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.03% (0.3374 => 0.3510, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.87% (0.5609 => 0.5826, std.dev.: 0.0035)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.11% (0.9494 => 0.9789, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C/football/football: 3.04% (0.9828 => 1.0127, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.80% (0.6439 => 0.6619, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (1.0935 => 1.1178, std.dev.: 0.0049)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.71% (7.6426 => 12.5116, std.dev.: 0.0510)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 63.02% (0.0576 => 0.0939, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.70% (1.4830 => 1.8790, std.dev.: 0.0081)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.49% (0.1374 => 0.1628, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/multiplies: 6.62% (0.5561 => 0.5929, std.dev.: 0.0044)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.22% (8.1346 => 8.6405, std.dev.: 0.0433)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.54% (4.1011 => 4.3281, std.dev.: 0.0118)
  SingleSource/Benchmarks/McGill/misr: 5.20% (0.3771 => 0.3967, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.01% (4.5744 => 4.8035, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.74% (5.9061 => 6.1861, std.dev.: 0.0672)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.24% (6.5990 => 6.8789, std.dev.: 0.0636)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.09% (39.9519 => 41.5861, std.dev.: 0.1879)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.3836 => 0.3954, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.69% (3.5642 => 3.6600, std.dev.: 0.0368)
  MultiSource/Benchmarks/Olden/power/power: 2.46% (1.2170 => 1.2469, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.75% (3.5592 => 3.6215, std.dev.: 0.0063)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.15% (8.8798 => 8.9819, std.dev.: 0.0220)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.07% (16.7972 => 16.9775, std.dev.: 0.0677)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.50% (0.5226 => 0.2378, std.dev.: 0.0051)
  MultiSource/Applications/sgefa/sgefa: -46.71% (1.5790 => 0.8414, std.dev.: 0.0334)
  SingleSource/Benchmarks/Linpack/linpack-pc: -25.29% (57.2347 => 42.7614, std.dev.: 4.5088)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.53% (15.9508 => 13.7922, std.dev.: 0.0873)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.24% (20.8247 => 18.4833, std.dev.: 0.1120)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.49% (3.4956 => 3.1290, std.dev.: 0.0426)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.26% (50.0284 => 46.3968, std.dev.: 0.2174)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.47% (2.5938 => 2.4779, std.dev.: 0.0330)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.93% (3.7437 => 3.6339, std.dev.: 0.0224)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.81% (17.1431 => 16.6613, std.dev.: 0.0136)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.11% (2.4471 => 2.3955, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.84% (6.0128 => 5.9021, std.dev.: 0.0427)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.00% (0.1348 => 0.1321, std.dev.: 0.0361)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131002/70505b49/attachment.html>


More information about the llvm-testresults mailing list