[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jul 27 14:37:13 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13830?compare_to=13827&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13830, Order: 187309, Start Time: 2013-07-27 19:54:31, End Time: 2013-07-27 21:38:53
      To: 13827, Order: 187306, Start Time: 2013-07-27 16:54:39, End Time: 2013-07-27 18:35:45
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 2 (2 on baseline)
Performance Regressions: 7 (17 on baseline)
Performance Improvements: 0 (84 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1098 (1004 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

New Failures - Compile Time
---------------------------
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/sqlite3/sqlite3: 5.67% (17.4018 => 18.3878, std.dev.: 1.4108)

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.3265 => 0.0000)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 23.21% (0.0448 => 0.0552, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/em3d/em3d: 7.31% (4.8162 => 5.1682, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.63% (0.3290 => 0.3508, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.51% (5.0006 => 5.2760, std.dev.: 0.0171)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 5.32% (4.0140 => 4.2276, std.dev.: 0.0134)
  SingleSource/Benchmarks/Misc/flops: 4.35% (9.5074 => 9.9209, std.dev.: 0.0220)
  SingleSource/Benchmarks/Misc/salsa20: 3.53% (8.6665 => 8.9728, std.dev.: 0.0054)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.57% (0.1341 => 0.1320, std.dev.: 0.0246)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Compile Time
---------------------------
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/sqlite3/sqlite3: -4.05% (19.1635 => 18.3878, std.dev.: 1.4108)

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.3833 => 0.0000)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.56% (2.8867 => 4.2885, std.dev.: 0.0334)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.78% (0.0341 => 0.0463, std.dev.: 0.0008)
  MultiSource/Applications/siod/siod: 13.41% (3.3761 => 3.8287, std.dev.: 0.0521)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9476, std.dev.: 0.0012)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.96% (48.3256 => 52.1717, std.dev.: 0.0450)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.87% (3.2027 => 3.4226, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.81% (5.3042 => 5.6123, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.68% (3.4085 => 3.6020, std.dev.: 0.0470)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.44% (5.5008 => 5.7998, std.dev.: 0.0997)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.3151 => 4.4974, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.18% (5.1471 => 5.3620, std.dev.: 0.0769)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.68% (3.3384 => 3.4613, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.91% (4.8739 => 5.0157, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.81% (3.3464 => 3.4071, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/flops: 1.58% (9.7664 => 9.9209, std.dev.: 0.0220)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.29% (3.0680 => 3.1077, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.12% (4.9040 => 4.9591, std.dev.: 0.0001)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.90% (0.2237 => 0.1434, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.40% (0.1072 => 0.0714, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/tsp/tsp: -25.14% (0.1818 => 0.1361, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -24.37% (0.0439 => 0.0332, std.dev.: 0.0007)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.96% (6.0938 => 4.6949, std.dev.: 0.0131)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -19.57% (0.1518 => 0.1221, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/em3d/em3d: -16.69% (0.2367 => 0.1972, std.dev.: 0.0025)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.33% (0.7091 => 0.6146, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -12.25% (0.1870 => 0.1641, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -11.88% (0.3073 => 0.2708, std.dev.: 0.0048)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.92% (1.1012 => 0.9810, std.dev.: 0.0119)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.81% (0.3655 => 0.3260, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.52% (1.7797 => 1.5924, std.dev.: 0.0013)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -9.21% (0.2498 => 0.2268, std.dev.: 0.0018)
  MultiSource/Benchmarks/Olden/bh/bh: -8.02% (0.3603 => 0.3314, std.dev.: 0.0041)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.68% (1.7461 => 1.6120, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.25% (1.5345 => 1.4232, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.19% (1.4514 => 1.3470, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.17% (1.5144 => 1.4058, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.01% (1.5426 => 1.4345, std.dev.: 0.0026)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.63% (2.6853 => 2.5073, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.47% (1.5815 => 1.4791, std.dev.: 0.0004)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.46% (6.1631 => 5.7651, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.33% (1.6226 => 1.5199, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.32% (1.4794 => 1.3859, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.02% (1.5239 => 1.4322, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (1.4333 => 1.3506, std.dev.: 0.0129)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.70% (27.6418 => 26.0661, std.dev.: 0.0596)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.60% (1.5437 => 1.4573, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.35% (1.4853 => 1.4059, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.01% (1.4940 => 1.4191, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.01% (1.5361 => 1.4591, std.dev.: 0.0158)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.98% (5.2851 => 5.0219, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.93% (1.4166 => 1.3467, std.dev.: 0.0133)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.91% (0.2385 => 0.2268, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.78% (1.4721 => 1.4018, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.74% (1.4339 => 1.3660, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.70% (1.4506 => 1.3824, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.63% (1.4783 => 1.4099, std.dev.: 0.0017)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -4.22% (49.1253 => 47.0527, std.dev.: 0.1714)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.16% (1.5629 => 1.4979, std.dev.: 0.0042)
  MultiSource/Benchmarks/Bullet/bullet: -4.00% (37.4863 => 35.9879, std.dev.: 0.0857)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.99% (1.4947 => 1.4350, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.71% (1.5479 => 1.4904, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.28% (0.7189 => 0.6953, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.06% (1.5357 => 1.4887, std.dev.: 0.0124)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.81% (15.5498 => 15.1124, std.dev.: 0.0273)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.39% (1.5416 => 1.5048, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.36% (1.3649 => 1.3327, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.20% (1.3952 => 1.3645, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.95% (1.5037 => 1.4744, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.81% (1.4179 => 1.3922, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -1.78% (0.5845 => 0.5741, std.dev.: 0.0029)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.61% (0.0345 => 0.0198, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/mst/mst: -36.64% (0.2134 => 0.1352, std.dev.: 0.0026)
  MultiSource/Benchmarks/MallocBench/gs/gs: -34.06% (0.1189 => 0.0784, std.dev.: 0.0034)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.54% (2.1022 => 1.4182, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.00% (0.0816 => 0.0563, std.dev.: 0.0012)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.20% (0.9545 => 0.6758, std.dev.: 0.0663)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.65% (6.9552 => 5.2407, std.dev.: 0.3338)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -16.04% (6.2627 => 5.2580, std.dev.: 0.2072)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.88% (0.3557 => 0.3099, std.dev.: 0.0117)
  MultiSource/Applications/sgefa/sgefa: -12.84% (1.4030 => 1.2229, std.dev.: 0.0009)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.24% (47.2250 => 41.9174, std.dev.: 1.3102)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -11.03% (2.6094 => 2.3215, std.dev.: 0.1063)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -10.83% (2.6992 => 2.4068, std.dev.: 0.0338)
  MultiSource/Applications/lua/lua: -7.96% (31.0707 => 28.5983, std.dev.: 0.8054)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.71% (1.5339 => 1.4309, std.dev.: 0.0273)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.40% (1.7207 => 1.6277, std.dev.: 0.0094)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.99% (0.5173 => 0.4915, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.73% (3.8119 => 3.6315, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.60% (0.7355 => 0.7017, std.dev.: 0.0086)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.92% (2.8052 => 2.6952, std.dev.: 0.0354)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.86% (0.3649 => 0.3508, std.dev.: 0.0030)
  MultiSource/Benchmarks/Bullet/bullet: -3.84% (7.2995 => 7.0192, std.dev.: 0.0544)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.46% (6.0444 => 5.8351, std.dev.: 0.0123)
  MultiSource/Benchmarks/Olden/bh/bh: -3.13% (2.4879 => 2.4101, std.dev.: 0.0222)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.06% (21.6864 => 21.0219, std.dev.: 0.2260)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9610, std.dev.: 0.0290)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.01% (5.2218 => 5.0645, std.dev.: 0.0122)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.93% (1.1024 => 1.0701, std.dev.: 0.0113)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.96% (3.5791 => 3.5091, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.43% (5.8810 => 5.7968, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.36% (4.9231 => 4.8560, std.dev.: 0.0002)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.21% (0.1378 => 0.1320, std.dev.: 0.0246)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130727/37c92f08/attachment.html>


More information about the llvm-testresults mailing list