[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jun 10 16:43:40 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12255?compare_to=12252&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12255, Order: 183695, Start Time: 2013-06-10 21:51:15, End Time: 2013-06-10 23:44:28
      To: 12252, Order: 183688, Start Time: 2013-06-10 19:36:13, End Time: 2013-06-10 21:27:08
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 30 (39 on baseline)
Performance Improvements: 12 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1065 (1050 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 83.70% (0.0184 => 0.0338, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 56.63% (0.0671 => 0.1051, std.dev.: 0.0027)
  MultiSource/Applications/aha/aha: 53.03% (0.1303 => 0.1994, std.dev.: 0.0178)
  MultiSource/Applications/spiff/spiff: 45.25% (0.9342 => 1.3569, std.dev.: 0.1043)
  MultiSource/Applications/Burg/burg: 45.01% (1.4549 => 2.1097, std.dev.: 0.0620)
  MultiSource/Applications/treecc/treecc: 34.37% (2.3298 => 3.1306, std.dev.: 0.0930)
  MultiSource/Applications/sgefa/sgefa: 33.00% (0.4139 => 0.5505, std.dev.: 0.0461)
  MultiSource/Applications/obsequi/Obsequi: 25.75% (1.2616 => 1.5865, std.dev.: 0.1005)
  MultiSource/Applications/ClamAV/clamscan: 24.13% (16.8293 => 20.8896, std.dev.: 0.9879)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 23.54% (1.6722 => 2.0658, std.dev.: 0.0742)
  MultiSource/Applications/JM/ldecod/ldecod: 20.80% (7.4525 => 9.0027, std.dev.: 0.3967)
  MultiSource/Applications/JM/lencod/lencod: 19.96% (16.8815 => 20.2518, std.dev.: 0.5141)
  MultiSource/Applications/SIBsim4/SIBsim4: 19.17% (1.5782 => 1.8808, std.dev.: 0.0561)
  MultiSource/Applications/SPASS/SPASS: 19.02% (16.8985 => 20.1132, std.dev.: 0.2367)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.97% (5.6713 => 6.6906, std.dev.: 0.3414)
  MultiSource/Applications/siod/siod: 17.53% (2.4918 => 2.9285, std.dev.: 0.1374)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.02% (0.1063 => 0.1212, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.65% (1.7484 => 1.9870, std.dev.: 0.0609)
  MultiSource/Applications/sqlite3/sqlite3: 8.71% (16.7496 => 18.2080, std.dev.: 0.2761)
  MultiSource/Benchmarks/Bullet/bullet: 7.31% (35.1545 => 37.7236, std.dev.: 0.1525)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.00% (1.4692 => 1.5720, std.dev.: 0.0351)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.90% (1.4542 => 1.5545, std.dev.: 0.0272)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.83% (1.5095 => 1.6126, std.dev.: 0.0235)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.57% (46.0630 => 49.0874, std.dev.: 0.5253)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4067 => 1.4780, std.dev.: 0.0156)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/SPASS/SPASS: 16.17% (8.2741 => 9.6122, std.dev.: 0.4396)
  MultiSource/Applications/obsequi/Obsequi: 10.78% (2.3540 => 2.6078, std.dev.: 0.0090)
  SingleSource/Benchmarks/Linpack/linpack-pc: 2.75% (50.5637 => 51.9525, std.dev.: 0.0106)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.94% (4.7760 => 4.8688, std.dev.: 0.0208)
  SingleSource/Benchmarks/Shootout/lists: 1.29% (7.3008 => 7.3948, std.dev.: 0.0134)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -28.30% (0.3452 => 0.2475, std.dev.: 0.0315)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -20.85% (0.3554 => 0.2813, std.dev.: 0.0100)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.17% (1.7989 => 1.4540, std.dev.: 0.0696)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.68% (0.0787 => 0.0640, std.dev.: 0.0056)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: -10.29% (0.1118 => 0.1003, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.67% (1.2221 => 1.1773, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.41% (0.0357 => 0.0227, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -25.11% (0.1577 => 0.1181, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -24.86% (0.0917 => 0.0689, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.23% (7.4934 => 7.1767, std.dev.: 0.0245)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -3.39% (2.6299 => 2.5408, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.08% (3.6831 => 3.6435, std.dev.: 0.0139)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 36.16% (0.1488 => 0.2026, std.dev.: 0.0053)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 57.94% (0.0214 => 0.0338, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 57.57% (0.0667 => 0.1051, std.dev.: 0.0027)
  MultiSource/Applications/spiff/spiff: 44.89% (0.9365 => 1.3569, std.dev.: 0.1043)
  MultiSource/Applications/aha/aha: 41.72% (0.1407 => 0.1994, std.dev.: 0.0178)
  MultiSource/Applications/Burg/burg: 37.22% (1.5375 => 2.1097, std.dev.: 0.0620)
  MultiSource/Applications/obsequi/Obsequi: 35.22% (1.1733 => 1.5865, std.dev.: 0.1005)
  MultiSource/Applications/treecc/treecc: 34.72% (2.3237 => 3.1306, std.dev.: 0.0930)
  MultiSource/Applications/sgefa/sgefa: 33.13% (0.4135 => 0.5505, std.dev.: 0.0461)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 30.24% (1.5862 => 2.0658, std.dev.: 0.0742)
  MultiSource/Applications/JM/ldecod/ldecod: 20.60% (7.4648 => 9.0027, std.dev.: 0.3967)
  MultiSource/Applications/ClamAV/clamscan: 20.59% (17.3229 => 20.8896, std.dev.: 0.9879)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.58% (5.6424 => 6.6906, std.dev.: 0.3414)
  MultiSource/Applications/siod/siod: 17.40% (2.4944 => 2.9285, std.dev.: 0.1374)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 16.19% (1.7102 => 1.9870, std.dev.: 0.0609)
  MultiSource/Applications/SPASS/SPASS: 14.03% (17.6379 => 20.1132, std.dev.: 0.2367)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.38% (1.3833 => 1.5545, std.dev.: 0.0272)
  MultiSource/Applications/SIBsim4/SIBsim4: 12.00% (1.6793 => 1.8808, std.dev.: 0.0561)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.14% (1.4081 => 1.5650, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.87% (1.4165 => 1.5705, std.dev.: 0.0579)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.69% (1.4202 => 1.5720, std.dev.: 0.0351)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.17% (1.4771 => 1.6126, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.55% (1.5735 => 1.7080, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.14% (1.3667 => 1.4780, std.dev.: 0.0156)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.83% (0.9957 => 1.0737, std.dev.: 0.0273)
  MultiSource/Applications/sqlite3/sqlite3: 7.28% (16.9719 => 18.2080, std.dev.: 0.2761)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.72% (1.4757 => 1.5749, std.dev.: 0.0329)
  MultiSource/Benchmarks/Bullet/bullet: 6.18% (35.5296 => 37.7236, std.dev.: 0.1525)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 19.96% (1.1695 => 1.4029, std.dev.: 0.0286)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.94% (6.1372 => 7.1767, std.dev.: 0.0245)
  MultiSource/Applications/obsequi/Obsequi: 16.43% (2.2398 => 2.6078, std.dev.: 0.0090)
  MultiSource/Benchmarks/Olden/bisort/bisort: 14.62% (0.8606 => 0.9864, std.dev.: 0.0420)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.93% (5.2003 => 5.6648, std.dev.: 0.0391)
  MultiSource/Applications/lua/lua: 5.25% (28.2496 => 29.7329, std.dev.: 0.5365)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.44% (1.0571 => 1.1040, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.31% (5.5010 => 5.6830, std.dev.: 0.0196)
  SingleSource/Benchmarks/Shootout/methcall: 2.16% (8.3425 => 8.5230, std.dev.: 0.0172)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.91% (4.3727 => 4.4563, std.dev.: 0.0092)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.83% (4.7814 => 4.8688, std.dev.: 0.0208)
  SingleSource/Benchmarks/Shootout/lists: 1.35% (7.2961 => 7.3948, std.dev.: 0.0134)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.44% (0.0803 => 0.0679, std.dev.: 0.0015)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -3.79% (51.0211 => 49.0874, std.dev.: 0.5253)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.68% (1.2911 => 0.7272, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.25% (4.4050 => 3.2486, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.45% (6.2328 => 5.0830, std.dev.: 0.0943)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.76% (25.3677 => 21.1162, std.dev.: 0.2084)
  SingleSource/Benchmarks/Misc/salsa20: -12.97% (10.3398 => 8.9987, std.dev.: 0.0055)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.00% (48.3307 => 43.4985, std.dev.: 0.1452)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.46% (1.6679 => 1.5102, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.35% (5.5889 => 5.2340, std.dev.: 0.0417)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.34% (9.8728 => 9.2473, std.dev.: 0.0282)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.11% (4.5717 => 4.3383, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.13% (5.3184 => 5.0990, std.dev.: 0.0644)
  MultiSource/Applications/hexxagon/hexxagon: -3.89% (15.4979 => 14.8951, std.dev.: 0.1079)
  SingleSource/Benchmarks/Misc/flops: -3.51% (10.2170 => 9.8579, std.dev.: 0.0344)
  SingleSource/Benchmarks/Shootout/sieve: -2.91% (8.0178 => 7.7846, std.dev.: 0.0488)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.82% (3.8665 => 3.7574, std.dev.: 0.0257)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (8.5243 => 8.3826, std.dev.: 0.0416)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 40.60% (0.1441 => 0.2026, std.dev.: 0.0053)

Report Time: 0.97s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130610/b620875d/attachment.html>


More information about the llvm-testresults mailing list