[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri May 31 10:04:46 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11924?compare_to=11920&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11924, Order: 183005, Start Time: 2013-05-31 15:16:02, End Time: 2013-05-31 17:05:22
      To: 11920, Order: 182998, Start Time: 2013-05-31 13:05:50, End Time: 2013-05-31 14:54:21
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 35 (31 on baseline)
Performance Improvements: 1 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1071 (1058 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/spiff/spiff: 49.38% (0.9255 => 1.3825, std.dev.: 0.0286)
  MultiSource/Applications/Burg/burg: 40.36% (1.4340 => 2.0127, std.dev.: 0.0264)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 36.47% (0.0850 => 0.1160, std.dev.: 0.0084)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.42% (0.2332 => 0.3088, std.dev.: 0.0215)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.70% (4.9970 => 5.8815, std.dev.: 0.2877)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.67% (4.6556 => 5.2453, std.dev.: 0.1844)
  MultiSource/Applications/SPASS/SPASS: 12.33% (16.8420 => 18.9181, std.dev.: 0.6662)
  MultiSource/Benchmarks/MallocBench/gs/gs: 12.12% (4.5908 => 5.1472, std.dev.: 0.0218)
  MultiSource/Applications/JM/lencod/lencod: 11.52% (16.9618 => 18.9151, std.dev.: 0.7125)
  MultiSource/Applications/siod/siod: 11.43% (2.4823 => 2.7660, std.dev.: 0.0230)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.87% (14.9012 => 16.2225, std.dev.: 0.4174)
  MultiSource/Applications/oggenc/oggenc: 5.09% (5.6971 => 5.9868, std.dev.: 0.0497)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.88% (1.6337 => 1.7135, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.69% (1.6134 => 1.6729, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.58% (1.4333 => 1.4846, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.58% (1.4319 => 1.4688, std.dev.: 0.0089)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 39.70% (0.0670 => 0.0936, std.dev.: 0.0044)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 35.12% (0.8719 => 1.1781, std.dev.: 0.1021)
  MultiSource/Applications/minisat/minisat: 19.42% (6.2572 => 7.4726, std.dev.: 0.4380)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.63% (3.5532 => 4.2152, std.dev.: 0.0416)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.92% (2.4726 => 2.9157, std.dev.: 0.0782)
  MultiSource/Benchmarks/FreeBench/neural/neural: 16.54% (0.3374 => 0.3932, std.dev.: 0.0008)
  MultiSource/Applications/SPASS/SPASS: 16.44% (8.1762 => 9.5207, std.dev.: 0.2448)
  SingleSource/Benchmarks/Misc/fp-convert: 15.18% (6.9901 => 8.0511, std.dev.: 0.0067)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.17% (0.3318 => 0.3755, std.dev.: 0.0159)
  SingleSource/Benchmarks/Misc/salsa20: 11.48% (8.0692 => 8.9955, std.dev.: 0.0186)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.76% (3.0105 => 3.2743, std.dev.: 0.0186)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.35% (0.8540 => 0.9082, std.dev.: 0.0126)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.83% (1.0554 => 1.1064, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.13% (3.0364 => 3.1617, std.dev.: 0.0187)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.78% (1.0459 => 1.0750, std.dev.: 0.0108)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.15% (40.1446 => 41.0090, std.dev.: 0.1049)
  MultiSource/Applications/sqlite3/sqlite3: 1.89% (4.3436 => 4.4258, std.dev.: 0.0285)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.43% (4.5954 => 4.6611, std.dev.: 0.0248)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.23% (1.8744 => 1.8974, std.dev.: 0.0075)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.76% (2.7419 => 2.6937, std.dev.: 0.0135)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.88% (0.1470 => 0.1483, std.dev.: 0.0339)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/spiff/spiff: 47.62% (0.9365 => 1.3825, std.dev.: 0.0286)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 38.35% (0.2232 => 0.3088, std.dev.: 0.0215)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.22% (0.0884 => 0.1160, std.dev.: 0.0084)
  MultiSource/Applications/Burg/burg: 30.91% (1.5375 => 2.0127, std.dev.: 0.0264)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.83% (4.9917 => 5.8815, std.dev.: 0.2877)
  MultiSource/Applications/siod/siod: 10.89% (2.4944 => 2.7660, std.dev.: 0.0230)
  MultiSource/Benchmarks/MallocBench/gs/gs: 9.30% (4.7091 => 5.1472, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.12% (1.4757 => 1.5956, std.dev.: 0.0351)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.70% (1.4991 => 1.6145, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.32% (1.3833 => 1.4846, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.15% (1.5612 => 1.6729, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.14% (1.3838 => 1.4688, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.02% (1.5372 => 1.6298, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.30% (1.6726 => 1.7612, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.28% (1.6275 => 1.7135, std.dev.: 0.0120)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.00% (2.5078 => 2.6333, std.dev.: 0.0166)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 39.91% (0.0669 => 0.0936, std.dev.: 0.0044)
  MultiSource/Applications/sgefa/sgefa: 20.20% (1.1695 => 1.4057, std.dev.: 0.0429)
  SingleSource/Benchmarks/Stanford/Puzzle: 15.95% (0.1455 => 0.1687, std.dev.: 0.0062)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.95% (2.5366 => 2.9157, std.dev.: 0.0782)
  MultiSource/Benchmarks/FreeBench/neural/neural: 11.93% (0.3513 => 0.3932, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.74% (0.8276 => 0.9082, std.dev.: 0.0126)
  MultiSource/Applications/SPASS/SPASS: 7.31% (8.8720 => 9.5207, std.dev.: 0.2448)
  MultiSource/Applications/lua/lua: 6.87% (28.2496 => 30.1895, std.dev.: 0.6049)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.14% (1.2224 => 1.2975, std.dev.: 0.0073)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.66% (1.0571 => 1.1064, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.57% (3.0234 => 3.1617, std.dev.: 0.0187)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (39.9248 => 41.0090, std.dev.: 0.1049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 2.23% (3.2030 => 3.2743, std.dev.: 0.0186)
  SingleSource/Regression/C/uint64_to_float: 2.02% (1.6851 => 1.7192, std.dev.: 0.0124)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.47% (4.5935 => 4.6611, std.dev.: 0.0248)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/whetstone: -14.95% (0.1097 => 0.0933, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.35% (0.7918 => 0.6940, std.dev.: 0.0331)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.82% (0.2006 => 0.1789, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.16% (0.4861 => 0.4756, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.76% (1.2911 => 0.7261, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.58% (4.4050 => 3.2341, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -21.85% (6.2328 => 4.8708, std.dev.: 0.1061)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.01% (25.3677 => 21.3070, std.dev.: 0.0407)
  SingleSource/Benchmarks/Misc/salsa20: -13.00% (10.3398 => 8.9955, std.dev.: 0.0186)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.02% (48.3307 => 44.4547, std.dev.: 0.0815)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.02% (4.5717 => 4.3420, std.dev.: 0.0103)
  MultiSource/Applications/sqlite3/sqlite3: -4.53% (4.6358 => 4.4258, std.dev.: 0.0285)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.29% (0.2777 => 0.2658, std.dev.: 0.0038)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.82% (9.1099 => 8.7617, std.dev.: 0.0163)
  SingleSource/Benchmarks/Misc/flops: -3.55% (10.2170 => 9.8542, std.dev.: 0.0131)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.42% (2.8537 => 2.7847, std.dev.: 0.0246)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.26% (5.7342 => 5.6046, std.dev.: 0.0375)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (8.5243 => 8.4277, std.dev.: 0.0033)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.91% (0.1441 => 0.1483, std.dev.: 0.0339)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130531/248a9d8b/attachment.html>


More information about the llvm-testresults mailing list