[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 26 19:34:30 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12799?compare_to=12796&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12799, Order: 185045, Start Time: 2013-06-27 00:43:40, End Time: 2013-06-27 02:35:33
      To: 12796, Order: 185024, Start Time: 2013-06-26 22:27:59, End Time: 2013-06-27 00:19:32
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 29 (49 on baseline)
Performance Improvements: 6 (27 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1072 (1031 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/member-function-pointers: 46.30% (0.0216 => 0.0316, std.dev.: 0.0017)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 43.85% (0.0301 => 0.0433, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 32.18% (0.7939 => 1.0494, std.dev.: 0.0842)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.88% (0.7187 => 0.9406, std.dev.: 0.0665)
  SingleSource/UnitTests/SignlessTypes/div: 29.38% (0.0371 => 0.0480, std.dev.: 0.0040)
  MultiSource/Benchmarks/McCat/09-vor/vor: 21.77% (0.3555 => 0.4329, std.dev.: 0.0171)
  MultiSource/Benchmarks/Prolangs-C/football/football: 15.04% (1.0296 => 1.1845, std.dev.: 0.0404)
  MultiSource/Benchmarks/Olden/bh/bh: 14.77% (0.3419 => 0.3924, std.dev.: 0.0181)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.53% (1.7981 => 2.0054, std.dev.: 0.0642)
  MultiSource/Applications/JM/lencod/lencod: 9.32% (16.9676 => 18.5491, std.dev.: 0.4067)
  MultiSource/Applications/sqlite3/sqlite3: 6.55% (16.5636 => 17.6485, std.dev.: 0.2473)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.12% (0.6340 => 0.6728, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.54% (1.4199 => 1.4843, std.dev.: 0.0161)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.13% (0.4264 => 0.4440, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.11% (1.7690 => 1.8240, std.dev.: 0.0136)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: 49.30% (0.0854 => 0.1275, std.dev.: 0.0079)
  MultiSource/Applications/minisat/minisat: 19.23% (6.2263 => 7.4238, std.dev.: 0.2869)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 17.37% (0.1744 => 0.2047, std.dev.: 0.0060)
  MultiSource/Applications/SPASS/SPASS: 15.03% (8.0993 => 9.3165, std.dev.: 0.4336)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.65% (2.7487 => 3.1240, std.dev.: 0.0828)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.75% (30.4649 => 34.3487, std.dev.: 0.3576)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.98% (2.9722 => 3.2095, std.dev.: 0.0335)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.93% (4.0112 => 4.2090, std.dev.: 0.0374)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.50% (0.2687 => 0.2808, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.26% (2.3563 => 2.4566, std.dev.: 0.0322)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.44% (5.1190 => 5.2951, std.dev.: 0.0315)
  MultiSource/Applications/JM/lencod/lencod: 1.82% (7.0763 => 7.2052, std.dev.: 0.0390)
  MultiSource/Applications/sqlite3/sqlite3: 1.55% (4.3118 => 4.3787, std.dev.: 0.0205)
  SingleSource/Benchmarks/Shootout/methcall: 1.20% (8.3551 => 8.4557, std.dev.: 0.0362)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc-C++/Large/ray: -10.58% (0.4017 => 0.3592, std.dev.: 0.0113)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.89% (0.2215 => 0.2018, std.dev.: 0.0072)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.13% (0.6446 => 0.6180, std.dev.: 0.0060)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/hash: -7.04% (0.7793 => 0.7244, std.dev.: 0.0182)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -7.04% (0.2401 => 0.2232, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/mandel: -1.15% (1.0441 => 1.0321, std.dev.: 0.0034)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.29% (0.1386 => 0.1390, std.dev.: 0.0056)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc-C++/mandel-text: 54.67% (0.0225 => 0.0348, std.dev.: 0.0016)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 46.28% (0.0296 => 0.0433, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 33.57% (1.5014 => 2.0054, std.dev.: 0.0642)
  SingleSource/UnitTests/SignlessTypes/div: 32.96% (0.0361 => 0.0480, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.80% (0.7191 => 0.9406, std.dev.: 0.0665)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 30.77% (0.8025 => 1.0494, std.dev.: 0.0842)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.46% (5.6424 => 6.8532, std.dev.: 0.3949)
  MultiSource/Benchmarks/McCat/09-vor/vor: 16.28% (0.3723 => 0.4329, std.dev.: 0.0171)
  MultiSource/Benchmarks/Prolangs-C/football/football: 15.09% (1.0292 => 1.1845, std.dev.: 0.0404)
  MultiSource/Benchmarks/Olden/bh/bh: 14.44% (0.3429 => 0.3924, std.dev.: 0.0181)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.58% (0.6254 => 0.6728, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 7.51% (1.5806 => 1.6993, std.dev.: 0.0239)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.26% (1.3838 => 1.4843, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 6.65% (1.7102 => 1.8240, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.28% (1.4757 => 1.5684, std.dev.: 0.0348)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.25% (1.4165 => 1.4909, std.dev.: 0.0164)
  MultiSource/Applications/sqlite3/sqlite3: 3.99% (16.9719 => 17.6485, std.dev.: 0.2473)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.42% (0.4293 => 0.4440, std.dev.: 0.0021)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.31% (0.5982 => 0.6180, std.dev.: 0.0060)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 56.12% (6.0122 => 9.3865, std.dev.: 0.6276)
  MultiSource/Benchmarks/MallocBench/gs/gs: 46.72% (0.0869 => 0.1275, std.dev.: 0.0079)
  MultiSource/Applications/sgefa/sgefa: 30.18% (1.1695 => 1.5224, std.dev.: 0.0012)
  SingleSource/Benchmarks/Stanford/Puzzle: 24.05% (0.1455 => 0.1805, std.dev.: 0.0032)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 23.16% (2.5366 => 3.1240, std.dev.: 0.0828)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 20.11% (0.1880 => 0.2258, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.61% (6.1372 => 7.2177, std.dev.: 0.1276)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.97% (0.1750 => 0.2047, std.dev.: 0.0060)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.67% (0.9806 => 1.1343, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.22% (5.2003 => 5.6280, std.dev.: 0.0312)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.72% (0.2072 => 0.2232, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.23% (3.1853 => 3.3837, std.dev.: 0.0169)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.98% (2.8994 => 3.0727, std.dev.: 0.0200)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.82% (32.4581 => 34.3487, std.dev.: 0.3576)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.14% (3.2201 => 3.3856, std.dev.: 0.0514)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.06% (0.3323 => 0.3491, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.91% (4.6639 => 4.8929, std.dev.: 0.0173)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.82% (4.0156 => 4.2090, std.dev.: 0.0374)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.69% (1.0571 => 1.1067, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.36% (40.6198 => 42.3919, std.dev.: 0.5301)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.11% (5.2788 => 5.4955, std.dev.: 0.0261)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.76% (5.9362 => 6.1596, std.dev.: 0.0391)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.92% (5.5010 => 5.6614, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.63% (4.6379 => 4.7600, std.dev.: 0.0341)
  MultiSource/Applications/JM/lencod/lencod: 2.41% (7.0353 => 7.2052, std.dev.: 0.0390)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.00% (5.6582 => 5.7715, std.dev.: 0.0211)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.96% (39.9248 => 40.7084, std.dev.: 0.1595)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.62% (4.3727 => 4.4435, std.dev.: 0.0179)
  SingleSource/Benchmarks/Shootout/methcall: 1.36% (8.3425 => 8.4557, std.dev.: 0.0362)
  SingleSource/Benchmarks/McGill/queens: 1.17% (1.6478 => 1.6670, std.dev.: 0.0069)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -33.51% (0.1113 => 0.0740, std.dev.: 0.0027)
  MultiSource/Applications/viterbi/viterbi: -22.83% (0.2431 => 0.1876, std.dev.: 0.0206)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.77% (0.2006 => 0.1830, std.dev.: 0.0021)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -42.08% (1.2911 => 0.7478, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.78% (4.4050 => 2.7409, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.69% (4.8986 => 3.8852, std.dev.: 0.0400)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.87% (5.7264 => 4.5886, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.59% (6.2328 => 5.0743, std.dev.: 0.0080)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.04% (25.3677 => 21.2976, std.dev.: 0.0347)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.86% (48.3307 => 41.6311, std.dev.: 0.1376)
  SingleSource/Benchmarks/Misc/salsa20: -12.99% (10.3398 => 8.9965, std.dev.: 0.0407)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.78% (0.7941 => 0.7244, std.dev.: 0.0182)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -8.43% (3.5120 => 3.2160, std.dev.: 0.1118)
  MultiSource/Applications/siod/siod: -7.71% (3.7240 => 3.4370, std.dev.: 0.0316)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.47% (9.8728 => 9.1354, std.dev.: 0.0862)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.01% (4.5717 => 4.2511, std.dev.: 0.0293)
  MultiSource/Applications/sqlite3/sqlite3: -5.55% (4.6358 => 4.3787, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.35% (5.3184 => 5.0871, std.dev.: 0.0230)
  SingleSource/Benchmarks/Misc/flops: -3.92% (10.2170 => 9.8163, std.dev.: 0.0362)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.83% (9.1099 => 8.7614, std.dev.: 0.0240)
  MultiSource/Applications/hexxagon/hexxagon: -3.63% (15.4979 => 14.9350, std.dev.: 0.1197)
  SingleSource/Benchmarks/Shootout/sieve: -2.98% (8.0178 => 7.7790, std.dev.: 0.0316)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.60% (3.8665 => 3.7661, std.dev.: 0.0213)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.35% (5.7342 => 5.5994, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.27% (4.5094 => 4.4072, std.dev.: 0.0285)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.69% (3.5327 => 3.4730, std.dev.: 0.0225)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.29% (12.1841 => 12.0272, std.dev.: 0.0598)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.54% (0.1441 => 0.1390, std.dev.: 0.0056)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130626/5870d3e8/attachment.html>


More information about the llvm-testresults mailing list