[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jun 16 21:17:40 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12453?compare_to=12451&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12453, Order: 184070, Start Time: 2013-06-17 02:35:50, End Time: 2013-06-17 04:18:34
      To: 12451, Order: 184068, Start Time: 2013-06-17 00:31:20, End Time: 2013-06-17 02:14:13
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 6 (15 on baseline)
Performance Improvements: 2 (78 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1099 (1014 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9679 => 0.9822, std.dev.: 0.0031)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.30% (4.6604 => 5.0473, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.35% (3.8565 => 4.1399, std.dev.: 0.0015)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.21% (15.5707 => 16.5381, std.dev.: 0.1031)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.52% (4.7461 => 4.9134, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.04% (4.0257 => 4.0674, std.dev.: 0.0043)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.78% (1.1764 => 1.1555, std.dev.: 0.0076)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.61% (1.6360 => 1.6097, std.dev.: 0.0094)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.95% (0.1424 => 0.1466, std.dev.: 0.0003)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.47% (0.2721 => 0.2897, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (1.5862 => 1.6291, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 18.28% (1.1695 => 1.3833, std.dev.: 0.0429)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.80% (6.1372 => 7.1069, std.dev.: 0.2043)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.94% (5.2003 => 5.6131, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.19% (3.1853 => 3.3825, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.75% (3.2201 => 3.3730, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.64% (4.6639 => 4.8804, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.72% (5.9362 => 6.1568, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.49% (5.2788 => 5.4628, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.81% (5.5010 => 5.6554, std.dev.: 0.0048)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (4.3727 => 4.4805, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/methcall: 2.45% (8.3425 => 8.5468, std.dev.: 0.0284)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.42% (3.9713 => 4.0674, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.96% (5.6582 => 5.7692, std.dev.: 0.0014)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -36.03% (0.1113 => 0.0712, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/constpool: -15.92% (10.3086 => 8.6674, std.dev.: 0.3184)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.44% (0.0803 => 0.0679, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.07% (0.7918 => 0.6804, std.dev.: 0.0068)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -13.77% (0.1322 => 0.1140, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -12.37% (0.1075 => 0.0942, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.79% (0.1646 => 0.1452, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.92% (1.5932 => 1.4193, std.dev.: 0.0113)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.32% (0.8025 => 0.7197, std.dev.: 0.0088)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -9.70% (0.1886 => 0.1703, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.59% (1.7804 => 1.6097, std.dev.: 0.0094)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.58% (51.0211 => 46.1328, std.dev.: 0.1795)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.25% (5.1587 => 4.6816, std.dev.: 0.0130)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.72% (0.2006 => 0.1831, std.dev.: 0.0003)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.48% (1.0314 => 0.9439, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -7.81% (5.4314 => 5.0070, std.dev.: 0.0217)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.18% (0.7381 => 0.6851, std.dev.: 0.0060)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.03% (15.9860 => 14.8615, std.dev.: 0.0420)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.80% (0.1828 => 0.1722, std.dev.: 0.0025)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.67% (0.2416 => 0.2279, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.52% (2.0439 => 1.9310, std.dev.: 0.0064)
  MultiSource/Benchmarks/Olden/em3d/em3d: -4.91% (0.2117 => 0.2013, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.17% (0.3378 => 0.3237, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.87% (0.4030 => 0.3874, std.dev.: 0.0022)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.65% (1.3686 => 1.3186, std.dev.: 0.0060)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.48% (0.3853 => 0.3719, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.28% (0.5887 => 0.5694, std.dev.: 0.0067)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.25% (0.4861 => 0.4703, std.dev.: 0.0020)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.11% (0.8969 => 0.8690, std.dev.: 0.0066)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.12% (10.7257 => 10.4984, std.dev.: 0.0380)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.97% (2.5078 => 2.4585, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.93% (1.1782 => 1.1555, std.dev.: 0.0076)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.36% (0.9957 => 0.9822, std.dev.: 0.0031)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.33% (25.9348 => 25.5906, std.dev.: 0.1182)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.17% (1.6726 => 1.6530, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.15% (1.4771 => 1.4601, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.12% (1.7006 => 1.6816, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.07% (1.6804 => 1.6625, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.06% (1.6275 => 1.6102, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.47% (1.2911 => 0.7298, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/mst/mst: -36.64% (0.2099 => 0.1330, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.49% (4.4050 => 3.2381, std.dev.: 0.0005)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.35% (0.8606 => 0.6769, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.02% (6.2328 => 5.0473, std.dev.: 0.0097)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.74% (25.3677 => 21.1212, std.dev.: 0.3703)
  MultiSource/Benchmarks/mafft/pairlocalalign: -14.07% (48.3307 => 41.5291, std.dev.: 0.8809)
  SingleSource/Benchmarks/Misc/salsa20: -13.10% (10.3398 => 8.9858, std.dev.: 0.0183)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.59% (0.3702 => 0.3310, std.dev.: 0.0117)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.72% (10.2418 => 9.2460, std.dev.: 0.0831)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.41% (1.6679 => 1.5109, std.dev.: 0.0050)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.14% (3.5327 => 3.2098, std.dev.: 0.0203)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.95% (0.7941 => 0.7230, std.dev.: 0.0234)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.99% (0.1945 => 0.1809, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.77% (5.5889 => 5.2108, std.dev.: 0.0004)
  MultiSource/Benchmarks/FreeBench/neural/neural: -6.26% (0.3513 => 0.3293, std.dev.: 0.0030)
  MultiSource/Applications/sqlite3/sqlite3: -6.17% (4.6358 => 4.3497, std.dev.: 0.0708)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.06% (9.8728 => 9.2746, std.dev.: 0.0346)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (4.5717 => 4.3154, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.86% (5.3184 => 5.0601, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.32% (0.2777 => 0.2657, std.dev.: 0.0027)
  MultiSource/Benchmarks/Bullet/bullet: -4.26% (7.1938 => 6.8871, std.dev.: 0.0399)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.98% (9.1099 => 8.7470, std.dev.: 0.0180)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.65% (2.8537 => 2.7494, std.dev.: 0.0155)
  SingleSource/Benchmarks/Misc/flops: -3.55% (10.2170 => 9.8543, std.dev.: 0.0178)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.54% (1.6613 => 1.6025, std.dev.: 0.0126)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.07% (94.2966 => 91.4038, std.dev.: 0.9999)
  SingleSource/Benchmarks/Shootout/sieve: -2.97% (8.0178 => 7.7800, std.dev.: 0.0713)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.84% (3.8665 => 3.7568, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.23% (4.5094 => 4.4088, std.dev.: 0.0007)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.19% (5.7342 => 5.6084, std.dev.: 0.0410)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.82% (4.2167 => 4.1399, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.80% (8.5243 => 8.3711, std.dev.: 0.0300)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.54% (1.4783 => 1.4556, std.dev.: 0.0061)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.38% (12.1841 => 12.0162, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.23% (9.6556 => 9.5370, std.dev.: 0.0251)
  MultiSource/Benchmarks/llubenchmark/llu: -1.20% (2.0425 => 2.0180, std.dev.: 0.0080)
  MultiSource/Applications/viterbi/viterbi: -1.19% (2.5688 => 2.5382, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.08% (1.6105 => 1.5931, std.dev.: 0.0065)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.73% (0.1441 => 0.1466, std.dev.: 0.0003)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130616/74b8fe26/attachment.html>


More information about the llvm-testresults mailing list