[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jun 8 19:20:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12205?compare_to=12200&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12205, Order: 183623, Start Time: 2013-06-09 00:27:55, End Time: 2013-06-09 02:21:32
      To: 12200, Order: 183621, Start Time: 2013-06-08 22:23:43, End Time: 2013-06-09 00:04:45
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 15 (18 on baseline)
Performance Improvements: 1 (71 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1091 (1018 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/sim/sim: 2.90% (0.3618 => 0.3723, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.43% (1.5076 => 1.5291, std.dev.: 0.0009)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: 16.53% (0.1385 => 0.1614, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.28% (2.1107 => 2.4121, std.dev.: 0.0955)
  SingleSource/Benchmarks/Shootout/matrix: 11.92% (1.7243 => 1.9299, std.dev.: 0.0562)
  SingleSource/Benchmarks/Misc/salsa20: 11.92% (8.0251 => 8.9813, std.dev.: 0.0174)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.63% (0.4122 => 0.4560, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/hash: 4.98% (0.7192 => 0.7550, std.dev.: 0.0134)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.70% (3.2072 => 3.3578, std.dev.: 0.0148)
  SingleSource/Benchmarks/Misc/flops: 3.36% (9.5417 => 9.8624, std.dev.: 0.0224)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.39% (42.4070 => 43.4209, std.dev.: 0.0378)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.92% (4.7103 => 4.8006, std.dev.: 0.0318)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.89% (50.4104 => 51.3609, std.dev.: 0.2088)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.57% (3.5821 => 3.6385, std.dev.: 0.0190)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 1.20% (1.4891 => 1.5070, std.dev.: 0.0007)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -1.33% (6.9881 => 6.8953, std.dev.: 0.0360)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.42% (0.1462 => 0.1412, std.dev.: 0.0121)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.59% (0.2721 => 0.2873, std.dev.: 0.0051)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 3.18% (1.5862 => 1.6367, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.95% (1.4999 => 1.5291, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.17% (1.5735 => 1.5919, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.10% (1.5727 => 1.5900, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.05% (1.3667 => 1.3811, std.dev.: 0.0033)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 18.09% (1.1695 => 1.3811, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.74% (6.1372 => 7.1643, std.dev.: 0.3869)
  SingleSource/Benchmarks/Shootout/nestedloop: 14.55% (0.1409 => 0.1614, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout/matrix: 11.20% (1.7355 => 1.9299, std.dev.: 0.0562)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.88% (5.2003 => 5.6103, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.27% (3.1853 => 3.3851, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.55% (4.6639 => 4.8763, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.87% (5.5010 => 5.6590, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout/methcall: 2.08% (8.3425 => 8.5159, std.dev.: 0.0322)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (4.3727 => 4.4584, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.84% (5.6582 => 5.7625, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/oourafft: 1.10% (3.7315 => 3.7724, std.dev.: 0.0107)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -36.75% (0.1113 => 0.0704, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/constpool: -14.48% (10.3086 => 8.8154, std.dev.: 0.2100)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.34% (0.7918 => 0.6862, std.dev.: 0.0094)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.03% (0.1151 => 0.1001, std.dev.: 0.0011)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -12.48% (0.1322 => 0.1157, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -12.47% (0.1075 => 0.0941, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.91% (0.1646 => 0.1450, std.dev.: 0.0009)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.55% (1.7804 => 1.5926, std.dev.: 0.0325)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.52% (1.5932 => 1.4256, std.dev.: 0.0113)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.89% (0.8025 => 0.7231, std.dev.: 0.0060)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -9.86% (0.1886 => 0.1700, std.dev.: 0.0025)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.56% (51.0211 => 46.1458, std.dev.: 0.1344)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.51% (5.1587 => 4.6680, std.dev.: 0.1658)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.07% (0.2006 => 0.1824, std.dev.: 0.0003)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.92% (0.1828 => 0.1665, std.dev.: 0.0043)
  MultiSource/Applications/aha/aha: -7.96% (0.1407 => 0.1295, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.90% (0.3378 => 0.3111, std.dev.: 0.0073)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.77% (1.0314 => 0.9513, std.dev.: 0.0041)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.29% (0.1563 => 0.1449, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.18% (15.9860 => 14.8375, std.dev.: 0.2814)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.42% (0.2416 => 0.2261, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.41% (0.7381 => 0.6908, std.dev.: 0.0026)
  MultiSource/Applications/lemon/lemon: -6.29% (1.3155 => 1.2327, std.dev.: 0.0215)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.83% (2.0439 => 1.9248, std.dev.: 0.0085)
  MultiSource/Applications/Burg/burg: -5.70% (1.5375 => 1.4498, std.dev.: 0.0033)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.34% (0.8649 => 0.8187, std.dev.: 0.0086)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.69% (0.4030 => 0.3841, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.17% (10.1602 => 9.8382, std.dev.: 0.1168)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.85% (0.5748 => 0.5584, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.76% (0.4861 => 0.4727, std.dev.: 0.0032)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.70% (0.3853 => 0.3749, std.dev.: 0.0024)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.21% (0.9964 => 0.9744, std.dev.: 0.0015)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.07% (0.9957 => 0.9751, std.dev.: 0.0073)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.50% (2.5078 => 2.4703, std.dev.: 0.0135)
  MultiSource/Benchmarks/Prolangs-C/football/football: -1.45% (1.0292 => 1.0143, std.dev.: 0.0034)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.52% (1.2911 => 0.7292, std.dev.: 0.0059)
  MultiSource/Applications/lemon/lemon: -32.25% (1.3499 => 0.9145, std.dev.: 0.0904)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.47% (4.4050 => 3.2388, std.dev.: 0.1403)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -24.98% (6.2328 => 4.6756, std.dev.: 0.1787)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.48% (25.3677 => 21.1878, std.dev.: 0.0755)
  SingleSource/Benchmarks/Misc/salsa20: -13.14% (10.3398 => 8.9813, std.dev.: 0.0174)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -11.02% (10.2418 => 9.1135, std.dev.: 0.1831)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.53% (0.3702 => 0.3312, std.dev.: 0.0122)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.16% (48.3307 => 43.4209, std.dev.: 0.0378)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.81% (1.6679 => 1.5043, std.dev.: 0.0053)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.02% (32.4581 => 29.8557, std.dev.: 0.1841)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.22% (16.4665 => 15.2784, std.dev.: 0.2995)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.14% (9.8728 => 9.1682, std.dev.: 0.0682)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.91% (5.5889 => 5.2029, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.69% (4.5717 => 4.2659, std.dev.: 0.1160)
  MultiSource/Benchmarks/FreeBench/neural/neural: -5.58% (0.3513 => 0.3317, std.dev.: 0.0074)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.23% (0.2332 => 0.2210, std.dev.: 0.0045)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.95% (3.5327 => 3.3578, std.dev.: 0.0148)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.92% (0.7941 => 0.7550, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.80% (5.3184 => 5.0633, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.34% (5.3276 => 5.0965, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.18% (0.2777 => 0.2661, std.dev.: 0.0029)
  MultiSource/Benchmarks/Bullet/bullet: -4.15% (7.1938 => 6.8953, std.dev.: 0.0360)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.03% (9.1099 => 8.7424, std.dev.: 0.0360)
  MultiSource/Applications/hexxagon/hexxagon: -4.01% (15.4979 => 14.8769, std.dev.: 0.0548)
  SingleSource/Benchmarks/Misc/flops: -3.47% (10.2170 => 9.8624, std.dev.: 0.0224)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.10% (94.2966 => 91.3772, std.dev.: 0.3699)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.03% (5.7342 => 5.5604, std.dev.: 0.0540)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.96% (3.8665 => 3.7522, std.dev.: 0.0392)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.34% (5.4801 => 5.3521, std.dev.: 0.0490)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.20% (4.5094 => 4.4104, std.dev.: 0.0265)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.80% (4.2167 => 4.1406, std.dev.: 0.0026)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.49% (2.8573 => 2.8147, std.dev.: 0.0026)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.36% (12.1841 => 12.0188, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.19% (9.6556 => 9.5403, std.dev.: 0.0358)
  MultiSource/Applications/aha/aha: -1.02% (3.6251 => 3.5880, std.dev.: 0.0074)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.01% (0.1441 => 0.1412, std.dev.: 0.0121)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130608/949f0697/attachment.html>


More information about the llvm-testresults mailing list