[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jun 14 21:38:58 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12404?compare_to=12402&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12404, Order: 184026, Start Time: 2013-06-15 02:57:16, End Time: 2013-06-15 04:39:49
      To: 12402, Order: 184021, Start Time: 2013-06-15 00:54:26, End Time: 2013-06-15 02:36:29
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 12 (22 on baseline)
Performance Improvements: 2 (62 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1093 (1023 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.73% (0.5995 => 0.6099, std.dev.: 0.0009)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: 7.95% (3.2348 => 3.4921, std.dev.: 0.0476)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.42% (5.0832 => 5.3588, std.dev.: 0.0608)
  SingleSource/Benchmarks/Misc/flops-4: 5.32% (1.5389 => 1.6208, std.dev.: 0.0188)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.87% (4.0252 => 4.1808, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.50% (4.7336 => 4.8995, std.dev.: 0.0099)
  MultiSource/Applications/sqlite3/sqlite3: 2.64% (4.3392 => 4.4539, std.dev.: 0.0217)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.44% (2.6870 => 2.7525, std.dev.: 0.0083)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.42% (4.5441 => 4.6540, std.dev.: 0.0399)
  MultiSource/Benchmarks/llubenchmark/llu: 2.10% (1.9817 => 2.0233, std.dev.: 0.0102)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.14% (1.2941 => 1.3089, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/whetstone: 1.02% (3.5513 => 3.5874, std.dev.: 0.0122)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -1.26% (35.5182 => 35.0694, std.dev.: 0.1421)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.85% (3.7143 => 3.6455, std.dev.: 0.0115)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.98% (0.1424 => 0.1438, std.dev.: 0.0037)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 4.14% (0.2513 => 0.2617, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/ary: 3.68% (0.2747 => 0.2848, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 3.09% (1.5862 => 1.6352, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 3.01% (0.3425 => 0.3528, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/moments: 2.62% (0.4006 => 0.4111, std.dev.: 0.0024)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.96% (0.5982 => 0.6099, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.63% (1.4131 => 1.4362, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.44% (1.4238 => 1.4443, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.22% (1.6070 => 1.6266, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.16% (1.4991 => 1.5165, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 17.22% (1.1695 => 1.3709, std.dev.: 0.0051)
  SingleSource/Benchmarks/Stanford/Puzzle: 17.18% (0.1455 => 0.1705, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.96% (5.2003 => 5.6144, std.dev.: 0.0794)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.31% (3.1853 => 3.3862, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.85% (3.2201 => 3.3764, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.66% (4.6639 => 4.8813, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.75% (5.9362 => 6.1588, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.56% (5.2788 => 5.4669, std.dev.: 0.0577)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.85% (5.5010 => 5.6579, std.dev.: 0.0476)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.94% (5.6582 => 5.7681, std.dev.: 0.0013)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.27% (2.7180 => 2.7525, std.dev.: 0.0083)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.02% (1.2957 => 1.3089, std.dev.: 0.0022)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -36.66% (0.1113 => 0.0705, std.dev.: 0.0007)
  MultiSource/Applications/viterbi/viterbi: -25.05% (0.2431 => 0.1822, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.69% (0.0803 => 0.0669, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/constpool: -14.79% (10.3086 => 8.7840, std.dev.: 0.1795)
  MultiSource/Applications/JM/lencod/lencod: -11.13% (18.9387 => 16.8301, std.dev.: 0.8059)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -9.92% (0.1563 => 0.1408, std.dev.: 0.0008)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.32% (0.2006 => 0.1819, std.dev.: 0.0007)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.25% (51.0211 => 46.3029, std.dev.: 0.1172)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.87% (0.1861 => 0.1696, std.dev.: 0.0026)
  MultiSource/Applications/aha/aha: -8.46% (0.1407 => 0.1288, std.dev.: 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.81% (0.7381 => 0.6878, std.dev.: 0.0116)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.58% (1.6793 => 1.5688, std.dev.: 0.0137)
  MultiSource/Applications/Burg/burg: -6.32% (1.5375 => 1.4404, std.dev.: 0.0107)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.72% (0.5698 => 0.5372, std.dev.: 0.0037)
  MultiSource/Applications/oggenc/oggenc: -5.71% (5.9886 => 5.6467, std.dev.: 0.0409)
  MultiSource/Benchmarks/McCat/09-vor/vor: -5.43% (0.3723 => 0.3521, std.dev.: 0.0018)
  MultiSource/Applications/kimwitu++/kc: -5.28% (20.1855 => 19.1207, std.dev.: 0.1713)
  MultiSource/Benchmarks/Olden/em3d/em3d: -4.91% (0.2117 => 0.2013, std.dev.: 0.0021)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.55% (0.5748 => 0.5544, std.dev.: 0.0040)
  MultiSource/Applications/ClamAV/clamscan: -3.29% (17.3229 => 16.7523, std.dev.: 0.1876)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.15% (0.7334 => 0.7176, std.dev.: 0.0040)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.00% (10.7257 => 10.5111, std.dev.: 0.0172)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.38% (25.9348 => 25.5772, std.dev.: 0.0551)
  MultiSource/Benchmarks/Bullet/bullet: -1.30% (35.5296 => 35.0694, std.dev.: 0.1421)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.34% (1.2911 => 0.7316, std.dev.: 0.0039)
  MultiSource/Applications/lemon/lemon: -36.43% (1.3499 => 0.8581, std.dev.: 0.1681)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.57% (4.4050 => 3.2344, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.22% (6.2328 => 5.0348, std.dev.: 0.0124)
  SingleSource/Benchmarks/Misc/salsa20: -19.20% (10.3398 => 8.3550, std.dev.: 0.2980)
  MultiSource/Benchmarks/mafft/pairlocalalign: -16.44% (48.3307 => 40.3838, std.dev.: 1.4785)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.99% (25.3677 => 21.3104, std.dev.: 0.2941)
  SingleSource/Benchmarks/Shootout-C++/fibo: -14.80% (4.8330 => 4.1179, std.dev.: 0.0320)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -13.04% (1.8291 => 1.5905, std.dev.: 0.0649)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.41% (1.6679 => 1.5110, std.dev.: 0.0160)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.91% (3.5327 => 3.2181, std.dev.: 0.0740)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.64% (0.7941 => 0.7255, std.dev.: 0.0235)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.34% (32.4581 => 29.7523, std.dev.: 0.5681)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.33% (16.4665 => 15.0952, std.dev.: 0.4785)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -8.29% (10.2418 => 9.3930, std.dev.: 0.0837)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.61% (9.8728 => 9.1218, std.dev.: 0.1050)
  MultiSource/Benchmarks/nbench/nbench: -7.23% (22.3004 => 20.6878, std.dev.: 0.5784)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.3530 => 1.2587, std.dev.: 0.0348)
  SingleSource/Benchmarks/Misc/flops: -6.84% (10.2170 => 9.5181, std.dev.: 0.1666)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.75% (5.5889 => 5.2119, std.dev.: 0.0428)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.58% (4.5717 => 4.3168, std.dev.: 0.0110)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.19% (0.2332 => 0.2211, std.dev.: 0.0045)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.93% (0.4480 => 0.4259, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.80% (5.3184 => 5.0630, std.dev.: 0.0911)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.21% (5.3276 => 5.1032, std.dev.: 0.0037)
  MultiSource/Benchmarks/Bullet/bullet: -4.07% (7.1938 => 6.9013, std.dev.: 0.0375)
  MultiSource/Applications/sqlite3/sqlite3: -3.92% (4.6358 => 4.4539, std.dev.: 0.0217)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.59% (9.1099 => 8.7826, std.dev.: 0.0284)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.30% (0.3208 => 0.3102, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/sieve: -2.97% (8.0178 => 7.7800, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.84% (3.8665 => 3.7567, std.dev.: 0.0129)
  SingleSource/Benchmarks/Shootout/hash: -2.43% (5.3656 => 5.2352, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.23% (4.5094 => 4.4087, std.dev.: 0.0013)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.14% (5.7342 => 5.6114, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.00% (4.2167 => 4.1324, std.dev.: 0.0215)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.24% (4.2334 => 4.1808, std.dev.: 0.0161)
  MultiSource/Applications/aha/aha: -1.21% (3.6251 => 3.5812, std.dev.: 0.0053)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.06% (1.6105 => 1.5934, std.dev.: 0.0046)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1441 => 0.1438, std.dev.: 0.0037)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130614/e700aaf4/attachment.html>


More information about the llvm-testresults mailing list