[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jul 7 21:14:20 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13183?compare_to=13179&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13183, Order: 185781, Start Time: 2013-07-08 02:28:36, End Time: 2013-07-08 04:15:38
      To: 13179, Order: 185779, Start Time: 2013-07-08 00:21:35, End Time: 2013-07-08 02:07:42
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 7 (30 on baseline)
Performance Improvements: 3 (76 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1097 (1001 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.9680 => 0.9892, std.dev.: 0.0071)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.06% (15.6084 => 17.3347, std.dev.: 0.2055)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.56% (4.1227 => 4.5581, std.dev.: 0.1259)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.14% (9.1608 => 9.8150, std.dev.: 0.1695)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.77% (1.0552 => 1.0950, std.dev.: 0.0051)
  MultiSource/Applications/JM/lencod/lencod: 2.27% (7.0005 => 7.1592, std.dev.: 0.0251)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.22% (4.4131 => 4.4670, std.dev.: 0.0130)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/llubenchmark/llu: -1.87% (2.0308 => 1.9929, std.dev.: 0.0145)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.12% (1.2893 => 1.2748, std.dev.: 0.0021)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (7.1035 => 7.0292, std.dev.: 0.0073)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.69% (0.1301 => 0.1292, std.dev.: 0.0158)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.17% (0.2721 => 0.2916, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.14% (1.6292 => 1.6804, std.dev.: 0.0170)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.30% (1.4253 => 1.4581, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.26% (4.9917 => 5.0545, std.dev.: 0.0242)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 35.69% (2.5688 => 3.4856, std.dev.: 0.0529)
  MultiSource/Applications/sgefa/sgefa: 30.05% (1.1695 => 1.5209, std.dev.: 0.0301)
  SingleSource/Benchmarks/Misc/perlin: 26.80% (3.6271 => 4.5992, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.73% (6.1372 => 7.2254, std.dev.: 0.3081)
  SingleSource/Benchmarks/Stanford/Puzzle: 16.84% (0.1455 => 0.1700, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/mandel: 16.35% (1.0293 => 1.1976, std.dev.: 0.0044)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.90% (0.9806 => 1.1365, std.dev.: 0.0390)
  MultiSource/Applications/lua/lua: 7.82% (28.2496 => 30.4575, std.dev.: 0.0332)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.41% (0.4572 => 0.4911, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.20% (3.1853 => 3.3829, std.dev.: 0.0096)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.27% (16.4665 => 17.3347, std.dev.: 0.2055)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.87% (3.2201 => 3.3770, std.dev.: 0.0318)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.65% (4.6639 => 4.8808, std.dev.: 0.0138)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.37% (2.8994 => 3.0261, std.dev.: 0.0330)
  SingleSource/Benchmarks/Misc/fbench: 4.33% (4.7508 => 4.9566, std.dev.: 0.0182)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.59% (1.0571 => 1.0950, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.96% (5.5010 => 5.6638, std.dev.: 0.0299)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.64% (4.6379 => 4.7605, std.dev.: 0.0108)
  SingleSource/Benchmarks/Shootout/methcall: 2.31% (8.3425 => 8.5348, std.dev.: 0.0231)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (4.3727 => 4.4670, std.dev.: 0.0130)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.09% (1.7925 => 1.8300, std.dev.: 0.0020)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.04% (34.3107 => 35.0120, std.dev.: 0.0713)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.76% (5.6582 => 5.7580, std.dev.: 0.0061)
  MultiSource/Applications/JM/lencod/lencod: 1.76% (7.0353 => 7.1592, std.dev.: 0.0251)
  MultiSource/Applications/obsequi/Obsequi: 1.66% (2.2398 => 2.2770, std.dev.: 0.0038)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.34% (1.2579 => 1.2748, std.dev.: 0.0021)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.67% (0.1113 => 0.0716, std.dev.: 0.0113)
  SingleSource/Benchmarks/Misc/whetstone: -14.04% (0.1097 => 0.0943, std.dev.: 0.0027)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -13.84% (0.1322 => 0.1139, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -11.90% (0.7918 => 0.6976, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.07% (0.1075 => 0.0956, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.51% (0.1646 => 0.1473, std.dev.: 0.0044)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.72% (0.8025 => 0.7245, std.dev.: 0.0105)
  MultiSource/Applications/JM/lencod/lencod: -9.35% (18.9387 => 17.1670, std.dev.: 0.4495)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.07% (1.0314 => 0.9379, std.dev.: 0.0106)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.96% (5.1587 => 4.6964, std.dev.: 0.0304)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.76% (0.1861 => 0.1698, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.88% (1.5932 => 1.4676, std.dev.: 0.0064)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.56% (1.7804 => 1.6458, std.dev.: 0.0122)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -7.11% (5.4314 => 5.0454, std.dev.: 0.0276)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.83% (15.9860 => 15.0546, std.dev.: 0.1390)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.00% (0.4199 => 0.3989, std.dev.: 0.0030)
  MultiSource/Benchmarks/McCat/05-eks/eks: -4.95% (0.5698 => 0.5416, std.dev.: 0.0044)
  MultiSource/Applications/kimwitu++/kc: -4.51% (20.1855 => 19.2743, std.dev.: 0.0765)
  MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3723 => 0.3567, std.dev.: 0.0057)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.19% (1.3686 => 1.3250, std.dev.: 0.0088)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.48% (10.1602 => 9.9086, std.dev.: 0.0615)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.45% (7.7211 => 7.5316, std.dev.: 0.0094)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9957 => 0.9796, std.dev.: 0.0050)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.75% (1.2911 => 0.7263, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.81% (4.4050 => 2.7395, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/mst/mst: -36.97% (0.2099 => 0.1323, std.dev.: 0.0018)
  MultiSource/Applications/lemon/lemon: -33.80% (1.3499 => 0.8937, std.dev.: 0.0910)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -25.35% (1.0251 => 0.7652, std.dev.: 0.0512)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.68% (1.6105 => 1.2131, std.dev.: 0.0191)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.84% (9.1099 => 7.0292, std.dev.: 0.0073)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.55% (0.8606 => 0.6751, std.dev.: 0.0112)
  SingleSource/Benchmarks/Shootout/hash: -21.53% (5.3656 => 4.2104, std.dev.: 0.1825)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.90% (4.8986 => 3.8750, std.dev.: 0.0201)
  SingleSource/Benchmarks/Shootout-C++/hash: -20.61% (0.7941 => 0.6304, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.16% (5.7264 => 4.5718, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.63% (6.2328 => 5.0715, std.dev.: 0.0228)
  MultiSource/Applications/minisat/minisat: -16.03% (7.3703 => 6.1886, std.dev.: 0.0375)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.91% (25.3677 => 21.3306, std.dev.: 0.0561)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.14% (0.1945 => 0.1670, std.dev.: 0.0018)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.57% (1.6613 => 1.4358, std.dev.: 0.0214)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.40% (1.6679 => 1.4444, std.dev.: 0.0158)
  SingleSource/Benchmarks/Misc/salsa20: -13.08% (10.3398 => 8.9872, std.dev.: 0.0186)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -11.21% (0.3702 => 0.3287, std.dev.: 0.0140)
  MultiSource/Benchmarks/FreeBench/neural/neural: -9.85% (0.3513 => 0.3167, std.dev.: 0.0092)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.56% (3.5327 => 3.1950, std.dev.: 0.0528)
  SingleSource/Regression/C/uint64_to_float: -9.32% (1.6851 => 1.5280, std.dev.: 0.0497)
  MultiSource/Applications/siod/siod: -9.10% (3.7240 => 3.3852, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.40% (9.8728 => 9.0436, std.dev.: 0.0184)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -8.09% (2.5087 => 2.3058, std.dev.: 0.0463)
  MultiSource/Applications/sqlite3/sqlite3: -7.28% (4.6358 => 4.2984, std.dev.: 0.0289)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.27% (4.5717 => 4.2395, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.73% (5.5889 => 5.2129, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -6.39% (2.8537 => 2.6714, std.dev.: 0.0702)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.31% (3.5939 => 3.3670, std.dev.: 0.0131)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.71% (0.4480 => 0.4224, std.dev.: 0.0087)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.27% (6.3757 => 6.0396, std.dev.: 0.0810)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.83% (5.3184 => 5.0615, std.dev.: 0.0172)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -4.40% (4.5935 => 4.3915, std.dev.: 0.0544)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.16% (5.3276 => 5.1062, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/flops: -4.15% (10.2170 => 9.7927, std.dev.: 0.0535)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.14% (1.4783 => 1.4171, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc/whetstone: -3.80% (3.5970 => 3.4602, std.dev.: 0.0258)
  MultiSource/Applications/hexxagon/hexxagon: -3.64% (15.4979 => 14.9342, std.dev.: 0.0353)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -3.49% (1.3084 => 1.2628, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.24% (1.6440 => 1.5908, std.dev.: 0.0148)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.85% (48.3307 => 46.9525, std.dev.: 0.2683)
  MultiSource/Benchmarks/llubenchmark/llu: -2.43% (2.0425 => 1.9929, std.dev.: 0.0145)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.37% (3.8665 => 3.7750, std.dev.: 0.0112)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (1.1791 => 1.1549, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.98% (4.2167 => 4.1333, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.69% (5.9068 => 5.8067, std.dev.: 0.0388)
  MultiSource/Benchmarks/Olden/power/power: -1.54% (1.2558 => 1.2364, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.41% (2.8573 => 2.8171, std.dev.: 0.0015)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.36% (12.1841 => 12.0189, std.dev.: 0.0149)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.29% (4.9946 => 4.9302, std.dev.: 0.0222)
  MultiSource/Benchmarks/Olden/bh/bh: -1.15% (2.4435 => 2.4154, std.dev.: 0.0032)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -10.34% (0.1441 => 0.1292, std.dev.: 0.0158)

Report Time: 0.93s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130707/5e3cd260/attachment.html>


More information about the llvm-testresults mailing list