[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 5 07:25:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12078?compare_to=12073&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12078, Order: 183304, Start Time: 2013-06-05 12:40:50, End Time: 2013-06-05 14:26:28
      To: 12073, Order: 183303, Start Time: 2013-06-05 09:46:34, End Time: 2013-06-05 11:26:32
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

New Failures: 0 (9 on baseline)
Performance Regressions: 8 (18 on baseline)
Performance Improvements: 3 (60 on baseline)
Existing Failures: 10 (1 on baseline)
Unchanged Tests: 1087 (1020 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops-4: 5.21% (1.5467 => 1.6273, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.42% (8.9905 => 9.2982, std.dev.: 0.0193)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.40% (1.0605 => 1.0966, std.dev.: 0.0119)
  SingleSource/Benchmarks/Misc/flops: 3.39% (9.5344 => 9.8574, std.dev.: 0.0320)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 2.51% (0.4700 => 0.4818, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.97% (3.9616 => 4.0396, std.dev.: 0.0281)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.89% (50.2628 => 51.2135, std.dev.: 0.3378)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.31% (2.9891 => 3.0282, std.dev.: 0.0043)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/spiff/spiff: -1.39% (0.9269 => 0.9140, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -10.56% (2.6790 => 2.3962, std.dev.: 0.0121)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.40% (1.4785 => 1.4578, std.dev.: 0.0068)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/lambda-0_1_3/lambda
  MultiSource/Benchmarks/Bullet/bullet
  SingleSource/Benchmarks/Shootout-C++/hello
  SingleSource/Benchmarks/Shootout-C++/methcall
  SingleSource/Benchmarks/Shootout-C++/reversefile
  SingleSource/Benchmarks/Shootout-C++/spellcheck
  SingleSource/Benchmarks/Shootout-C++/sumcol
  SingleSource/Benchmarks/Shootout-C++/wc
  MultiSource/Applications/ClamAV/clamscan: 1.12% (0.1427 => 0.1443, std.dev.: 0.0012)
  MultiSource/Applications/kimwitu++/kc: - (0.0010 => 0.0010, std.dev.: 0.0002)
  MultiSource/Applications/lambda-0_1_3/lambda: - (0.0009 => 0.0009, std.dev.: 0.0002)
  MultiSource/Benchmarks/Bullet/bullet: - (0.0009 => 0.0009, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/hello: - (0.0010 => 0.0010, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.53% (4.6888 => 4.7604, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -88.89% (0.0009 => 0.0001, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -90.00% (0.0010 => 0.0001, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/wc: - (0.0001 => 0.0001, std.dev.: 0.0004)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/lambda-0_1_3/lambda
  MultiSource/Benchmarks/Bullet/bullet
  SingleSource/Benchmarks/Shootout-C++/hello
  SingleSource/Benchmarks/Shootout-C++/methcall
  SingleSource/Benchmarks/Shootout-C++/reversefile
  SingleSource/Benchmarks/Shootout-C++/spellcheck
  SingleSource/Benchmarks/Shootout-C++/sumcol
  SingleSource/Benchmarks/Shootout-C++/wc
  MultiSource/Applications/kimwitu++/kc: -98.20% (0.0556 => 0.0010, std.dev.: 0.0002)
  MultiSource/Applications/lambda-0_1_3/lambda: -99.99% (9.1099 => 0.0009, std.dev.: 0.0002)
  MultiSource/Benchmarks/Bullet/bullet: -99.99% (7.1938 => 0.0009, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/hello: 900.00% (0.0001 => 0.0010, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/methcall: -58.60% (11.4990 => 4.7604, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -50.00% (0.0002 => 0.0001, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/sumcol: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/wc: - (0.0001 => 0.0001, std.dev.: 0.0004)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.32% (6.1372 => 7.3231, std.dev.: 0.0534)
  MultiSource/Applications/sgefa/sgefa: 18.22% (1.1695 => 1.3826, std.dev.: 0.0015)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.83% (0.0624 => 0.0729, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.01% (5.2003 => 5.6171, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.23% (3.1853 => 3.3837, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.89% (3.2201 => 3.3776, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.75% (4.6639 => 4.8855, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.00% (1.0571 => 1.0994, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.77% (5.9362 => 6.1600, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.48% (5.2788 => 5.4624, std.dev.: 0.0397)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.40% (1.0605 => 1.0966, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.88% (5.5010 => 5.6593, std.dev.: 0.0275)
  SingleSource/Benchmarks/Shootout/methcall: 2.38% (8.3425 => 8.5413, std.dev.: 0.0609)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (4.3727 => 4.4755, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.96% (5.6582 => 5.7690, std.dev.: 0.0168)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.41% (3.6122 => 3.6632, std.dev.: 0.0102)
  SingleSource/Regression/C/uint64_to_float: 1.01% (1.6851 => 1.7021, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/oourafft: 1.01% (3.7315 => 3.7691, std.dev.: 0.0010)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -24.76% (0.2431 => 0.1829, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/whetstone: -16.04% (0.1097 => 0.0921, std.dev.: 0.0051)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -15.13% (0.1322 => 0.1122, std.dev.: 0.0044)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.74% (0.7918 => 0.6830, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.21% (0.1151 => 0.0999, std.dev.: 0.0052)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.58% (0.1646 => 0.1439, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.34% (1.5932 => 1.4126, std.dev.: 0.0088)
  MultiSource/Applications/JM/lencod/lencod: -11.16% (18.9387 => 16.8244, std.dev.: 0.4930)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.61% (5.1587 => 4.6112, std.dev.: 0.0307)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.27% (0.8025 => 0.7201, std.dev.: 0.0062)
  MultiSource/Applications/aha/aha: -9.81% (0.1407 => 0.1269, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -9.28% (0.1886 => 0.1711, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.07% (1.7804 => 1.6189, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.61% (0.7381 => 0.6819, std.dev.: 0.0055)
  MultiSource/Applications/lemon/lemon: -7.56% (1.3155 => 1.2160, std.dev.: 0.0304)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.39% (15.9860 => 14.8049, std.dev.: 0.0897)
  MultiSource/Applications/Burg/burg: -6.97% (1.5375 => 1.4303, std.dev.: 0.0076)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.09% (0.1674 => 0.1572, std.dev.: 0.0040)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.74% (0.1828 => 0.1723, std.dev.: 0.0008)
  SingleSource/Benchmarks/Linpack/linpack-pc: -4.46% (0.2738 => 0.2616, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.97% (0.3378 => 0.3244, std.dev.: 0.0034)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.70% (0.4030 => 0.3881, std.dev.: 0.0016)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.65% (0.2768 => 0.2667, std.dev.: 0.0036)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.56% (0.3853 => 0.3716, std.dev.: 0.0021)
  MultiSource/Applications/ClamAV/clamscan: -3.42% (17.3229 => 16.7300, std.dev.: 0.0900)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.06% (0.5887 => 0.5707, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.43% (0.4861 => 0.4743, std.dev.: 0.0022)
  MultiSource/Applications/spiff/spiff: -2.40% (0.9365 => 0.9140, std.dev.: 0.0045)
  MultiSource/Applications/d/make_dparser: -1.96% (3.7330 => 3.6600, std.dev.: 0.0185)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.79% (1.2911 => 0.7257, std.dev.: 0.0039)
  MultiSource/Applications/lemon/lemon: -34.68% (1.3499 => 0.8818, std.dev.: 0.1558)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.46% (4.4050 => 3.2393, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.77% (6.2328 => 5.0007, std.dev.: 0.0278)
  MultiSource/Applications/minisat/minisat: -15.09% (7.3703 => 6.2578, std.dev.: 0.4047)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.07% (25.3677 => 21.5437, std.dev.: 0.4588)
  SingleSource/Benchmarks/Misc/salsa20: -12.98% (10.3398 => 8.9977, std.dev.: 0.0154)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.07% (48.3307 => 43.4640, std.dev.: 0.5041)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.30% (1.6679 => 1.5128, std.dev.: 0.0454)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.96% (3.5327 => 3.2161, std.dev.: 0.0641)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.89% (0.7941 => 0.7235, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.69% (5.5889 => 5.2148, std.dev.: 0.0529)
  MultiSource/Applications/sqlite3/sqlite3: -6.41% (4.6358 => 4.3385, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.82% (9.8728 => 9.2982, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.55% (4.5717 => 4.3181, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.77% (5.3184 => 5.0648, std.dev.: 0.0174)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.39% (0.2777 => 0.2655, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.20% (5.3276 => 5.1039, std.dev.: 0.0101)
  MultiSource/Applications/hexxagon/hexxagon: -3.81% (15.4979 => 14.9080, std.dev.: 0.0934)
  SingleSource/Benchmarks/Misc/flops: -3.52% (10.2170 => 9.8574, std.dev.: 0.0320)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.41% (2.4808 => 2.3962, std.dev.: 0.0121)
  MultiSource/Benchmarks/FreeBench/neural/neural: -3.10% (0.3513 => 0.3404, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/sieve: -2.97% (8.0178 => 7.7793, std.dev.: 0.0391)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.86% (5.7342 => 5.5701, std.dev.: 0.0395)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.80% (3.8665 => 3.7584, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.22% (4.5094 => 4.4093, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.94% (4.2167 => 4.1350, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.78% (8.5243 => 8.3725, std.dev.: 0.0077)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.55% (2.5408 => 2.5014, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.39% (1.4783 => 1.4578, std.dev.: 0.0068)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.33% (12.1841 => 12.0222, std.dev.: 0.0058)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1441 => 0.1443, std.dev.: 0.0012)

Report Time: 1.29s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130605/e43dcaaf/attachment.html>


More information about the llvm-testresults mailing list