[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jul 27 05:16:25 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13817?compare_to=13813&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13817, Order: 187296, Start Time: 2013-07-27 10:21:24, End Time: 2013-07-27 12:18:05
      To: 13813, Order: 187295, Start Time: 2013-07-27 07:48:22, End Time: 2013-07-27 09:29:30
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 62 (57 on baseline)
Performance Improvements: 3 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1042 (1036 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-07-10-SignConversions: 92.02% (0.0163 => 0.0313, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/ffbench: 79.49% (0.0790 => 0.1418, std.dev.: 0.0086)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 78.00% (0.0150 => 0.0267, std.dev.: 0.0024)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 68.56% (0.0773 => 0.1303, std.dev.: 0.0063)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 62.30% (0.0374 => 0.0607, std.dev.: 0.0071)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 55.98% (0.3812 => 0.5946, std.dev.: 0.0275)
  SingleSource/Regression/C++/global_ctor: 49.32% (0.0219 => 0.0327, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/methcall: 49.31% (0.2312 => 0.3452, std.dev.: 0.0387)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 44.18% (0.8873 => 1.2793, std.dev.: 0.0356)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 41.33% (0.6637 => 0.9380, std.dev.: 0.0230)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 37.85% (1.1160 => 1.5384, std.dev.: 0.1440)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 32.42% (0.7086 => 0.9383, std.dev.: 0.0852)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 31.89% (0.3449 => 0.4549, std.dev.: 0.0228)
  MultiSource/Applications/spiff/spiff: 31.77% (0.9325 => 1.2288, std.dev.: 0.0612)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 29.40% (1.1828 => 1.5306, std.dev.: 0.0585)
  MultiSource/Applications/lua/lua: 27.13% (4.3820 => 5.5708, std.dev.: 0.0885)
  MultiSource/Applications/Burg/burg: 24.37% (1.4653 => 1.8224, std.dev.: 0.0683)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.10% (6.4879 => 7.8567, std.dev.: 0.2521)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.96% (0.9809 => 1.1571, std.dev.: 0.0578)
  MultiSource/Applications/d/make_dparser: 17.67% (3.7247 => 4.3827, std.dev.: 0.0556)
  MultiSource/Applications/sgefa/sgefa: 17.52% (0.4133 => 0.4857, std.dev.: 0.0216)
  MultiSource/Applications/JM/ldecod/ldecod: 17.39% (7.6351 => 8.9630, std.dev.: 0.2701)
  MultiSource/Applications/JM/lencod/lencod: 17.27% (17.3580 => 20.3561, std.dev.: 0.3533)
  MultiSource/Applications/siod/siod: 17.27% (2.5163 => 2.9508, std.dev.: 0.0811)
  MultiSource/Applications/lemon/lemon: 16.01% (1.2358 => 1.4337, std.dev.: 0.0254)
  MultiSource/Applications/SPASS/SPASS: 15.67% (17.0613 => 19.7345, std.dev.: 0.3947)
  MultiSource/Applications/kimwitu++/kc: 15.51% (19.4195 => 22.4319, std.dev.: 0.4741)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.62% (0.1382 => 0.1584, std.dev.: 0.0039)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.58% (7.6238 => 8.7354, std.dev.: 0.3951)
  SingleSource/Benchmarks/Misc/whetstone: 14.22% (0.0921 => 0.1052, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 11.71% (0.0948 => 0.1059, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.66% (1.4507 => 1.5909, std.dev.: 0.0484)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 89.27% (0.7589 => 1.4364, std.dev.: 0.1635)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 65.05% (0.0455 => 0.0751, std.dev.: 0.0031)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 57.59% (0.0224 => 0.0353, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 54.75% (2.9254 => 4.5271, std.dev.: 0.4228)
  MultiSource/Applications/minisat/minisat: 43.09% (6.2865 => 8.9955, std.dev.: 0.6635)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 42.95% (4.5021 => 6.4359, std.dev.: 0.7396)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 34.31% (0.0580 => 0.0779, std.dev.: 0.0028)
  MultiSource/Applications/JM/ldecod/ldecod: 30.09% (0.0648 => 0.0843, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 29.51% (1.4627 => 1.8944, std.dev.: 0.0069)
  MultiSource/Applications/obsequi/Obsequi: 15.31% (2.2147 => 2.5537, std.dev.: 0.0846)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 9.20% (2.7453 => 2.9980, std.dev.: 0.0207)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.63% (0.3291 => 0.3575, std.dev.: 0.0110)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.41% (15.4558 => 16.7555, std.dev.: 0.2775)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.32% (0.8465 => 0.9169, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.25% (4.9325 => 5.2900, std.dev.: 0.0574)
  SingleSource/Benchmarks/Misc/salsa20: 6.72% (8.4615 => 9.0302, std.dev.: 0.0127)
  SingleSource/Benchmarks/Misc/fp-convert: 6.32% (7.5912 => 8.0710, std.dev.: 0.0176)
  MultiSource/Applications/sqlite3/sqlite3: 5.96% (4.3277 => 4.5857, std.dev.: 0.0391)
  MultiSource/Applications/lua/lua: 5.68% (28.7202 => 30.3520, std.dev.: 0.1605)
  SingleSource/Regression/C/uint64_to_float: 5.19% (1.4245 => 1.4985, std.dev.: 0.0076)
  SingleSource/Benchmarks/Misc/flops: 4.62% (9.5102 => 9.9492, std.dev.: 0.0119)
  MultiSource/Applications/siod/siod: 4.37% (3.8384 => 4.0061, std.dev.: 0.0180)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.88% (1.4572 => 1.5138, std.dev.: 0.0078)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.50% (21.0002 => 21.5245, std.dev.: 0.1542)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.39% (1.0701 => 1.0957, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.29% (3.5211 => 3.6017, std.dev.: 0.0102)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.13% (11.3904 => 11.6327, std.dev.: 0.0302)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.03% (1.5805 => 1.6126, std.dev.: 0.0120)
  MultiSource/Applications/spiff/spiff: 1.60% (2.7498 => 2.7938, std.dev.: 0.0150)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.48% (6.1161 => 6.2065, std.dev.: 0.0302)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -21.38% (2.5443 => 2.0004, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.61% (5.7682 => 5.2139, std.dev.: 0.0973)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.53% (0.6600 => 0.6367, std.dev.: 0.0070)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 9.28% (0.1293 => 0.1413, std.dev.: 0.0273)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-07-10-SignConversions: 76.84% (0.0177 => 0.0313, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/ffbench: 75.71% (0.0807 => 0.1418, std.dev.: 0.0086)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 66.20% (0.0784 => 0.1303, std.dev.: 0.0063)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 58.07% (0.0384 => 0.0607, std.dev.: 0.0071)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 53.52% (0.3873 => 0.5946, std.dev.: 0.0275)
  SingleSource/Benchmarks/Shootout-C++/methcall: 50.09% (0.2300 => 0.3452, std.dev.: 0.0387)
  SingleSource/Regression/C++/global_ctor: 47.30% (0.0222 => 0.0327, std.dev.: 0.0031)
  SingleSource/UnitTests/Vector/simple: 45.45% (0.0220 => 0.0320, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 41.91% (0.9015 => 1.2793, std.dev.: 0.0356)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 38.25% (0.6785 => 0.9380, std.dev.: 0.0230)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 36.30% (1.1287 => 1.5384, std.dev.: 0.1440)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 29.68% (0.3508 => 0.4549, std.dev.: 0.0228)
  MultiSource/Applications/spiff/spiff: 28.29% (0.9578 => 1.2288, std.dev.: 0.0612)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 20.91% (6.4979 => 7.8567, std.dev.: 0.2521)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.54% (0.9761 => 1.1571, std.dev.: 0.0578)
  MultiSource/Applications/d/make_dparser: 16.18% (3.7722 => 4.3827, std.dev.: 0.0556)
  MultiSource/Applications/Burg/burg: 15.83% (1.5733 => 1.8224, std.dev.: 0.0683)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.40% (7.7035 => 8.7354, std.dev.: 0.3951)
  SingleSource/Benchmarks/Misc/whetstone: 11.68% (0.0942 => 0.1052, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.31% (0.1423 => 0.1584, std.dev.: 0.0039)
  MultiSource/Applications/lemon/lemon: 10.49% (1.2976 => 1.4337, std.dev.: 0.0254)
  MultiSource/Applications/SPASS/SPASS: 10.18% (17.9111 => 19.7345, std.dev.: 0.3947)
  MultiSource/Applications/JM/lencod/lencod: 10.02% (18.5029 => 20.3561, std.dev.: 0.3533)
  MultiSource/Applications/siod/siod: 8.69% (2.7150 => 2.9508, std.dev.: 0.0811)
  MultiSource/Applications/kimwitu++/kc: 6.43% (21.0770 => 22.4319, std.dev.: 0.4741)
  MultiSource/Applications/lua/lua: 4.71% (5.3200 => 5.5708, std.dev.: 0.0885)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 84.07% (0.0182 => 0.0335, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 55.93% (2.9033 => 4.5271, std.dev.: 0.4228)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.23% (2.8867 => 4.3077, std.dev.: 0.0126)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 47.54% (0.0509 => 0.0751, std.dev.: 0.0031)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.78% (0.0341 => 0.0463, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 34.78% (0.0578 => 0.0779, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.04% (1.5030 => 1.8944, std.dev.: 0.0069)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 20.53% (0.0526 => 0.0634, std.dev.: 0.0004)
  MultiSource/Applications/siod/siod: 18.66% (3.3761 => 4.0061, std.dev.: 0.0180)
  SingleSource/Benchmarks/Shootout-C++/lists1: 13.01% (0.6034 => 0.6819, std.dev.: 0.0275)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.01% (14.9584 => 16.7555, std.dev.: 0.2775)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.50% (0.1348 => 0.1503, std.dev.: 0.0003)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 10.61% (1.2557 => 1.3889, std.dev.: 0.0471)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9479, std.dev.: 0.0832)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.91% (3.2027 => 3.4241, std.dev.: 0.0332)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.87% (2.8052 => 2.9980, std.dev.: 0.0207)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.80% (48.3256 => 51.6108, std.dev.: 0.6392)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.22% (0.2799 => 0.2973, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.67% (3.4085 => 3.6018, std.dev.: 0.0327)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 5.66% (1.4327 => 1.5138, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.53% (5.5008 => 5.8050, std.dev.: 0.0695)
  MultiSource/Applications/sqlite3/sqlite3: 4.62% (4.3833 => 4.5857, std.dev.: 0.0391)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.23% (5.1471 => 5.3649, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.98% (4.8739 => 5.0190, std.dev.: 0.0385)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.70% (0.8928 => 0.9169, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.11% (4.9040 => 5.0074, std.dev.: 0.0345)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.88% (3.5351 => 3.6017, std.dev.: 0.0102)
  SingleSource/Benchmarks/Misc/flops: 1.87% (9.7664 => 9.9492, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.40% (3.0680 => 3.1108, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.34% (6.1245 => 6.2065, std.dev.: 0.0302)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.15% (1.5957 => 1.6141, std.dev.: 0.0057)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.31% (0.1818 => 0.1376, std.dev.: 0.0096)
  MultiSource/Benchmarks/nbench/nbench: -4.10% (1.3677 => 1.3116, std.dev.: 0.0152)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.09% (2.1022 => 1.4277, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.62% (6.9552 => 5.2429, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -16.75% (6.2627 => 5.2139, std.dev.: 0.0973)
  MultiSource/Applications/sgefa/sgefa: -12.57% (1.4030 => 1.2266, std.dev.: 0.0052)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.77% (47.2250 => 44.9716, std.dev.: 0.1205)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.77% (0.2854 => 0.2718, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.74% (3.8119 => 3.6313, std.dev.: 0.0246)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.34% (6.0444 => 5.8424, std.dev.: 0.0715)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9611, std.dev.: 0.0372)
  MultiSource/Applications/lua/lua: -2.31% (31.0707 => 30.3520, std.dev.: 0.1605)
  SingleSource/Regression/C/uint64_to_float: -1.31% (1.5184 => 1.4985, std.dev.: 0.0076)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.24% (2.1343 => 2.1078, std.dev.: 0.0067)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.54% (0.1378 => 0.1413, std.dev.: 0.0273)

Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130727/ee28ee2b/attachment.html>


More information about the llvm-testresults mailing list