[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 27 13:28:16 PST 2013


http://llvm.org/perf/db_default/v4/nts/19126?compare_to=19115&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19126, Order: 198078, Start Time: 2013-12-27 19:44:48, End Time: 2013-12-27 21:32:50
      To: 19115, Order: 198076, Start Time: 2013-12-27 17:07:27, End Time: 2013-12-27 18:47:47
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 60 (62 on baseline)
Performance Improvements: 5 (13 on baseline)
Unchanged Tests: 1045 (1035 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 59.48% (0.1308 => 0.2086, std.dev.: 0.0112)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 43.23% (0.5584 => 0.7998, std.dev.: 0.0888)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 40.51% (0.6766 => 0.9507, std.dev.: 0.0999)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 29.58% (0.1670 => 0.2164, std.dev.: 0.0163)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.34% (1.3867 => 1.7381, std.dev.: 0.0899)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.68% (0.0456 => 0.0564, std.dev.: 0.0028)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.27% (0.1332 => 0.1642, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.00% (1.6962 => 2.0863, std.dev.: 0.1182)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 22.00% (9.6797 => 11.8097, std.dev.: 0.1029)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 20.33% (0.9153 => 1.1014, std.dev.: 0.0545)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 19.36% (1.1506 => 1.3734, std.dev.: 0.0260)
  MultiSource/Applications/obsequi/Obsequi: 19.25% (1.1567 => 1.3794, std.dev.: 0.0816)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.94% (0.0620 => 0.0725, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/football/football: 16.89% (1.0021 => 1.1714, std.dev.: 0.0102)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.46% (0.0887 => 0.1033, std.dev.: 0.0008)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.44% (5.1125 => 5.9528, std.dev.: 0.3087)
  MultiSource/Applications/lua/lua: 12.15% (4.2706 => 4.7896, std.dev.: 0.1417)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.26% (7.2920 => 8.1134, std.dev.: 0.1877)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.63% (1.2778 => 1.4136, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.69% (5.4351 => 5.9619, std.dev.: 0.0164)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.79% (2.7657 => 3.0089, std.dev.: 0.0545)
  MultiSource/Applications/JM/ldecod/ldecod: 8.60% (7.5435 => 8.1922, std.dev.: 0.2422)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.22% (1.2395 => 1.3414, std.dev.: 0.0132)
  MultiSource/Applications/kimwitu++/kc: 8.11% (18.5345 => 20.0380, std.dev.: 0.3707)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.10% (1.3195 => 1.4264, std.dev.: 0.0229)
  MultiSource/Applications/JM/lencod/lencod: 7.71% (17.3265 => 18.6626, std.dev.: 0.4428)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.36% (1.9832 => 2.1291, std.dev.: 0.0448)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.28% (0.2934 => 0.3089, std.dev.: 0.0054)
  MultiSource/Applications/oggenc/oggenc: 4.56% (5.6234 => 5.8800, std.dev.: 0.0754)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.99% (0.3407 => 0.3543, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.30% (0.3792 => 0.3917, std.dev.: 0.0013)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 108.13% (0.1340 => 0.2789, std.dev.: 0.0246)
  MultiSource/Benchmarks/Olden/bisort/bisort: 36.64% (0.6608 => 0.9029, std.dev.: 0.0216)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 27.97% (4.5588 => 5.8339, std.dev.: 0.0994)
  MultiSource/Applications/minisat/minisat: 27.86% (6.3072 => 8.0643, std.dev.: 0.1419)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 26.40% (1.2450 => 1.5737, std.dev.: 0.0392)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.36% (1.2745 => 1.5085, std.dev.: 0.0403)
  SingleSource/Benchmarks/Shootout/ary3: 15.17% (4.3985 => 5.0658, std.dev.: 0.1855)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.25% (2.1024 => 2.3810, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 12.15% (3.9137 => 4.3891, std.dev.: 0.0583)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.48% (6.2513 => 6.7811, std.dev.: 0.0719)
  MultiSource/Benchmarks/llubenchmark/llu: 8.29% (1.9724 => 2.1360, std.dev.: 0.0573)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.84% (9.3337 => 10.0653, std.dev.: 0.2774)
  MultiSource/Applications/obsequi/Obsequi: 7.57% (2.3420 => 2.5194, std.dev.: 0.0387)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.42% (5.0267 => 5.3995, std.dev.: 0.0088)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.74% (36.2924 => 38.7371, std.dev.: 0.9025)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.84% (0.6032 => 0.6384, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.38% (40.2881 => 42.4576, std.dev.: 0.2914)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (14.6978 => 15.4635, std.dev.: 0.2805)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.08% (4.1010 => 4.3094, std.dev.: 0.0108)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.39% (2.3154 => 2.4171, std.dev.: 0.0274)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.91% (4.4276 => 4.6009, std.dev.: 0.0601)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.41% (6.4893 => 6.7106, std.dev.: 0.0252)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.41% (1.6382 => 1.6940, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/bh/bh: 3.02% (2.3850 => 2.4571, std.dev.: 0.0215)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.99% (3.9911 => 4.1104, std.dev.: 0.0422)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.88% (5.4899 => 5.5931, std.dev.: 0.0147)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.63% (5.8017 => 5.8963, std.dev.: 0.0117)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.48% (3.5654 => 3.6180, std.dev.: 0.0203)
  SingleSource/Benchmarks/Shootout-C++/hash: 1.47% (0.7433 => 0.7542, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.82% (5.9403 => 5.5947, std.dev.: 0.0101)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.18% (4.3993 => 4.2153, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.50% (6.1138 => 5.9001, std.dev.: 0.0484)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.94% (8.6770 => 8.5086, std.dev.: 0.0106)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.26% (3.1919 => 3.1516, std.dev.: 0.0099)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 52.37% (0.1369 => 0.2086, std.dev.: 0.0112)
  MultiSource/Applications/sqlite3/sqlite3: 46.66% (15.7419 => 23.0868, std.dev.: 0.7378)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 41.98% (0.3859 => 0.5479, std.dev.: 0.0435)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 41.23% (0.5663 => 0.7998, std.dev.: 0.0888)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 25.96% (0.1718 => 0.2164, std.dev.: 0.0163)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.33% (1.7054 => 2.0863, std.dev.: 0.1182)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.29% (1.4449 => 1.7381, std.dev.: 0.0899)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.99% (9.8425 => 11.8097, std.dev.: 0.1029)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 18.31% (1.1608 => 1.3734, std.dev.: 0.0260)
  MultiSource/Benchmarks/Prolangs-C/football/football: 18.14% (0.9915 => 1.1714, std.dev.: 0.0102)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.75% (5.0556 => 5.9528, std.dev.: 0.3087)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.71% (0.9437 => 1.1014, std.dev.: 0.0545)
  MultiSource/Applications/lua/lua: 12.07% (4.2737 => 4.7896, std.dev.: 0.1417)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 11.56% (0.0926 => 0.1033, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.13% (2.7572 => 3.0089, std.dev.: 0.0545)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.00% (7.5124 => 8.1134, std.dev.: 0.1877)
  MultiSource/Applications/JM/lencod/lencod: 7.90% (17.2968 => 18.6626, std.dev.: 0.4428)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.35% (1.2495 => 1.3414, std.dev.: 0.0132)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.35% (1.9834 => 2.1291, std.dev.: 0.0448)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.24% (1.3182 => 1.4136, std.dev.: 0.0098)
  MultiSource/Applications/kimwitu++/kc: 7.23% (18.6861 => 20.0380, std.dev.: 0.3707)
  MultiSource/Applications/oggenc/oggenc: 6.97% (5.4968 => 5.8800, std.dev.: 0.0754)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.58% (1.3510 => 1.4264, std.dev.: 0.0229)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.35% (0.2057 => 0.2167, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.26% (0.3366 => 0.3543, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (0.2945 => 0.3089, std.dev.: 0.0054)
  SingleSource/UnitTests/Vector/constpool: 4.71% (9.2178 => 9.6524, std.dev.: 0.1019)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.23% (0.3758 => 0.3917, std.dev.: 0.0013)
  MultiSource/Applications/siod/siod: 3.30% (2.5491 => 2.6333, std.dev.: 0.0237)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.48% (5.8749 => 5.9619, std.dev.: 0.0164)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 107.36% (0.1345 => 0.2789, std.dev.: 0.0246)
  MultiSource/Benchmarks/Olden/bisort/bisort: 34.12% (0.6732 => 0.9029, std.dev.: 0.0216)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 27.46% (4.5769 => 5.8339, std.dev.: 0.0994)
  MultiSource/Applications/minisat/minisat: 26.24% (6.3881 => 8.0643, std.dev.: 0.1419)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.86% (1.2278 => 1.5085, std.dev.: 0.0403)
  SingleSource/Benchmarks/Shootout/matrix: 17.24% (1.7960 => 2.1057, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.54% (5.9583 => 6.9439, std.dev.: 0.0670)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.27% (2.1020 => 2.3810, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 12.88% (3.8883 => 4.3891, std.dev.: 0.0583)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 9.78% (1.4335 => 1.5737, std.dev.: 0.0392)
  MultiSource/Applications/obsequi/Obsequi: 9.25% (2.3061 => 2.5194, std.dev.: 0.0387)
  MultiSource/Applications/SPASS/SPASS: 8.49% (8.5363 => 9.2608, std.dev.: 0.2184)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.26% (3.3810 => 3.6603, std.dev.: 0.0062)
  MultiSource/Benchmarks/llubenchmark/llu: 8.08% (1.9763 => 2.1360, std.dev.: 0.0573)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.70% (35.9684 => 38.7371, std.dev.: 0.9025)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.30% (5.0320 => 5.3995, std.dev.: 0.0088)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.96% (2.8568 => 3.0555, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.70% (40.5530 => 42.4576, std.dev.: 0.2914)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.60% (3.4043 => 3.5610, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.94% (4.1462 => 4.3094, std.dev.: 0.0108)
  SingleSource/Benchmarks/McGill/chomp: 3.59% (1.0099 => 1.0462, std.dev.: 0.0132)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.49% (2.3355 => 2.4171, std.dev.: 0.0274)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.39% (3.9755 => 4.1104, std.dev.: 0.0422)
  MultiSource/Applications/sgefa/sgefa: 2.88% (0.8745 => 0.8997, std.dev.: 0.0078)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.81% (1.4366 => 1.4769, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.78% (6.5291 => 6.7106, std.dev.: 0.0252)
  MultiSource/Benchmarks/Olden/bh/bh: 2.73% (2.3919 => 2.4571, std.dev.: 0.0215)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.56% (1.8409 => 1.8881, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.13% (11.7894 => 12.0401, std.dev.: 0.0408)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.63% (5.5032 => 5.5931, std.dev.: 0.0147)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (1.6699 => 1.6940, std.dev.: 0.0015)
  MultiSource/Applications/viterbi/viterbi: 1.23% (2.6366 => 2.6690, std.dev.: 0.0093)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -24.85% (0.0688 => 0.0517, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -16.77% (0.1938 => 0.1613, std.dev.: 0.0085)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.74% (0.1088 => 0.0982, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.27% (0.6882 => 0.6313, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.96% (0.1523 => 0.1417, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.01% (0.3714 => 0.3528, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.90% (1.3146 => 1.2502, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.33% (1.3660 => 1.3069, std.dev.: 0.0200)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.02% (1.3157 => 1.2628, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.81% (1.3918 => 1.3388, std.dev.: 0.0061)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.90% (5.9456 => 5.5947, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.60% (6.0535 => 5.8963, std.dev.: 0.0117)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.5200 => 2.4816, std.dev.: 0.0020)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131227/a3fee62f/attachment.html>


More information about the llvm-testresults mailing list