[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 17 12:24:18 PST 2013


http://llvm.org/perf/db_default/v4/nts/18533?compare_to=18530&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18533, Order: 197507, Start Time: 2013-12-17 18:43:59, End Time: 2013-12-17 20:28:39
      To: 18530, Order: 197503, Start Time: 2013-12-17 16:31:31, End Time: 2013-12-17 18:19:33
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 16 (20 on baseline)
Performance Improvements: 42 (25 on baseline)
Unchanged Tests: 1052 (1065 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 37.63% (1.6995 => 2.3390, std.dev.: 0.1280)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.85% (29.0078 => 32.4443, std.dev.: 1.2165)
  SingleSource/Benchmarks/McGill/misr: 11.21% (0.3738 => 0.4157, std.dev.: 0.0122)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.65% (1.3750 => 1.5077, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 8.86% (0.3657 => 0.3981, std.dev.: 0.0026)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 7.70% (0.4846 => 0.5219, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.39% (1.2525 => 1.3450, std.dev.: 0.0150)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 6.82% (1.1085 => 1.1841, std.dev.: 0.0196)
  MultiSource/Benchmarks/sim/sim: 4.23% (3.8462 => 4.0089, std.dev.: 0.0131)
  MultiSource/Applications/aha/aha: 4.07% (3.6291 => 3.7768, std.dev.: 0.0045)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (2.4823 => 2.5370, std.dev.: 0.0211)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.87% (1.5960 => 1.6258, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.36% (1.6117 => 1.6336, std.dev.: 0.0056)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.33% (2.3836 => 2.4152, std.dev.: 0.0052)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.08% (18.5950 => 18.7953, std.dev.: 0.0758)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.06% (6.6145 => 6.6843, std.dev.: 0.0102)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/mason/mason: -40.32% (0.1121 => 0.0669, std.dev.: 0.0010)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -22.24% (0.0706 => 0.0549, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -20.70% (0.0884 => 0.0701, std.dev.: 0.0070)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -20.29% (0.4475 => 0.3567, std.dev.: 0.0125)
  SingleSource/Benchmarks/Stanford/Queens: -20.04% (0.0544 => 0.0435, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -15.26% (0.5563 => 0.4714, std.dev.: 0.0102)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -12.81% (1.4967 => 1.3050, std.dev.: 0.0515)
  MultiSource/Benchmarks/Prolangs-C/football/football: -12.50% (1.1458 => 1.0026, std.dev.: 0.0059)
  MultiSource/Benchmarks/nbench/nbench: -12.23% (1.3990 => 1.2279, std.dev.: 0.0030)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -12.22% (0.1907 => 0.1674, std.dev.: 0.0077)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -11.97% (0.7611 => 0.6700, std.dev.: 0.0099)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.93% (0.2943 => 0.2592, std.dev.: 0.0106)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.30% (0.2664 => 0.2363, std.dev.: 0.0014)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -10.77% (6.1169 => 5.4581, std.dev.: 0.0793)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.11% (1.8307 => 1.6822, std.dev.: 0.0231)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.59% (5.8126 => 5.4298, std.dev.: 0.0786)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.30% (1.1325 => 1.0612, std.dev.: 0.0187)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.28% (1.4797 => 1.3868, std.dev.: 0.0142)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -6.10% (0.1821 => 0.1710, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.07% (0.9066 => 0.8606, std.dev.: 0.0172)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.80% (10.1596 => 9.6724, std.dev.: 0.1115)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.56% (0.2281 => 0.2177, std.dev.: 0.0037)
  MultiSource/Benchmarks/sim/sim: -4.49% (0.3809 => 0.3638, std.dev.: 0.0044)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.31% (0.3527 => 0.3375, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.09% (0.5791 => 0.5554, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.98% (0.5028 => 0.4828, std.dev.: 0.0025)
  SingleSource/Benchmarks/Linpack/linpack-pc: -3.57% (0.3217 => 0.3102, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -3.42% (0.6774 => 0.6542, std.dev.: 0.0085)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.31% (1.6880 => 1.6322, std.dev.: 0.0141)
  SingleSource/Benchmarks/Shootout-C++/hash2: -3.26% (0.4416 => 0.4272, std.dev.: 0.0020)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.80% (0.3640 => 0.3538, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.22% (0.6843 => 0.6691, std.dev.: 0.0058)
  MultiSource/Applications/lemon/lemon: -1.81% (1.3511 => 1.3267, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.46% (1.1042 => 1.0881, std.dev.: 0.0050)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.00% (0.0415 => 0.0249, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/ary3: -26.92% (5.8752 => 4.2935, std.dev.: 0.5677)
  MultiSource/Benchmarks/FreeBench/mason/mason: -19.15% (0.3613 => 0.2921, std.dev.: 0.0033)
  MultiSource/Benchmarks/FreeBench/distray/distray: -7.36% (0.2580 => 0.2390, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.85% (63.6283 => 60.5455, std.dev.: 0.1667)
  MultiSource/Benchmarks/llubenchmark/llu: -4.65% (2.0733 => 1.9769, std.dev.: 0.0242)
  SingleSource/Benchmarks/Misc/flops-6: -2.26% (2.4687 => 2.4128, std.dev.: 0.0065)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.93% (21.9685 => 21.5450, std.dev.: 0.1213)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 39.20% (15.7419 => 21.9123, std.dev.: 0.7980)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 22.16% (0.3859 => 0.4714, std.dev.: 0.0102)
  MultiSource/Applications/lemon/lemon: 8.75% (1.2200 => 1.3267, std.dev.: 0.0051)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 40.19% (1.6685 => 2.3390, std.dev.: 0.1280)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.98% (5.9583 => 6.9104, std.dev.: 0.1677)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.19% (28.6638 => 32.4443, std.dev.: 1.2165)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.95% (1.3838 => 1.5077, std.dev.: 0.0007)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.46% (1.1019 => 1.1841, std.dev.: 0.0196)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.12% (1.2556 => 1.3450, std.dev.: 0.0150)
  MultiSource/Applications/lua/lua: 6.04% (29.1357 => 30.8966, std.dev.: 0.5007)
  MultiSource/Applications/aha/aha: 5.96% (3.5645 => 3.7768, std.dev.: 0.0045)
  MultiSource/Applications/siod/siod: 5.58% (3.4258 => 3.6170, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.92% (1.5797 => 1.6258, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.38% (6.5291 => 6.6843, std.dev.: 0.0102)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.19% (1.5986 => 1.6336, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout/lists: 2.11% (6.9930 => 7.1407, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.99% (3.1547 => 3.2174, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.79% (5.9126 => 6.0184, std.dev.: 0.0403)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.79% (11.7894 => 12.0003, std.dev.: 0.0680)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.13% (2.3882 => 2.4152, std.dev.: 0.0052)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -27.03% (0.0688 => 0.0502, std.dev.: 0.0019)
  MultiSource/Benchmarks/Bullet/bullet: -9.73% (36.6274 => 33.0622, std.dev.: 0.9619)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -8.16% (0.3247 => 0.2982, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.58% (5.8749 => 5.4298, std.dev.: 0.0786)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.97% (0.2540 => 0.2363, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.73% (1.3676 => 1.2756, std.dev.: 0.0254)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.54% (0.1774 => 0.1658, std.dev.: 0.0037)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -6.36% (1.0197 => 0.9548, std.dev.: 0.0207)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.16% (0.1673 => 0.1570, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.69% (0.2810 => 0.2650, std.dev.: 0.0014)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.51% (0.2758 => 0.2606, std.dev.: 0.0029)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.84% (0.2251 => 0.2142, std.dev.: 0.0018)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.74% (0.3714 => 0.3538, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.63% (1.1409 => 1.0881, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.33% (1.5034 => 1.4383, std.dev.: 0.0050)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.02% (1.4449 => 1.3868, std.dev.: 0.0142)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.19% (0.6995 => 0.6772, std.dev.: 0.0082)
  MultiSource/Benchmarks/nbench/nbench: -2.91% (1.2647 => 1.2279, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.79% (0.7375 => 0.7169, std.dev.: 0.0076)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -40.38% (0.0369 => 0.0220, std.dev.: 0.0041)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.50% (2.8850 => 2.3801, std.dev.: 0.0929)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.87% (50.9650 => 46.4461, std.dev.: 1.5833)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -7.48% (10.0217 => 9.2720, std.dev.: 0.2302)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.33% (6.0535 => 5.8520, std.dev.: 0.0275)
  MultiSource/Applications/sgefa/sgefa: -1.44% (0.8745 => 0.8619, std.dev.: 0.0027)

Report Time: 1.19s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131217/7047fc9f/attachment.html>


More information about the llvm-testresults mailing list