[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 30 12:44:50 PST 2013


http://llvm.org/perf/db_default/v4/nts/19353?compare_to=19342&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19353, Order: 198227, Start Time: 2013-12-30 19:00:23, End Time: 2013-12-30 20:49:27
      To: 19342, Order: 198214, Start Time: 2013-12-30 16:47:52, End Time: 2013-12-30 18:33:22
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 44 (45 on baseline)
Performance Improvements: 4 (7 on baseline)
Unchanged Tests: 1062 (1058 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 60.24% (0.0928 => 0.1487, std.dev.: 0.0092)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.26% (0.0889 => 0.1398, std.dev.: 0.0133)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 46.13% (0.3523 => 0.5148, std.dev.: 0.0385)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 42.23% (0.6893 => 0.9804, std.dev.: 0.0191)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 35.16% (0.5697 => 0.7700, std.dev.: 0.0285)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 34.00% (0.3721 => 0.4986, std.dev.: 0.0363)
  MultiSource/Applications/obsequi/Obsequi: 27.46% (1.1604 => 1.4790, std.dev.: 0.0316)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.51% (0.4988 => 0.6011, std.dev.: 0.0295)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.14% (1.1078 => 1.3309, std.dev.: 0.0864)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.98% (0.6668 => 0.8000, std.dev.: 0.0468)
  MultiSource/Applications/spiff/spiff: 18.79% (0.9173 => 1.0897, std.dev.: 0.0338)
  SingleSource/UnitTests/Vector/constpool: 18.46% (9.1469 => 10.8358, std.dev.: 0.6124)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.78% (1.3221 => 1.4778, std.dev.: 0.0012)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.05% (2.7636 => 3.0414, std.dev.: 0.0527)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.79% (14.8184 => 16.2696, std.dev.: 0.0662)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.18% (9.8299 => 10.6338, std.dev.: 0.2323)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.80% (27.3769 => 29.2376, std.dev.: 0.1461)
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.45% (0.2045 => 0.2177, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.69% (1.3519 => 1.4288, std.dev.: 0.0160)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.80% (1.5651 => 1.6402, std.dev.: 0.0207)
  MultiSource/Applications/sqlite3/sqlite3: 4.00% (22.1124 => 22.9980, std.dev.: 0.3395)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.83% (1.3570 => 1.4090, std.dev.: 0.0114)
  MultiSource/Applications/lemon/lemon: 3.22% (1.3366 => 1.3796, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.24% (1.3300 => 1.3598, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.59% (1.3072 => 1.3280, std.dev.: 0.0072)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 43.03% (2.8556 => 4.0844, std.dev.: 0.2197)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.48% (28.4485 => 33.9890, std.dev.: 1.0012)
  SingleSource/Benchmarks/Shootout-C++/ary3: 15.17% (4.6308 => 5.3333, std.dev.: 0.2620)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.50% (2.0960 => 2.3790, std.dev.: 0.0090)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.05% (9.4121 => 10.5459, std.dev.: 0.1468)
  MultiSource/Benchmarks/nbench/nbench: 11.56% (20.0552 => 22.3741, std.dev.: 0.6671)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.48% (0.3311 => 0.3691, std.dev.: 0.0112)
  MultiSource/Applications/obsequi/Obsequi: 8.25% (2.2908 => 2.4797, std.dev.: 0.0401)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.75% (5.0045 => 5.3923, std.dev.: 0.0209)
  SingleSource/Benchmarks/Shootout/hash: 5.30% (5.1693 => 5.4434, std.dev.: 0.0528)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.24% (4.5657 => 4.8049, std.dev.: 0.0262)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.13% (2.6703 => 2.8073, std.dev.: 0.0306)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.06% (4.1016 => 4.3093, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.53% (3.9414 => 4.1199, std.dev.: 0.0289)
  MultiSource/Benchmarks/Olden/health/health: 3.28% (0.3199 => 0.3304, std.dev.: 0.0011)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.44% (39.5089 => 40.4731, std.dev.: 0.1760)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.15% (6.7842 => 6.9298, std.dev.: 0.0475)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.90% (4.8972 => 4.9902, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.20% (4.0473 => 4.0958, std.dev.: 0.0152)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.68% (0.3908 => 0.3217, std.dev.: 0.0030)
  MultiSource/Applications/JM/lencod/lencod: -8.87% (8.4865 => 7.7339, std.dev.: 0.0587)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.66% (101.7815 => 99.0788, std.dev.: 0.7621)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.76% (51.2310 => 50.3273, std.dev.: 0.2299)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 60.58% (0.0926 => 0.1487, std.dev.: 0.0092)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 59.04% (0.0879 => 0.1398, std.dev.: 0.0133)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 55.77% (0.3859 => 0.6011, std.dev.: 0.0295)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 53.44% (0.3355 => 0.5148, std.dev.: 0.0385)
  MultiSource/Applications/sqlite3/sqlite3: 46.09% (15.7419 => 22.9980, std.dev.: 0.3395)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 41.23% (0.6942 => 0.9804, std.dev.: 0.0191)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 35.97% (0.5663 => 0.7700, std.dev.: 0.0285)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 33.49% (0.3735 => 0.4986, std.dev.: 0.0363)
  MultiSource/Applications/obsequi/Obsequi: 24.23% (1.1905 => 1.4790, std.dev.: 0.0316)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.89% (1.0830 => 1.3309, std.dev.: 0.0864)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.27% (0.6597 => 0.8000, std.dev.: 0.0468)
  MultiSource/Applications/spiff/spiff: 20.84% (0.9018 => 1.0897, std.dev.: 0.0338)
  SingleSource/UnitTests/Vector/constpool: 17.55% (9.2178 => 10.8358, std.dev.: 0.6124)
  MultiSource/Applications/lemon/lemon: 13.08% (1.2200 => 1.3796, std.dev.: 0.0116)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.60% (25.9661 => 29.2376, std.dev.: 0.1461)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.31% (2.7572 => 3.0414, std.dev.: 0.0527)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.21% (5.5433 => 6.1091, std.dev.: 0.2021)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.39% (1.3510 => 1.4778, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.04% (9.8425 => 10.6338, std.dev.: 0.2323)
  MultiSource/Applications/SIBsim4/SIBsim4: 7.92% (1.5198 => 1.6402, std.dev.: 0.0207)
  SingleSource/Benchmarks/Shootout-C++/methcall: 7.08% (0.2033 => 0.2177, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.61% (15.4053 => 16.2696, std.dev.: 0.0662)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.91% (1.3750 => 1.4288, std.dev.: 0.0160)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.30% (0.8787 => 0.9077, std.dev.: 0.0089)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 36.40% (2.9945 => 4.0844, std.dev.: 0.2197)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.58% (28.6638 => 33.9890, std.dev.: 1.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.57% (5.9583 => 7.0050, std.dev.: 0.0839)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.18% (2.1020 => 2.3790, std.dev.: 0.0090)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.92% (0.3358 => 0.3691, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.34% (3.3810 => 3.6630, std.dev.: 0.0162)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.83% (1.1019 => 1.1882, std.dev.: 0.0056)
  MultiSource/Applications/obsequi/Obsequi: 7.53% (2.3061 => 2.4797, std.dev.: 0.0401)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.16% (5.0320 => 5.3923, std.dev.: 0.0209)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.55% (2.8940 => 3.0546, std.dev.: 0.0619)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.31% (2.6658 => 2.8073, std.dev.: 0.0306)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 5.23% (10.0217 => 10.5459, std.dev.: 0.1468)
  MultiSource/Applications/siod/siod: 5.10% (3.4258 => 3.6004, std.dev.: 0.0498)
  SingleSource/Benchmarks/Shootout/hash: 4.89% (5.1896 => 5.4434, std.dev.: 0.0528)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.72% (4.5883 => 4.8049, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.93% (4.1462 => 4.3093, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.63% (3.9755 => 4.1199, std.dev.: 0.0289)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.44% (4.8243 => 4.9902, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.10% (5.9126 => 6.0365, std.dev.: 0.0394)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.97% (4.4509 => 4.5384, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.74% (11.7894 => 11.9942, std.dev.: 0.0102)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.10% (0.1774 => 0.1648, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -3.90% (1.3819 => 1.3280, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.27% (1.2824 => 1.2405, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.16% (1.3146 => 1.2730, std.dev.: 0.0154)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/JM/lencod/lencod: -2.66% (7.9450 => 7.7339, std.dev.: 0.0587)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (50.9650 => 50.3273, std.dev.: 0.2299)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.06% (2.8568 => 2.8265, std.dev.: 0.0054)

Report Time: 1.25s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131230/23bc84b0/attachment.html>


More information about the llvm-testresults mailing list