[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jan 9 06:30:09 PST 2014


http://llvm.org/perf/db_default/v4/nts/20105?compare_to=20097&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 20105, Order: 198862, Start Time: 2014-01-09 12:38:09, End Time: 2014-01-09 14:34:56
      To: 20097, Order: 198858, Start Time: 2014-01-09 10:13:54, End Time: 2014-01-09 12:11:58
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 33 (39 on baseline)
Performance Improvements: 5 (21 on baseline)
Unchanged Tests: 1072 (1050 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 80.00% (0.0665 => 0.1197, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0300 => 0.0450, std.dev.: 0.0030)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 41.21% (0.2378 => 0.3358, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 40.69% (0.0580 => 0.0816, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 34.83% (0.0847 => 0.1142, std.dev.: 0.0109)
  SingleSource/Benchmarks/Misc/ReedSolomon: 34.17% (0.2195 => 0.2945, std.dev.: 0.0081)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 29.44% (0.1695 => 0.2194, std.dev.: 0.0131)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 23.16% (5.1237 => 6.3106, std.dev.: 0.1722)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 23.08% (1.6304 => 2.0067, std.dev.: 0.1002)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.46% (1.3953 => 1.6668, std.dev.: 0.0786)
  MultiSource/Applications/lua/lua: 14.07% (4.3072 => 4.9131, std.dev.: 0.1726)
  MultiSource/Benchmarks/nbench/nbench: 10.13% (1.2740 => 1.4030, std.dev.: 0.0443)
  MultiSource/Applications/kimwitu++/kc: 8.72% (18.6128 => 20.2352, std.dev.: 0.3634)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.30% (1.2076 => 1.2837, std.dev.: 0.0075)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.74% (14.9406 => 15.7980, std.dev.: 0.1381)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 43.13% (0.1535 => 0.2197, std.dev.: 0.0199)
  SingleSource/Benchmarks/Shootout/ary3: 27.26% (4.4985 => 5.7247, std.dev.: 0.1200)
  SingleSource/Benchmarks/Shootout-C++/ary3: 21.01% (4.4055 => 5.3311, std.dev.: 0.3323)
  SingleSource/Benchmarks/Shootout/sieve: 21.00% (6.7273 => 8.1401, std.dev.: 0.0016)
  MultiSource/Applications/obsequi/Obsequi: 15.81% (2.1784 => 2.5228, std.dev.: 0.0183)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.33% (0.4236 => 0.4589, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.13% (3.5391 => 3.7208, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.97% (6.5731 => 6.9001, std.dev.: 0.1067)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 4.88% (1.1903 => 1.2484, std.dev.: 0.0123)
  MultiSource/Applications/JM/lencod/lencod: 4.38% (7.4300 => 7.7552, std.dev.: 0.0183)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.88% (0.5107 => 0.5254, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.85% (5.1875 => 5.3351, std.dev.: 0.0386)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.40% (13.0427 => 13.3556, std.dev.: 0.1000)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 2.11% (2.3748 => 2.4250, std.dev.: 0.0117)
  SingleSource/Benchmarks/Shootout/fib2: 2.04% (3.5877 => 3.6609, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.96% (5.8940 => 6.0095, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/whetstone: 1.18% (3.5754 => 3.6175, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/ReedSolomon: 1.01% (8.3732 => 8.4574, std.dev.: 0.0168)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -7.74% (0.3824 => 0.3528, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.32% (6.1672 => 5.9006, std.dev.: 0.0330)
  MultiSource/Applications/lua/lua: -3.84% (31.3416 => 30.1371, std.dev.: 0.2519)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.76% (2.5176 => 2.4732, std.dev.: 0.0112)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.54% (2.5279 => 2.4889, std.dev.: 0.0083)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 75.00% (0.0684 => 0.1197, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc/fp-convert: 49.01% (0.0302 => 0.0450, std.dev.: 0.0030)
  MultiSource/Applications/sqlite3/sqlite3: 45.15% (15.7419 => 22.8492, std.dev.: 0.2181)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 37.92% (0.0828 => 0.1142, std.dev.: 0.0109)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 37.84% (0.0592 => 0.0816, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc/ReedSolomon: 34.05% (0.2197 => 0.2945, std.dev.: 0.0081)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 32.20% (0.2540 => 0.3358, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 30.06% (0.3859 => 0.5019, std.dev.: 0.0096)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 27.71% (0.1718 => 0.2194, std.dev.: 0.0131)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 24.82% (5.0556 => 6.3106, std.dev.: 0.1722)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.48% (1.6656 => 2.0067, std.dev.: 0.1002)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.36% (1.4449 => 1.6668, std.dev.: 0.0786)
  MultiSource/Applications/lua/lua: 14.96% (4.2737 => 4.9131, std.dev.: 0.1726)
  MultiSource/Benchmarks/nbench/nbench: 10.94% (1.2647 => 1.4030, std.dev.: 0.0443)
  MultiSource/Applications/lemon/lemon: 10.83% (1.2200 => 1.3521, std.dev.: 0.0505)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.66% (0.1145 => 0.1267, std.dev.: 0.0035)
  MultiSource/Applications/kimwitu++/kc: 8.29% (18.6861 => 20.2352, std.dev.: 0.3634)
  MultiSource/Applications/siod/siod: 4.40% (2.5491 => 2.6613, std.dev.: 0.0227)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (15.4053 => 15.7980, std.dev.: 0.1381)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 43.13% (0.1535 => 0.2197, std.dev.: 0.0199)
  SingleSource/Benchmarks/Shootout/ary3: 24.51% (4.5977 => 5.7247, std.dev.: 0.1200)
  SingleSource/Benchmarks/Shootout/sieve: 20.68% (6.7454 => 8.1401, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 18.99% (5.9583 => 7.0895, std.dev.: 0.1134)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.17% (1.2278 => 1.4386, std.dev.: 0.0815)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.42% (82.2592 => 92.4749, std.dev.: 0.0149)
  MultiSource/Applications/obsequi/Obsequi: 9.40% (2.3061 => 2.5228, std.dev.: 0.0183)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.16% (3.3810 => 3.6907, std.dev.: 0.0739)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.23% (3.5027 => 3.7208, std.dev.: 0.0009)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 5.15% (1.1872 => 1.2484, std.dev.: 0.0123)
  MultiSource/Applications/siod/siod: 5.14% (3.4258 => 3.6020, std.dev.: 0.0286)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.11% (4.5883 => 4.7767, std.dev.: 0.0512)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.54% (5.7952 => 6.0003, std.dev.: 0.0043)
  MultiSource/Applications/lua/lua: 3.44% (29.1357 => 30.1371, std.dev.: 0.2519)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.97% (5.8933 => 6.0095, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.85% (5.9126 => 6.0218, std.dev.: 0.0415)
  SingleSource/Benchmarks/Shootout/fib2: 1.80% (3.5960 => 3.6609, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.79% (11.7894 => 12.0000, std.dev.: 0.0215)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.54% (2.3882 => 2.4250, std.dev.: 0.0117)
  SingleSource/Benchmarks/Misc/oourafft: 1.05% (3.6501 => 3.6884, std.dev.: 0.0127)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.45% (0.0688 => 0.0506, std.dev.: 0.0023)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.18% (0.3247 => 0.3014, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.64% (1.4277 => 1.3472, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.71% (1.3660 => 1.3017, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.52% (1.3819 => 1.3195, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.92% (1.3146 => 1.2631, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.56% (1.2824 => 1.2368, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.48% (1.5305 => 1.4772, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.46% (1.3127 => 1.2673, std.dev.: 0.0127)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.00% (1.1409 => 1.1067, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.77% (1.2544 => 1.2196, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.63% (1.2670 => 1.2337, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.47% (1.2952 => 1.2632, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.15% (1.2583 => 1.2313, std.dev.: 0.0081)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.03% (15.5356 => 13.3556, std.dev.: 0.1000)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.77% (50.9650 => 44.9684, std.dev.: 1.7885)
  MultiSource/Benchmarks/nbench/nbench: -11.59% (23.4696 => 20.7504, std.dev.: 0.6847)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.15% (6.0535 => 5.8630, std.dev.: 0.0253)
  MultiSource/Applications/JM/lencod/lencod: -2.39% (7.9450 => 7.7552, std.dev.: 0.0183)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.23% (2.5200 => 2.4889, std.dev.: 0.0083)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.17% (2.5025 => 2.4732, std.dev.: 0.0112)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140109/fcf3b3ae/attachment.html>


More information about the llvm-testresults mailing list