[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 4 18:31:29 PST 2013


http://llvm.org/perf/db_default/v4/nts/17982?compare_to=17976&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17982, Order: 196434, Start Time: 2013-12-05 00:45:31, End Time: 2013-12-05 02:35:34
      To: 17976, Order: 196414, Start Time: 2013-12-04 22:19:04, End Time: 2013-12-05 00:18:15
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 27 (46 on baseline)
Performance Improvements: 27 (5 on baseline)
Unchanged Tests: 1056 (1059 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/llubenchmark/llu: 67.11% (0.0526 => 0.0879, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 64.48% (0.0487 => 0.0801, std.dev.: 0.0106)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 60.76% (0.0288 => 0.0463, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/nestedloop: 57.93% (0.0328 => 0.0518, std.dev.: 0.0027)
  SingleSource/UnitTests/2002-05-03-NotTest: 56.35% (0.0197 => 0.0308, std.dev.: 0.0017)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 56.08% (0.0633 => 0.0988, std.dev.: 0.0046)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 41.80% (0.0256 => 0.0363, std.dev.: 0.0016)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.02% (0.2847 => 0.3474, std.dev.: 0.0175)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 20.54% (0.7850 => 0.9462, std.dev.: 0.0485)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 12.32% (0.2395 => 0.2690, std.dev.: 0.0045)
  MultiSource/Applications/JM/ldecod/ldecod: 7.12% (7.7890 => 8.3436, std.dev.: 0.2053)
  MultiSource/Applications/JM/lencod/lencod: 6.25% (17.9790 => 19.1030, std.dev.: 0.2996)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.96% (1.3842 => 1.4667, std.dev.: 0.0317)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.40% (1.2753 => 1.3186, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.09% (1.2934 => 1.3334, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.15% (1.4846 => 1.8728, std.dev.: 0.0526)
  MultiSource/Applications/obsequi/Obsequi: 13.83% (2.1473 => 2.4442, std.dev.: 0.0399)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.21% (29.6394 => 33.2573, std.dev.: 0.3409)
  SingleSource/Benchmarks/Shootout-C++/moments: 11.91% (0.1108 => 0.1240, std.dev.: 0.0021)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 9.29% (1.1411 => 1.2471, std.dev.: 0.0365)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.24% (4.9863 => 5.3970, std.dev.: 0.0136)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.56% (0.3659 => 0.3899, std.dev.: 0.0031)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.84% (1.7192 => 1.8024, std.dev.: 0.0241)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.45% (1.5014 => 1.5682, std.dev.: 0.0245)
  SingleSource/Benchmarks/Shootout/hash: 3.48% (5.2373 => 5.4193, std.dev.: 0.0281)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.31% (5.4952 => 5.6770, std.dev.: 0.0170)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.89% (1.5783 => 1.6082, std.dev.: 0.0027)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/richards_benchmark: -34.42% (0.1293 => 0.0848, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/flops-8: -27.80% (0.0464 => 0.0335, std.dev.: 0.0030)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -25.49% (0.2193 => 0.1634, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.56% (0.1157 => 0.0896, std.dev.: 0.0044)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.52% (0.0702 => 0.0572, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/mandel: -18.43% (0.0624 => 0.0509, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.00% (5.9348 => 5.0444, std.dev.: 0.1584)
  MultiSource/Applications/sgefa/sgefa: -12.50% (0.4623 => 0.4045, std.dev.: 0.0091)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -11.93% (5.5563 => 4.8936, std.dev.: 0.2246)
  SingleSource/Benchmarks/Shootout-C++/sieve: -9.81% (0.3282 => 0.2960, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.08% (1.5333 => 1.4401, std.dev.: 0.0287)
  SingleSource/Benchmarks/Shootout-C++/ary2: -5.78% (0.2838 => 0.2674, std.dev.: 0.0017)
  MultiSource/Applications/SPASS/SPASS: -4.70% (18.6061 => 17.7323, std.dev.: 0.2940)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.23% (1.3318 => 1.2888, std.dev.: 0.0138)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -38.67% (0.2149 => 0.1318, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/bisort/bisort: -20.00% (1.0001 => 0.8001, std.dev.: 0.0682)
  MultiSource/Applications/kimwitu++/kc: -16.72% (0.0604 => 0.0503, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.61% (0.0692 => 0.0584, std.dev.: 0.0040)
  MultiSource/Benchmarks/FreeBench/neural/neural: -8.79% (0.4631 => 0.4224, std.dev.: 0.0122)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.41% (0.3442 => 0.3187, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -3.34% (4.2417 => 4.1001, std.dev.: 0.0522)
  SingleSource/Benchmarks/Misc/richards_benchmark: -2.56% (1.3935 => 1.3578, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/perlin: -2.44% (3.7161 => 3.6253, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout/sieve: -2.37% (6.8978 => 6.7342, std.dev.: 0.0235)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.35% (8.7464 => 8.5411, std.dev.: 0.0645)
  SingleSource/Benchmarks/Misc/flops-3: -2.22% (2.0845 => 2.0383, std.dev.: 0.0101)
  SingleSource/Benchmarks/Misc/whetstone: -1.91% (3.6466 => 3.5769, std.dev.: 0.0120)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: 68.73% (0.0307 => 0.0518, std.dev.: 0.0027)
  MultiSource/Benchmarks/llubenchmark/llu: 66.48% (0.0528 => 0.0879, std.dev.: 0.0028)
  SingleSource/Regression/C++/EH/inlined_cleanup: 64.18% (0.0201 => 0.0330, std.dev.: 0.0023)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 63.03% (0.0284 => 0.0463, std.dev.: 0.0045)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 62.23% (0.0609 => 0.0988, std.dev.: 0.0046)
  SingleSource/UnitTests/2003-04-22-Switch: 59.89% (0.0177 => 0.0283, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 58.93% (0.0504 => 0.0801, std.dev.: 0.0106)
  SingleSource/UnitTests/2002-05-03-NotTest: 55.56% (0.0198 => 0.0308, std.dev.: 0.0017)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 55.13% (0.0234 => 0.0363, std.dev.: 0.0016)
  SingleSource/Regression/C++/EH/function_try_block: 45.11% (0.0317 => 0.0460, std.dev.: 0.0049)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 29.10% (0.2691 => 0.3474, std.dev.: 0.0175)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 28.30% (0.7375 => 0.9462, std.dev.: 0.0485)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 17.93% (0.2281 => 0.2690, std.dev.: 0.0045)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.30% (0.1393 => 0.1634, std.dev.: 0.0016)
  MultiSource/Applications/JM/lencod/lencod: 10.44% (17.2968 => 19.1030, std.dev.: 0.2996)
  MultiSource/Applications/JM/ldecod/ldecod: 8.98% (7.6560 => 8.3436, std.dev.: 0.2053)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.21% (1.9834 => 2.1264, std.dev.: 0.0411)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (15.4053 => 16.4333, std.dev.: 0.2255)
  MultiSource/Applications/SPASS/SPASS: 6.07% (16.7177 => 17.7323, std.dev.: 0.2940)
  MultiSource/Applications/oggenc/oggenc: 5.32% (5.4968 => 5.7890, std.dev.: 0.0849)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.31% (0.2033 => 0.2141, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.63% (0.6412 => 0.6709, std.dev.: 0.0066)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.10% (0.3758 => 0.3912, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/sieve: 3.64% (0.2856 => 0.2960, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.04% (1.3068 => 1.3334, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 62.59% (0.7670 => 1.2471, std.dev.: 0.0365)
  SingleSource/Benchmarks/Shootout/heapsort: 33.11% (2.9492 => 3.9256, std.dev.: 0.3017)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.58% (1.4795 => 1.8728, std.dev.: 0.0526)
  MultiSource/Applications/lemon/lemon: 25.50% (0.8632 => 1.0833, std.dev.: 0.0837)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.21% (0.3358 => 0.3936, std.dev.: 0.0197)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.03% (28.6638 => 33.2573, std.dev.: 0.3409)
  SingleSource/Benchmarks/Shootout-C++/moments: 11.11% (0.1116 => 0.1240, std.dev.: 0.0021)
  MultiSource/Benchmarks/llubenchmark/llu: 7.43% (1.9763 => 2.1231, std.dev.: 0.0493)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.25% (5.0320 => 5.3970, std.dev.: 0.0136)
  MultiSource/Applications/obsequi/Obsequi: 5.99% (2.3061 => 2.4442, std.dev.: 0.0399)
  SingleSource/Benchmarks/Shootout/hash: 4.43% (5.1896 => 5.4193, std.dev.: 0.0281)
  MultiSource/Applications/sgefa/sgefa: 3.92% (0.8745 => 0.9088, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/flops: 3.84% (9.2673 => 9.6231, std.dev.: 0.0148)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (40.5530 => 42.0801, std.dev.: 0.0935)
  SingleSource/Benchmarks/Shootout/lists: 3.27% (6.9930 => 7.2220, std.dev.: 0.0752)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.24% (5.9133 => 6.1051, std.dev.: 0.0610)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.16% (5.5032 => 5.6770, std.dev.: 0.0170)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.22% (3.8062 => 3.8906, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.06% (5.7060 => 5.8234, std.dev.: 0.0281)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.80% (1.5797 => 1.6082, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/flops-7: 1.29% (1.7183 => 1.7405, std.dev.: 0.0080)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -9.64% (0.3247 => 0.2934, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.76% (1.3676 => 1.2888, std.dev.: 0.0138)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.15% (0.1973 => 0.1674, std.dev.: 0.0099)
  MultiSource/Benchmarks/nbench/nbench: -13.59% (23.4696 => 20.2809, std.dev.: 1.1810)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.32% (6.0535 => 5.8523, std.dev.: 0.0597)

Report Time: 1.96s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131204/29c5e2d3/attachment.html>


More information about the llvm-testresults mailing list