[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 10 02:37:03 PST 2013


http://llvm.org/perf/db_default/v4/nts/18243?compare_to=18237&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18243, Order: 196892, Start Time: 2013-12-10 09:00:17, End Time: 2013-12-10 10:41:14
      To: 18237, Order: 196882, Start Time: 2013-12-10 06:50:40, End Time: 2013-12-10 08:34:31
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 28 (30 on baseline)
Performance Improvements: 4 (64 on baseline)
Unchanged Tests: 1078 (1016 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.72% (1.2178 => 1.2387, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.58% (1.3576 => 1.3790, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.51% (1.3059 => 1.3256, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.50% (1.2612 => 1.2801, std.dev.: 0.0012)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: 19.41% (20.0929 => 23.9923, std.dev.: 0.8796)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.51% (6.4982 => 7.4414, std.dev.: 0.1099)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.61% (3.1631 => 3.5303, std.dev.: 0.0051)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.25% (0.4304 => 0.4659, std.dev.: 0.0002)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.12% (2.8154 => 3.0439, std.dev.: 0.0048)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.53% (1.2575 => 1.3522, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.94% (3.6038 => 3.8540, std.dev.: 0.0049)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.23% (1.9731 => 2.0960, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/hash: 5.32% (0.7071 => 0.7447, std.dev.: 0.0057)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 4.95% (1.2478 => 1.3096, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.24% (5.0355 => 5.2490, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.77% (3.5055 => 3.6376, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.21% (5.2347 => 5.4027, std.dev.: 0.0107)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.09% (1.8357 => 1.8925, std.dev.: 0.0049)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.06% (4.2108 => 4.3396, std.dev.: 0.0265)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.67% (11.7629 => 12.0773, std.dev.: 0.0168)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (2.4782 => 2.5361, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.00% (3.1575 => 3.2208, std.dev.: 0.0003)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.96% (2.3776 => 2.4242, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.92% (5.3331 => 5.4357, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.46% (3.1453 => 3.1911, std.dev.: 0.0037)
  MultiSource/Benchmarks/llubenchmark/llu: 1.32% (1.9841 => 2.0103, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/fp-convert: 1.29% (7.6990 => 7.7987, std.dev.: 0.0363)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.19% (5.8067 => 5.8760, std.dev.: 0.0186)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.51% (0.2963 => 0.2859, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.05% (1.3671 => 1.3527, std.dev.: 0.0023)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.96% (3.8430 => 3.7294, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.36% (1.6193 => 1.5972, std.dev.: 0.0085)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 15.89% (6.4210 => 7.4414, std.dev.: 0.1099)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.77% (3.1585 => 3.5303, std.dev.: 0.0051)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.87% (1.1019 => 1.1886, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.74% (3.5771 => 3.8540, std.dev.: 0.0049)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.69% (1.2556 => 1.3522, std.dev.: 0.0184)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.16% (1.0232 => 1.0965, std.dev.: 0.0187)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.55% (2.8568 => 3.0439, std.dev.: 0.0048)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.24% (1.9729 => 2.0960, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/fp-convert: 5.54% (7.3892 => 7.7987, std.dev.: 0.0363)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.85% (3.5027 => 3.6376, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.73% (5.0601 => 5.2490, std.dev.: 0.0218)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.72% (4.1840 => 4.3396, std.dev.: 0.0265)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.71% (0.6261 => 0.6493, std.dev.: 0.0000)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.58% (1.2278 => 1.2718, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.56% (5.2486 => 5.4357, std.dev.: 0.0006)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.21% (0.5112 => 0.5276, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.08% (5.9126 => 6.0947, std.dev.: 0.0114)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.94% (0.4526 => 0.4659, std.dev.: 0.0002)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.80% (1.8409 => 1.8925, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.44% (11.7894 => 12.0773, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.20% (5.5032 => 5.6242, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (3.1547 => 3.2208, std.dev.: 0.0003)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.88% (2.4894 => 2.5361, std.dev.: 0.0005)
  MultiSource/Benchmarks/llubenchmark/llu: 1.72% (1.9763 => 2.0103, std.dev.: 0.0052)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.51% (2.3882 => 2.4242, std.dev.: 0.0003)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.45% (3.1455 => 3.1911, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.39% (5.9583 => 6.0413, std.dev.: 0.0315)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.16% (3.5451 => 3.5862, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.12% (4.9365 => 4.9916, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.05% (5.3463 => 5.4027, std.dev.: 0.0107)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -27.03% (0.0688 => 0.0502, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -15.33% (0.1938 => 0.1641, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -11.95% (0.3247 => 0.2859, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.58% (0.1088 => 0.0962, std.dev.: 0.0016)
  MultiSource/Benchmarks/Bullet/bullet: -9.89% (36.6274 => 33.0065, std.dev.: 0.2741)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.17% (0.3402 => 0.3124, std.dev.: 0.0023)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -7.97% (0.1280 => 0.1178, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.16% (0.1523 => 0.1414, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.09% (0.6882 => 0.6394, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.05% (5.8749 => 5.4606, std.dev.: 0.0359)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.92% (1.5034 => 1.3993, std.dev.: 0.0174)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -6.57% (1.0197 => 0.9527, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.40% (1.3676 => 1.2801, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.19% (0.2810 => 0.2636, std.dev.: 0.0042)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2758 => 0.2588, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.09% (2.0207 => 1.8976, std.dev.: 0.0105)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.64% (0.1774 => 0.1674, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.36% (1.3819 => 1.3078, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.23% (1.4277 => 1.3530, std.dev.: 0.0020)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.11% (0.2252 => 0.2137, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.96% (1.4113 => 1.3413, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.89% (1.3505 => 1.2845, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.71% (1.3918 => 1.3263, std.dev.: 0.0084)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.68% (5.0823 => 4.8447, std.dev.: 0.0440)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.66% (1.3146 => 1.2533, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.62% (15.4053 => 14.6941, std.dev.: 0.0739)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.26% (1.2824 => 1.2278, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.23% (1.4125 => 1.3527, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.16% (1.3127 => 1.2581, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.15% (1.5305 => 1.4670, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.11% (1.3660 => 1.3098, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.11% (1.1409 => 1.0940, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.08% (1.2914 => 1.2387, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.04% (1.3157 => 1.2626, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.03% (1.3182 => 1.2651, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.91% (1.2724 => 1.2227, std.dev.: 0.0086)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.82% (0.3714 => 0.3572, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.50% (1.3264 => 1.2800, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.48% (1.3460 => 1.2992, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.31% (1.2544 => 1.2129, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.17% (1.3702 => 1.3268, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.11% (1.2583 => 1.2192, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.09% (1.3024 => 1.2621, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.96% (1.2785 => 1.2407, std.dev.: 0.0017)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.82% (0.5322 => 0.5172, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.59% (1.3608 => 1.3256, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.53% (1.4790 => 1.4416, std.dev.: 0.0066)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.51% (4.7807 => 4.6606, std.dev.: 0.0402)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.50% (0.5879 => 0.5732, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.28% (7.5124 => 7.3409, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.16% (1.3457 => 1.3167, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.02% (1.4074 => 1.3790, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.01% (1.2670 => 1.2415, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.96% (1.3510 => 1.3245, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.95% (1.2952 => 1.2700, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.76% (1.3551 => 1.3312, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.72% (1.3068 => 1.2843, std.dev.: 0.0008)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.64% (2.8850 => 2.3762, std.dev.: 0.0422)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.64% (1.4335 => 1.3096, std.dev.: 0.0163)
  MultiSource/Benchmarks/Bullet/bullet: -5.39% (7.4226 => 7.0224, std.dev.: 0.0521)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.00% (3.4043 => 3.3022, std.dev.: 0.0381)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.93% (6.0535 => 5.8760, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.01% (5.1947 => 5.0903, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.10% (4.1462 => 4.1007, std.dev.: 0.0007)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131210/6aed87c0/attachment.html>


More information about the llvm-testresults mailing list