[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 3 15:47:03 PST 2014


http://llvm.org/perf/db_default/v4/nts/19651?compare_to=19643&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19651, Order: 198446, Start Time: 2014-01-03 22:03:08, End Time: 2014-01-03 23:51:45
      To: 19643, Order: 198435, Start Time: 2014-01-03 19:51:57, End Time: 2014-01-03 21:39:43
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 34 (43 on baseline)
Performance Improvements: 10 (17 on baseline)
Unchanged Tests: 1066 (1050 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 91.12% (0.0259 => 0.0495, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 66.82% (0.0214 => 0.0357, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 66.60% (0.2150 => 0.3582, std.dev.: 0.0181)
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: 64.74% (0.0743 => 0.1224, std.dev.: 0.0022)
  SingleSource/UnitTests/2003-05-31-CastToBool: 40.75% (0.0265 => 0.0373, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 20.97% (1.5043 => 1.8198, std.dev.: 0.0624)
  MultiSource/Benchmarks/Bullet/bullet: 14.97% (33.2204 => 38.1944, std.dev.: 0.6167)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.12% (27.4805 => 29.9865, std.dev.: 0.2850)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.40% (5.5126 => 5.9758, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.10% (1.2808 => 1.3717, std.dev.: 0.0315)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.64% (0.3207 => 0.3420, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.81% (1.9923 => 2.1080, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.92% (1.2680 => 1.3050, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.49% (0.6836 => 0.7006, std.dev.: 0.0017)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.51% (10.1486 => 10.3023, std.dev.: 0.0593)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except: 15.29% (0.4813 => 0.5549, std.dev.: 0.0169)
  SingleSource/Benchmarks/Shootout-C++/ary3: 15.19% (4.4462 => 5.1218, std.dev.: 0.1615)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.54% (5.3734 => 5.8861, std.dev.: 0.1677)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.55% (4.9930 => 5.4197, std.dev.: 0.0744)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.73% (3.5799 => 3.8566, std.dev.: 0.0983)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.61% (2.6417 => 2.8162, std.dev.: 0.0515)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.12% (1.2689 => 1.3466, std.dev.: 0.0105)
  MultiSource/Benchmarks/nbench/nbench: 5.65% (23.4557 => 24.7798, std.dev.: 0.4006)
  MultiSource/Benchmarks/Bullet/bullet: 5.31% (7.1047 => 7.4818, std.dev.: 0.0523)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.81% (4.5742 => 4.7941, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.69% (5.9002 => 6.1769, std.dev.: 0.0748)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.89% (2.3472 => 2.4386, std.dev.: 0.0240)
  SingleSource/Benchmarks/Misc/flops: 3.86% (9.2706 => 9.6281, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc/fp-convert: 2.82% (7.3290 => 7.5358, std.dev.: 0.0213)
  SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.9579 => 8.1531, std.dev.: 0.0687)
  SingleSource/Benchmarks/Shootout/random: 2.25% (2.4177 => 2.4722, std.dev.: 0.0072)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.13% (1.5645 => 1.5978, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.01% (5.0935 => 5.1960, std.dev.: 0.0156)
  MultiSource/Applications/viterbi/viterbi: 1.35% (2.6280 => 2.6635, std.dev.: 0.0085)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.55% (0.2279 => 0.1879, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -3.02% (0.7010 => 0.6798, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/bc/bc: -8.94% (1.2178 => 1.1089, std.dev.: 0.0415)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.68% (1.4299 => 1.3630, std.dev.: 0.0150)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.37% (31.4163 => 30.0436, std.dev.: 0.2368)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.39% (1.7976 => 1.7547, std.dev.: 0.0148)
  MultiSource/Applications/sqlite3/sqlite3: -2.10% (4.4640 => 4.3701, std.dev.: 0.0225)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.53% (2.5050 => 2.4667, std.dev.: 0.0102)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.23% (4.2721 => 4.2196, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.10% (3.5420 => 3.5030, std.dev.: 0.0042)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 90.38% (0.0260 => 0.0495, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: 67.67% (0.0730 => 0.1224, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 66.05% (0.0215 => 0.0357, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 64.54% (0.2177 => 0.3582, std.dev.: 0.0181)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: 63.79% (0.0174 => 0.0285, std.dev.: 0.0027)
  SingleSource/UnitTests/2003-05-31-CastToBool: 42.37% (0.0262 => 0.0373, std.dev.: 0.0035)
  MultiSource/Applications/sqlite3/sqlite3: 41.77% (15.7419 => 22.3178, std.dev.: 0.9105)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 21.37% (1.4994 => 1.8198, std.dev.: 0.0624)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.48% (25.9661 => 29.9865, std.dev.: 0.2850)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 10.01% (0.1109 => 0.1220, std.dev.: 0.0038)
  MultiSource/Applications/lemon/lemon: 9.88% (1.2200 => 1.3405, std.dev.: 0.0365)
  SingleSource/Benchmarks/Misc-C++/bigfib: 9.26% (0.6412 => 0.7006, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.28% (1.9834 => 2.1080, std.dev.: 0.0199)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.88% (0.3261 => 0.3420, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.20% (0.8880 => 0.9075, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.72% (5.8749 => 5.9758, std.dev.: 0.0243)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.60% (4.5769 => 5.8861, std.dev.: 0.1677)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.40% (5.9583 => 6.9356, std.dev.: 0.0834)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 14.98% (4.0567 => 4.6645, std.dev.: 0.1335)
  SingleSource/Benchmarks/Shootout/ary3: 13.38% (4.5977 => 5.2131, std.dev.: 0.0865)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.16% (82.2592 => 92.2640, std.dev.: 0.2983)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 11.27% (0.4987 => 0.5549, std.dev.: 0.0169)
  SingleSource/Benchmarks/Shootout-C++/ary3: 9.45% (4.6797 => 5.1218, std.dev.: 0.1615)
  SingleSource/Benchmarks/McGill/chomp: 8.48% (1.0099 => 1.0955, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.81% (3.5771 => 3.8566, std.dev.: 0.0983)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.70% (5.0320 => 5.4197, std.dev.: 0.0744)
  SingleSource/Benchmarks/Misc/salsa20: 7.35% (7.5947 => 8.1531, std.dev.: 0.0687)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2556 => 1.3466, std.dev.: 0.0105)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.19% (1.0232 => 1.0865, std.dev.: 0.0234)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.64% (2.6658 => 2.8162, std.dev.: 0.0515)
  MultiSource/Benchmarks/nbench/nbench: 5.58% (23.4696 => 24.7798, std.dev.: 0.4006)
  MultiSource/Applications/sgefa/sgefa: 4.87% (0.8745 => 0.9171, std.dev.: 0.0018)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.81% (28.6638 => 30.0436, std.dev.: 0.2368)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.49% (4.5883 => 4.7941, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.46% (5.9133 => 6.1769, std.dev.: 0.0748)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.41% (2.3355 => 2.4386, std.dev.: 0.0240)
  SingleSource/Benchmarks/Misc/flops: 3.89% (9.2673 => 9.6281, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.28% (1.2463 => 1.2872, std.dev.: 0.0073)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.79% (3.4043 => 3.4992, std.dev.: 0.0346)
  SingleSource/Benchmarks/Misc/fp-convert: 1.98% (7.3892 => 7.5358, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.82% (11.7894 => 12.0034, std.dev.: 0.0424)
  MultiSource/Applications/sqlite3/sqlite3: 1.68% (4.2978 => 4.3701, std.dev.: 0.0225)
  MultiSource/Applications/viterbi/viterbi: 1.02% (2.6366 => 2.6635, std.dev.: 0.0085)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -15.74% (0.1938 => 0.1633, std.dev.: 0.0035)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.05% (0.2540 => 0.2361, std.dev.: 0.0059)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.64% (0.3402 => 0.3176, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.15% (0.6882 => 0.6459, std.dev.: 0.0012)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.98% (0.2824 => 0.2655, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.73% (0.2810 => 0.2677, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.68% (2.0207 => 1.9262, std.dev.: 0.0248)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.15% (1.1409 => 1.0935, std.dev.: 0.0050)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.97% (1.4449 => 1.4020, std.dev.: 0.0121)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.55% (7.5124 => 7.3209, std.dev.: 0.0304)
  MultiSource/Benchmarks/nbench/nbench: -2.10% (1.2647 => 1.2381, std.dev.: 0.0080)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.79% (0.5879 => 0.5774, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.26% (15.5356 => 12.5429, std.dev.: 0.2646)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.42% (2.5559 => 2.3918, std.dev.: 0.0471)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.64% (6.0535 => 5.8937, std.dev.: 0.0152)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.13% (3.6605 => 3.5827, std.dev.: 0.0052)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.43% (2.5025 => 2.4667, std.dev.: 0.0102)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140103/4f4a2d24/attachment.html>


More information about the llvm-testresults mailing list