[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 10 13:06:01 PST 2014


http://llvm.org/perf/db_default/v4/nts/20228?compare_to=20207&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 20228, Order: 198950, Start Time: 2014-01-10 19:17:56, End Time: 2014-01-10 21:10:50
      To: 20207, Order: 198940, Start Time: 2014-01-10 14:35:53, End Time: 2014-01-10 16:26:01
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 17 (16 on baseline)
Performance Improvements: 35 (7 on baseline)
Unchanged Tests: 1058 (1087 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.82% (27.6447 => 29.2533, std.dev.: 0.2140)
  MultiSource/Benchmarks/Olden/bh/bh: 4.44% (0.3223 => 0.3366, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.90% (1.3369 => 1.3891, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.25% (1.3338 => 1.3771, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.79% (1.2557 => 1.2907, std.dev.: 0.0067)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.20% (1.5542 => 1.5884, std.dev.: 0.0022)
  MultiSource/Applications/obsequi/Obsequi: 1.98% (1.1649 => 1.1880, std.dev.: 0.0054)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops: 19.31% (7.7671 => 9.2672, std.dev.: 0.1677)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.97% (0.4256 => 0.4510, std.dev.: 0.0060)
  MultiSource/Applications/obsequi/Obsequi: 4.26% (2.1819 => 2.2748, std.dev.: 0.0299)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 4.12% (0.4880 => 0.5081, std.dev.: 0.0066)
  SingleSource/Benchmarks/Shootout-C++/random: 4.08% (2.3748 => 2.4716, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/methcall: 1.95% (8.4686 => 8.6336, std.dev.: 0.0619)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.65% (2.4988 => 2.5401, std.dev.: 0.0121)
  MultiSource/Applications/viterbi/viterbi: 1.63% (2.6338 => 2.6766, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.10% (3.8193 => 3.8613, std.dev.: 0.0128)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.03% (8.7971 => 8.8875, std.dev.: 0.0205)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -39.51% (0.0529 => 0.0320, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -39.45% (0.5932 => 0.3592, std.dev.: 0.0103)
  SingleSource/Benchmarks/Shootout-C++/ary2: -37.52% (0.4115 => 0.2571, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/fibo: -36.31% (0.2972 => 0.1893, std.dev.: 0.0081)
  SingleSource/Regression/C++/2011-03-28-Bitfield: -35.71% (0.0294 => 0.0189, std.dev.: 0.0011)
  SingleSource/Benchmarks/Dhrystone/dry: -35.49% (0.0882 => 0.0569, std.dev.: 0.0114)
  SingleSource/UnitTests/2002-05-02-CastTest: -31.84% (0.0380 => 0.0259, std.dev.: 0.0005)
  SingleSource/UnitTests/2006-01-23-UnionInit: -30.39% (0.0385 => 0.0268, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/objinst: -30.10% (0.3033 => 0.2120, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc/flops-6: -30.04% (0.0456 => 0.0319, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/flops-5: -29.83% (0.0476 => 0.0334, std.dev.: 0.0008)
  SingleSource/Regression/C/PR10189: -28.46% (0.0376 => 0.0269, std.dev.: 0.0034)
  SingleSource/Benchmarks/CoyoteBench/almabench: -27.77% (0.1084 => 0.0783, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/flops-4: -27.53% (0.0454 => 0.0329, std.dev.: 0.0004)
  SingleSource/Regression/C/bigstack: -26.41% (0.0871 => 0.0641, std.dev.: 0.0053)
  SingleSource/Regression/C++/ofstream_ctor: -21.17% (0.2607 => 0.2055, std.dev.: 0.0044)
  SingleSource/Benchmarks/McGill/exptree: -12.17% (0.1068 => 0.0938, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/wc: -11.50% (0.2512 => 0.2223, std.dev.: 0.0108)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.63% (0.5900 => 0.5332, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout-C++/methcall: -8.69% (0.2233 => 0.2039, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -8.45% (0.2129 => 0.1949, std.dev.: 0.0069)
  SingleSource/Benchmarks/McGill/chomp: -8.09% (0.2434 => 0.2237, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.10% (0.3610 => 0.3462, std.dev.: 0.0057)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -41.78% (2.5198 => 1.4671, std.dev.: 0.2750)
  SingleSource/Benchmarks/Shootout/heapsort: -39.69% (4.9064 => 2.9591, std.dev.: 0.6351)
  SingleSource/Benchmarks/Stanford/Perm: -24.65% (0.0430 => 0.0324, std.dev.: 0.0018)
  SingleSource/Benchmarks/McGill/chomp: -9.77% (1.1950 => 1.0783, std.dev.: 0.0196)
  MultiSource/Applications/ClamAV/clamscan: -8.33% (0.1380 => 0.1265, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/hash: -8.31% (5.6148 => 5.1481, std.dev.: 0.1267)
  SingleSource/Benchmarks/Dhrystone/dry: -5.40% (0.5112 => 0.4836, std.dev.: 0.0086)
  SingleSource/Benchmarks/Shootout-C++/sieve: -3.69% (3.6028 => 3.4700, std.dev.: 0.0365)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -3.24% (4.1939 => 4.0582, std.dev.: 0.0518)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.81% (1.5408 => 1.4975, std.dev.: 0.0168)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.80% (0.7655 => 0.7441, std.dev.: 0.0037)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.07% (35.4799 => 35.0985, std.dev.: 0.1256)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 28.14% (0.3859 => 0.4945, std.dev.: 0.0262)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.66% (25.9661 => 29.2533, std.dev.: 0.2140)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.51% (1.5198 => 1.5884, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.38% (1.3702 => 1.3891, std.dev.: 0.0066)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 22.05% (5.9583 => 7.2720, std.dev.: 0.3874)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 13.13% (82.2592 => 93.0614, std.dev.: 0.0306)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (3.3810 => 3.6680, std.dev.: 0.0468)
  SingleSource/Benchmarks/McGill/chomp: 6.77% (1.0099 => 1.0783, std.dev.: 0.0196)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.80% (1.2278 => 1.2990, std.dev.: 0.0043)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.84% (2.8568 => 2.9950, std.dev.: 0.0283)
  MultiSource/Applications/siod/siod: 4.80% (3.4258 => 3.5904, std.dev.: 0.0061)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.17% (0.5112 => 0.5325, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.88% (11.7894 => 12.0111, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.79% (5.9126 => 6.0184, std.dev.: 0.0410)
  MultiSource/Applications/viterbi/viterbi: 1.52% (2.6366 => 2.6766, std.dev.: 0.0020)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.50% (2.5025 => 2.5401, std.dev.: 0.0121)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.78% (0.3247 => 0.3027, std.dev.: 0.0050)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.96% (0.2824 => 0.2684, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.82% (1.3146 => 1.2907, std.dev.: 0.0067)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.11% (15.5356 => 12.8782, std.dev.: 1.0042)
  SingleSource/Benchmarks/McGill/misr: -5.63% (0.4029 => 0.3802, std.dev.: 0.0036)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.00% (50.9650 => 48.4179, std.dev.: 0.3222)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.73% (0.4400 => 0.4280, std.dev.: 0.0034)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140110/90c9517e/attachment.html>


More information about the llvm-testresults mailing list