[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Sep 17 20:01:00 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15404?compare_to=15400&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15404, Order: 190909, Start Time: 2013-09-18 01:13:17, End Time: 2013-09-18 03:03:40
      To: 15400, Order: 190892, Start Time: 2013-09-17 22:55:45, End Time: 2013-09-18 00:48:49
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 11 (13 on baseline)
Performance Improvements: 70 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1026 (1080 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 30.27% (3.6189 => 4.7143, std.dev.: 0.1575)
  SingleSource/Benchmarks/Shootout/strcat: 8.45% (0.1468 => 0.1592, std.dev.: 0.0015)
  MultiSource/Applications/aha/aha: 5.85% (3.5668 => 3.7756, std.dev.: 0.0767)
  SingleSource/Benchmarks/Misc/fp-convert: 3.29% (7.4681 => 7.7139, std.dev.: 0.0830)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.92% (5.8269 => 5.9969, std.dev.: 0.0102)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.80% (1.6491 => 1.6953, std.dev.: 0.0029)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.03% (1.8576 => 1.8953, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.95% (3.9153 => 3.9915, std.dev.: 0.0053)
  MultiSource/Applications/viterbi/viterbi: 1.92% (2.6369 => 2.6876, std.dev.: 0.0095)
  SingleSource/Benchmarks/Shootout/fib2: 1.57% (3.5992 => 3.6556, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.24% (3.5422 => 3.5863, std.dev.: 0.0138)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: -44.76% (0.0534 => 0.0295, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/salsa20: -42.56% (0.0900 => 0.0517, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -41.40% (0.0471 => 0.0276, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -39.63% (0.1393 => 0.0841, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/lowercase: -37.76% (0.0392 => 0.0244, std.dev.: 0.0024)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -32.65% (0.0487 => 0.0328, std.dev.: 0.0060)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -31.29% (1.0738 => 0.7378, std.dev.: 0.0935)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.50% (0.1044 => 0.0736, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/whetstone: -29.27% (0.1281 => 0.0906, std.dev.: 0.0132)
  SingleSource/Benchmarks/Misc/flops-4: -26.59% (0.0410 => 0.0301, std.dev.: 0.0008)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -25.79% (0.1105 => 0.0820, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/power/power: -23.64% (0.1853 => 0.1415, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/perlin: -22.69% (0.0780 => 0.0603, std.dev.: 0.0039)
  MultiSource/Applications/lua/lua: -22.47% (5.5810 => 4.3271, std.dev.: 0.2122)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.60% (1.4662 => 1.1642, std.dev.: 0.0772)
  MultiSource/Benchmarks/McCat/18-imp/imp: -20.55% (0.4992 => 0.3966, std.dev.: 0.0255)
  MultiSource/Benchmarks/McCat/05-eks/eks: -20.00% (0.6699 => 0.5359, std.dev.: 0.0150)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -19.40% (1.8387 => 1.4820, std.dev.: 0.1164)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -19.17% (1.4410 => 1.1647, std.dev.: 0.0526)
  MultiSource/Benchmarks/Olden/tsp/tsp: -18.88% (0.1658 => 0.1345, std.dev.: 0.0066)
  MultiSource/Benchmarks/Olden/bh/bh: -17.19% (0.3961 => 0.3280, std.dev.: 0.0073)
  MultiSource/Applications/obsequi/Obsequi: -14.15% (1.3697 => 1.1759, std.dev.: 0.0715)
  MultiSource/Applications/lambda-0_1_3/lambda: -12.32% (0.9491 => 0.8322, std.dev.: 0.0345)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -11.49% (4.6938 => 4.1547, std.dev.: 0.1138)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -11.21% (1.5064 => 1.3376, std.dev.: 0.0477)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -11.07% (1.3832 => 1.2301, std.dev.: 0.0138)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -11.05% (0.3709 => 0.3299, std.dev.: 0.0146)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: -10.37% (0.1119 => 0.1003, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.31% (1.3566 => 1.2167, std.dev.: 0.0071)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -10.21% (3.0339 => 2.7240, std.dev.: 0.0792)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -9.98% (0.1162 => 0.1046, std.dev.: 0.0025)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -9.97% (0.1935 => 0.1742, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -8.78% (0.3589 => 0.3274, std.dev.: 0.0117)
  MultiSource/Benchmarks/McCat/09-vor/vor: -8.75% (0.3909 => 0.3567, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -8.58% (1.3951 => 1.2754, std.dev.: 0.0107)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -8.46% (0.2128 => 0.1948, std.dev.: 0.0040)
  MultiSource/Applications/minisat/minisat: -7.77% (0.8160 => 0.7526, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -7.55% (1.4706 => 1.3595, std.dev.: 0.0157)
  SingleSource/Benchmarks/Misc/ReedSolomon: -7.40% (0.2365 => 0.2190, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc/oourafft: -7.15% (0.2489 => 0.2311, std.dev.: 0.0021)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -7.10% (0.8962 => 0.8326, std.dev.: 0.0145)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.02% (0.3193 => 0.2969, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.99% (1.3885 => 1.2915, std.dev.: 0.0202)
  SingleSource/Benchmarks/Shootout-C++/methcall: -6.96% (0.2199 => 0.2046, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/moments: -4.74% (0.3986 => 0.3797, std.dev.: 0.0047)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.46% (1.5923 => 1.5531, std.dev.: 0.0102)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -53.40% (0.2914 => 0.1358, std.dev.: 0.0592)
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.61% (0.9979 => 0.6625, std.dev.: 0.1015)
  MultiSource/Applications/minisat/minisat: -26.64% (8.6098 => 6.3160, std.dev.: 0.7501)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -24.65% (0.0645 => 0.0486, std.dev.: 0.0013)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -23.64% (0.1125 => 0.0859, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -14.59% (0.1604 => 0.1370, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/09-vor/vor: -13.97% (0.1303 => 0.1121, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/18-imp/imp: -13.50% (0.1170 => 0.1012, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/tsp/tsp: -9.96% (1.7394 => 1.5661, std.dev.: 0.0530)
  MultiSource/Applications/obsequi/Obsequi: -9.95% (2.6272 => 2.3658, std.dev.: 0.0900)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -7.76% (2.8831 => 2.6594, std.dev.: 0.0373)
  SingleSource/Benchmarks/McGill/misr: -7.40% (0.4282 => 0.3965, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout-C++/methcall: -6.05% (8.1673 => 7.6731, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/hash: -5.76% (0.7859 => 0.7406, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/bh/bh: -4.89% (2.5305 => 2.4068, std.dev.: 0.0181)
  MultiSource/Applications/lua/lua: -4.59% (30.8297 => 29.4148, std.dev.: 0.5351)
  MultiSource/Benchmarks/FreeBench/mason/mason: -4.52% (0.3117 => 0.2976, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/em3d/em3d: -3.28% (5.2019 => 5.0313, std.dev.: 0.0567)
  SingleSource/Benchmarks/Misc/ffbench: -3.00% (1.4498 => 1.4063, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.89% (4.2351 => 4.1125, std.dev.: 0.0278)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.42% (1.3093 => 1.2776, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc/flops-4: -1.66% (1.7597 => 1.7305, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.44% (4.9984 => 4.9266, std.dev.: 0.0275)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.40% (3.2432 => 3.1977, std.dev.: 0.0078)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.28% (0.1286 => 0.1341, std.dev.: 0.0058)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 31.32% (3.5900 => 4.7143, std.dev.: 0.1575)
  SingleSource/UnitTests/Vector/multiplies: 6.65% (0.5561 => 0.5931, std.dev.: 0.0048)
  MultiSource/Applications/aha/aha: 5.67% (3.5731 => 3.7756, std.dev.: 0.0767)
  SingleSource/Benchmarks/McGill/misr: 5.14% (0.3771 => 0.3965, std.dev.: 0.0065)
  MultiSource/Applications/spiff/spiff: 4.20% (2.8194 => 2.9377, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.83% (5.7757 => 5.9969, std.dev.: 0.0102)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.42% (1.7652 => 1.8079, std.dev.: 0.0031)
  MultiSource/Benchmarks/Olden/power/power: 2.40% (1.2170 => 1.2462, std.dev.: 0.0012)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.34% (1.8519 => 1.8953, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout/fib2: 1.64% (3.5966 => 3.6556, std.dev.: 0.0203)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.47% (1.6707 => 1.6953, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.41% (1.0477 => 1.0625, std.dev.: 0.0014)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.35% (16.7972 => 17.0240, std.dev.: 0.0671)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.42% (0.1483 => 0.1195, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.29% (0.5226 => 0.2389, std.dev.: 0.0132)
  MultiSource/Applications/sgefa/sgefa: -46.78% (1.5790 => 0.8404, std.dev.: 0.0287)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.93% (15.9508 => 13.0914, std.dev.: 0.5157)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.45% (57.2347 => 47.2465, std.dev.: 1.8918)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -12.03% (20.8247 => 18.3198, std.dev.: 0.2143)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.72% (50.0284 => 44.6635, std.dev.: 0.0359)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.45% (3.4956 => 3.1303, std.dev.: 0.0419)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0014)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.83% (4.3592 => 4.1921, std.dev.: 0.0589)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.75% (2.4471 => 2.3798, std.dev.: 0.0161)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.49% (0.7474 => 0.7288, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.45% (4.9991 => 4.9266, std.dev.: 0.0275)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.36% (89.7126 => 88.4901, std.dev.: 0.3751)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.52% (0.1348 => 0.1341, std.dev.: 0.0058)

Report Time: 0.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130917/7dca3b7f/attachment.html>


More information about the llvm-testresults mailing list