[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 10 13:45:43 PST 2013


http://llvm.org/perf/db_default/v4/nts/18259?compare_to=18256&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18259, Order: 196950, Start Time: 2013-12-10 20:02:03, End Time: 2013-12-10 21:49:55
      To: 18256, Order: 196935, Start Time: 2013-12-10 17:49:51, End Time: 2013-12-10 19:36:14
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 23 (32 on baseline)
Performance Improvements: 20 (7 on baseline)
Unchanged Tests: 1067 (1071 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/ConditionalExpr: 87.17% (0.0226 => 0.0423, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-05-31-LongShifts: 76.19% (0.0147 => 0.0259, std.dev.: 0.0011)
  SingleSource/UnitTests/2002-05-02-CastTest: 75.20% (0.0250 => 0.0438, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 58.06% (0.0887 => 0.1402, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 52.38% (0.0693 => 0.1056, std.dev.: 0.0035)
  SingleSource/UnitTests/Vector/simple: 51.79% (0.0224 => 0.0340, std.dev.: 0.0039)
  SingleSource/Regression/C++/EH/exception_spec_test: 42.49% (0.0346 => 0.0493, std.dev.: 0.0056)
  SingleSource/UnitTests/Vector/constpool: 23.56% (8.9662 => 11.0784, std.dev.: 0.6093)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.68% (0.1154 => 0.1358, std.dev.: 0.0059)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.11% (43.9455 => 50.5842, std.dev.: 0.5887)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 11.25% (0.0969 => 0.1078, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.2238 => 0.2354, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 4.14% (1.5152 => 1.5780, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: 21.91% (3.9232 => 4.7829, std.dev.: 0.0749)
  SingleSource/Benchmarks/Shootout/ary3: 21.32% (4.6925 => 5.6930, std.dev.: 0.1991)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.72% (28.5658 => 31.9132, std.dev.: 0.9028)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.36% (2.8209 => 2.9721, std.dev.: 0.0569)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.33% (5.9014 => 6.2158, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.47% (5.0930 => 5.2695, std.dev.: 0.0255)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.14% (3.6372 => 3.7513, std.dev.: 0.0339)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.69% (95.1056 => 97.6610, std.dev.: 0.9018)
  SingleSource/Regression/C/uint64_to_float: 2.63% (1.4719 => 1.5106, std.dev.: 0.0127)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.69% (2.3765 => 2.4166, std.dev.: 0.0126)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -36.75% (0.1230 => 0.0778, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -31.13% (0.1224 => 0.0843, std.dev.: 0.0138)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -23.36% (0.0672 => 0.0515, std.dev.: 0.0034)
  MultiSource/Benchmarks/McCat/18-imp/imp: -18.23% (0.4790 => 0.3917, std.dev.: 0.0090)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -16.00% (2.2698 => 1.9066, std.dev.: 0.0905)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -14.40% (1.9282 => 1.6505, std.dev.: 0.0200)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.95% (0.7536 => 0.6485, std.dev.: 0.0316)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -13.42% (1.5405 => 1.3338, std.dev.: 0.0734)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -13.41% (5.8198 => 5.0395, std.dev.: 0.2876)
  MultiSource/Benchmarks/McCat/09-vor/vor: -13.25% (0.4160 => 0.3609, std.dev.: 0.0047)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -8.76% (0.1495 => 0.1364, std.dev.: 0.0037)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.54% (0.1921 => 0.1757, std.dev.: 0.0052)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.71% (0.7469 => 0.6893, std.dev.: 0.0124)
  MultiSource/Benchmarks/nbench/nbench: -4.59% (1.2947 => 1.2353, std.dev.: 0.0194)
  MultiSource/Benchmarks/McCat/08-main/main: -3.94% (0.3095 => 0.2973, std.dev.: 0.0023)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: -29.18% (0.1669 => 0.1182, std.dev.: 0.0010)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.87% (3.4930 => 3.3229, std.dev.: 0.0301)
  MultiSource/Benchmarks/llubenchmark/llu: -2.75% (2.0635 => 2.0067, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.08% (6.0399 => 5.9140, std.dev.: 0.0384)
  SingleSource/Benchmarks/Shootout-C++/methcall: -1.28% (7.9366 => 7.8354, std.dev.: 0.0266)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/ConditionalExpr: 84.72% (0.0229 => 0.0423, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-05-31-LongShifts: 73.83% (0.0149 => 0.0259, std.dev.: 0.0011)
  SingleSource/UnitTests/2002-05-02-CastTest: 70.43% (0.0257 => 0.0438, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 62.83% (0.0861 => 0.1402, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 60.24% (0.0659 => 0.1056, std.dev.: 0.0035)
  SingleSource/UnitTests/Vector/simple: 44.68% (0.0235 => 0.0340, std.dev.: 0.0039)
  SingleSource/Regression/C++/EH/exception_spec_test: 41.67% (0.0348 => 0.0493, std.dev.: 0.0056)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.74% (0.1080 => 0.1358, std.dev.: 0.0059)
  SingleSource/UnitTests/Vector/constpool: 20.18% (9.2178 => 11.0784, std.dev.: 0.6093)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 14.32% (0.0943 => 0.1078, std.dev.: 0.0021)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.61% (44.9186 => 50.5842, std.dev.: 0.5887)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 5.24% (1.4994 => 1.5780, std.dev.: 0.0046)
  SingleSource/Benchmarks/Shootout-C++/wc: 5.23% (0.2237 => 0.2354, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.23% (0.6412 => 0.6683, std.dev.: 0.0088)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 23.82% (4.5977 => 5.6930, std.dev.: 0.1991)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 17.90% (4.0567 => 4.7829, std.dev.: 0.0749)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 11.77% (35.9684 => 40.2021, std.dev.: 0.2656)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.34% (28.6638 => 31.9132, std.dev.: 0.9028)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 10.71% (3.8883 => 4.3048, std.dev.: 0.1181)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.92% (0.3358 => 0.3691, std.dev.: 0.0118)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.05% (2.6658 => 2.8538, std.dev.: 0.0614)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.95% (2.8940 => 3.0950, std.dev.: 0.0572)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.12% (5.9133 => 6.2158, std.dev.: 0.0242)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.79% (3.6142 => 3.7513, std.dev.: 0.0339)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.69% (61.0792 => 63.3311, std.dev.: 0.4937)
  SingleSource/Regression/C/uint64_to_float: 3.57% (1.4585 => 1.5106, std.dev.: 0.0127)
  SingleSource/Benchmarks/Misc/fp-convert: 3.28% (7.3892 => 7.6318, std.dev.: 0.0725)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.85% (7.6931 => 7.8354, std.dev.: 0.0266)
  MultiSource/Benchmarks/llubenchmark/llu: 1.54% (1.9763 => 2.0067, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.44% (5.1947 => 5.2695, std.dev.: 0.0255)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.13% (2.5025 => 2.5307, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.09% (5.3463 => 5.4046, std.dev.: 0.0145)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -8.07% (0.3247 => 0.2985, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.56% (1.3182 => 1.2844, std.dev.: 0.0030)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -9.95% (0.1035 => 0.0932, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.21% (0.8636 => 0.8272, std.dev.: 0.0097)
  SingleSource/Benchmarks/McGill/misr: -3.23% (0.4029 => 0.3899, std.dev.: 0.0024)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.39% (3.4043 => 3.3229, std.dev.: 0.0301)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.30% (6.0535 => 5.9140, std.dev.: 0.0384)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131210/8c65214f/attachment.html>


More information about the llvm-testresults mailing list