[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 18 20:46:53 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16465?compare_to=16461&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16465, Order: 193024, Start Time: 2013-10-19 02:03:22, End Time: 2013-10-19 03:50:06
      To: 16461, Order: 193009, Start Time: 2013-10-18 23:45:34, End Time: 2013-10-19 01:40:04
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 14 (24 on baseline)
Performance Improvements: 40 (21 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1053 (1062 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: 30.76% (3.6147 => 4.7265, std.dev.: 0.2969)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 21.21% (0.1641 => 0.1989, std.dev.: 0.0135)
  SingleSource/Benchmarks/Misc/ReedSolomon: 15.17% (8.5249 => 9.8178, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 10.81% (3.6839 => 4.0820, std.dev.: 0.1091)
  SingleSource/Benchmarks/McGill/misr: 8.78% (0.3817 => 0.4152, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.50% (3.4957 => 3.7229, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.72% (5.0996 => 5.2381, std.dev.: 0.0064)
  MultiSource/Applications/spiff/spiff: 2.66% (2.8462 => 2.9220, std.dev.: 0.0260)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.58% (1.6523 => 1.6950, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.35% (5.9077 => 5.9873, std.dev.: 0.0117)
  SingleSource/Benchmarks/Misc/flops-5: 1.26% (2.7757 => 2.8107, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc/mandel: 1.20% (1.0464 => 1.0590, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.14% (3.1846 => 3.2208, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.12% (4.9359 => 4.9910, std.dev.: 0.0187)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -22.87% (1.5253 => 1.1764, std.dev.: 0.1110)
  MultiSource/Benchmarks/Olden/em3d/em3d: -17.38% (0.2416 => 0.1996, std.dev.: 0.0007)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -16.94% (0.1110 => 0.0922, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/ReedSolomon: -16.45% (0.2639 => 0.2205, std.dev.: 0.0008)
  MultiSource/Applications/obsequi/Obsequi: -14.58% (1.3668 => 1.1675, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -13.27% (0.1469 => 0.1274, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -12.25% (1.4926 => 1.3097, std.dev.: 0.0646)
  MultiSource/Benchmarks/Olden/bh/bh: -11.24% (0.3735 => 0.3315, std.dev.: 0.0027)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.73% (0.2663 => 0.2404, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/power/power: -9.43% (0.1601 => 0.1450, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -9.40% (1.3566 => 1.2291, std.dev.: 0.0051)
  MultiSource/Benchmarks/Bullet/bullet: -7.89% (36.1395 => 33.2891, std.dev.: 0.7998)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.17% (1.3083 => 1.2145, std.dev.: 0.0065)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.88% (0.1816 => 0.1691, std.dev.: 0.0042)
  MultiSource/Applications/kimwitu++/kc: -6.02% (20.2922 => 19.0697, std.dev.: 0.2915)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.83% (0.1768 => 0.1665, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.54% (1.3160 => 1.2431, std.dev.: 0.0050)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.30% (1.7519 => 1.6590, std.dev.: 0.0126)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.2256 => 0.2138, std.dev.: 0.0010)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.70% (1.2288 => 1.1711, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.17% (1.3179 => 1.2630, std.dev.: 0.0190)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.16% (0.4163 => 0.3990, std.dev.: 0.0044)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.92% (1.4834 => 1.4252, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.03% (1.3922 => 1.3500, std.dev.: 0.0073)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.31% (5.1300 => 5.0116, std.dev.: 0.0156)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.13% (0.6813 => 0.6668, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.09% (1.2430 => 1.2170, std.dev.: 0.0056)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.81% (2.6116 => 2.5644, std.dev.: 0.0135)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.07% (4.9701 => 4.9170, std.dev.: 0.0194)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -37.26% (0.0738 => 0.0463, std.dev.: 0.0004)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -17.25% (0.0655 => 0.0542, std.dev.: 0.0001)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.45% (51.2364 => 43.8328, std.dev.: 0.6939)
  SingleSource/Benchmarks/Shootout/sieve: -13.40% (8.1576 => 7.0646, std.dev.: 0.0841)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -7.79% (0.9166 => 0.8452, std.dev.: 0.0250)
  MultiSource/Applications/lua/lua: -4.92% (29.7536 => 28.2903, std.dev.: 0.3835)
  MultiSource/Applications/obsequi/Obsequi: -3.91% (2.4741 => 2.3773, std.dev.: 0.0075)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.44% (6.0549 => 5.9072, std.dev.: 0.0255)
  MultiSource/Benchmarks/Olden/bh/bh: -1.66% (2.4145 => 2.3743, std.dev.: 0.0140)
  SingleSource/Benchmarks/Misc/oourafft: -1.26% (3.7328 => 3.6859, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.05% (5.1642 => 5.1102, std.dev.: 0.0173)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.36% (0.1397 => 0.1364, std.dev.: 0.0280)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.48% (0.8667 => 0.8969, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6439 => 0.6586, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.70% (1.2086 => 1.2291, std.dev.: 0.0051)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.67% (4.9293 => 5.0116, std.dev.: 0.0156)
  MultiSource/Applications/obsequi/Obsequi: 1.07% (1.1551 => 1.1675, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.66% (7.6426 => 12.5080, std.dev.: 0.0774)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 22.57% (1.1431 => 1.4011, std.dev.: 0.0517)
  SingleSource/Benchmarks/Misc/ReedSolomon: 15.16% (8.5256 => 9.8178, std.dev.: 0.0041)
  SingleSource/Benchmarks/McGill/misr: 10.10% (0.3771 => 0.4152, std.dev.: 0.0109)
  MultiSource/Applications/obsequi/Obsequi: 8.63% (2.1884 => 2.3773, std.dev.: 0.0075)
  SingleSource/UnitTests/Vector/multiplies: 6.62% (0.5561 => 0.5929, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.45% (3.5642 => 3.7229, std.dev.: 0.0007)
  MultiSource/Applications/spiff/spiff: 3.64% (2.8194 => 2.9220, std.dev.: 0.0260)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.47% (1.1013 => 1.1395, std.dev.: 0.0143)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.24% (89.7126 => 92.6232, std.dev.: 0.3679)
  MultiSource/Benchmarks/Olden/power/power: 2.39% (1.2170 => 1.2461, std.dev.: 0.0048)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.06% (1.7652 => 1.8015, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (3.1569 => 3.2208, std.dev.: 0.0140)
  SingleSource/Benchmarks/Misc/flops: 1.77% (9.4433 => 9.6105, std.dev.: 0.0155)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.64% (8.1346 => 8.2683, std.dev.: 0.0416)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6950, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.31% (5.3022 => 5.3716, std.dev.: 0.0157)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.27% (16.7972 => 17.0111, std.dev.: 0.0700)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.20% (1.5940 => 1.6132, std.dev.: 0.0060)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.51% (1.2622 => 1.2431, std.dev.: 0.0050)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.69% (0.5226 => 0.2368, std.dev.: 0.0383)
  MultiSource/Applications/sgefa/sgefa: -42.95% (1.5790 => 0.9008, std.dev.: 0.0079)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.00% (0.0400 => 0.0260, std.dev.: 0.0006)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.42% (57.2347 => 43.8328, std.dev.: 0.6939)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.43% (50.0284 => 40.8102, std.dev.: 1.5393)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.16% (15.9508 => 13.0539, std.dev.: 0.2151)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.29% (20.8247 => 18.4741, std.dev.: 0.1249)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.34% (3.4956 => 3.1341, std.dev.: 0.0256)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0003)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.95% (0.7474 => 0.7104, std.dev.: 0.0102)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.30% (1.0695 => 1.0235, std.dev.: 0.0178)
  MultiSource/Applications/lua/lua: -4.17% (29.5202 => 28.2903, std.dev.: 0.3835)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.10% (2.5938 => 2.4875, std.dev.: 0.0213)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.38% (3.7437 => 3.6170, std.dev.: 0.0346)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.37% (4.3592 => 4.2123, std.dev.: 0.0448)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.83% (2.4471 => 2.3779, std.dev.: 0.0214)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.72% (3.7874 => 3.6843, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.54% (17.1431 => 16.7076, std.dev.: 0.0671)
  SingleSource/Benchmarks/Misc/oourafft: -1.67% (3.7484 => 3.6859, std.dev.: 0.0130)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.42% (4.9459 => 4.8759, std.dev.: 0.0016)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1348 => 0.1364, std.dev.: 0.0280)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131018/89dc1605/attachment.html>


More information about the llvm-testresults mailing list