[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 20 18:23:54 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15507?compare_to=15504&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15507, Order: 191113, Start Time: 2013-09-20 23:34:36, End Time: 2013-09-21 01:26:35
      To: 15504, Order: 191105, Start Time: 2013-09-20 21:16:51, End Time: 2013-09-20 23:09:32
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 25 (45 on baseline)
Performance Improvements: 15 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1067 (1047 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: 72.93% (0.0314 => 0.0543, std.dev.: 0.0018)
  SingleSource/Benchmarks/McGill/queens: 29.84% (0.0516 => 0.0670, std.dev.: 0.0028)
  MultiSource/Applications/JM/ldecod/ldecod: 12.79% (7.5819 => 8.5517, std.dev.: 0.1774)
  MultiSource/Applications/oggenc/oggenc: 7.59% (5.4213 => 5.8328, std.dev.: 0.0136)
  MultiSource/Applications/JM/lencod/lencod: 7.28% (17.1233 => 18.3699, std.dev.: 0.3924)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.17% (0.6483 => 0.6948, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.43% (1.2442 => 1.3118, std.dev.: 0.0160)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.79% (28.0293 => 28.8117, std.dev.: 0.1479)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 35.84% (4.9439 => 6.7160, std.dev.: 0.1531)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.64% (29.4143 => 34.6018, std.dev.: 0.4925)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.30% (37.3519 => 42.6949, std.dev.: 0.4655)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 12.99% (40.9095 => 46.2227, std.dev.: 1.9484)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.58% (9.7681 => 10.9969, std.dev.: 0.4328)
  SingleSource/Benchmarks/Shootout-C++/fibo: 9.70% (4.9941 => 5.4784, std.dev.: 0.0012)
  MultiSource/Benchmarks/nbench/nbench: 7.69% (19.9969 => 21.5347, std.dev.: 0.4772)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 6.91% (3.9881 => 4.2635, std.dev.: 0.0692)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.62% (1.1472 => 1.2117, std.dev.: 0.0029)
  SingleSource/Regression/C/uint64_to_float: 4.45% (1.4186 => 1.4817, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.08% (2.1203 => 2.2068, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.58% (4.0275 => 4.1314, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.30% (5.2031 => 5.3228, std.dev.: 0.0445)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.27% (6.5879 => 6.7377, std.dev.: 0.0229)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.08% (0.7452 => 0.7607, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/fib2: 1.80% (3.5978 => 3.6624, std.dev.: 0.0018)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.61% (1.6490 => 1.6755, std.dev.: 0.0096)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/strcat: -34.13% (0.3138 => 0.2067, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/matrix: -25.46% (0.3213 => 0.2395, std.dev.: 0.0164)
  SingleSource/Benchmarks/Stanford/Puzzle: -21.35% (0.1639 => 0.1289, std.dev.: 0.0046)
  SingleSource/Benchmarks/Shootout-C++/sieve: -18.65% (0.3582 => 0.2914, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -11.85% (1.4300 => 1.2606, std.dev.: 0.0525)
  SingleSource/Benchmarks/Shootout-C++/hello: -11.43% (0.2091 => 0.1852, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -10.37% (1.5093 => 1.3528, std.dev.: 0.0519)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.74% (1.0074 => 0.9697, std.dev.: 0.0124)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Bubblesort: -32.82% (0.0515 => 0.0346, std.dev.: 0.0046)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -21.32% (5.2500 => 4.1308, std.dev.: 0.1117)
  SingleSource/Benchmarks/Shootout-C++/lists1: -10.56% (0.6698 => 0.5991, std.dev.: 0.0148)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -10.22% (0.9450 => 0.8484, std.dev.: 0.0374)
  SingleSource/Benchmarks/Stanford/Puzzle: -9.86% (0.2079 => 0.1874, std.dev.: 0.0019)
  MultiSource/Applications/viterbi/viterbi: -1.81% (2.6873 => 2.6387, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.48% (1.5230 => 1.5005, std.dev.: 0.0084)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.71% (0.1295 => 0.1343, std.dev.: 0.0043)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: 84.07% (0.0295 => 0.0543, std.dev.: 0.0018)
  SingleSource/Benchmarks/McGill/queens: 33.20% (0.0503 => 0.0670, std.dev.: 0.0028)
  MultiSource/Benchmarks/Bullet/bullet: 18.86% (32.7552 => 38.9316, std.dev.: 1.2446)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 17.05% (24.6139 => 28.8117, std.dev.: 0.1479)
  MultiSource/Applications/JM/ldecod/ldecod: 15.52% (7.4026 => 8.5517, std.dev.: 0.1774)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.13% (1.9476 => 2.2422, std.dev.: 0.0464)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.79% (6.0284 => 6.9199, std.dev.: 0.0441)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.21% (1.3249 => 1.5132, std.dev.: 0.0476)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.55% (4.0397 => 4.5063, std.dev.: 0.0653)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.55% (1.2695 => 1.4161, std.dev.: 0.0482)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.48% (0.3328 => 0.3710, std.dev.: 0.0081)
  MultiSource/Applications/JM/lencod/lencod: 10.73% (16.5902 => 18.3699, std.dev.: 0.3924)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.34% (0.6297 => 0.6948, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.19% (1.3042 => 1.4371, std.dev.: 0.0484)
  MultiSource/Applications/oggenc/oggenc: 9.35% (5.3339 => 5.8328, std.dev.: 0.0136)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.75% (0.2069 => 0.2250, std.dev.: 0.0050)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.44% (2.5666 => 2.7832, std.dev.: 0.0601)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.52% (1.2201 => 1.3118, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.09% (1.2948 => 1.3866, std.dev.: 0.0330)
  MultiSource/Applications/siod/siod: 4.18% (2.4480 => 2.5503, std.dev.: 0.0268)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.13% (1.3123 => 1.3534, std.dev.: 0.0107)
  MultiSource/Applications/d/make_dparser: 2.74% (3.4962 => 3.5920, std.dev.: 0.0268)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 47.67% (4.5479 => 6.7160, std.dev.: 0.1531)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.26% (9.4586 => 10.9969, std.dev.: 0.4328)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.89% (36.8417 => 42.6949, std.dev.: 0.4655)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 14.88% (60.7119 => 69.7455, std.dev.: 3.1595)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.64% (30.1838 => 34.6018, std.dev.: 0.4925)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.96% (40.5588 => 46.2227, std.dev.: 1.9484)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.96% (2.1111 => 2.4059, std.dev.: 0.0288)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.84% (4.9428 => 5.4784, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.02% (1.1013 => 1.2117, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 7.42% (3.9691 => 4.2635, std.dev.: 0.0692)
  SingleSource/UnitTests/Vector/multiplies: 6.40% (0.5561 => 0.5917, std.dev.: 0.0048)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.31% (96.7834 => 102.8929, std.dev.: 1.5985)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.26% (2.9372 => 3.1210, std.dev.: 0.0701)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.97% (1.7652 => 1.8177, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.82% (4.0181 => 4.1314, std.dev.: 0.0065)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.78% (2.1472 => 2.2068, std.dev.: 0.0035)
  MultiSource/Applications/siod/siod: 2.28% (3.5310 => 3.6115, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.04% (6.6028 => 6.7377, std.dev.: 0.0229)
  SingleSource/Regression/C/uint64_to_float: 1.99% (1.4528 => 1.4817, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout/fib2: 1.83% (3.5966 => 3.6624, std.dev.: 0.0018)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.78% (0.7474 => 0.7607, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.19% (5.7757 => 5.8445, std.dev.: 0.0189)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.13% (16.7972 => 16.9870, std.dev.: 0.0220)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -54.82% (57.2347 => 25.8574, std.dev.: 11.8519)
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.55% (0.5226 => 0.2375, std.dev.: 0.0708)
  MultiSource/Applications/sgefa/sgefa: -47.08% (1.5790 => 0.8356, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.97% (15.9508 => 13.2444, std.dev.: 0.3041)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.57% (20.8247 => 18.4144, std.dev.: 0.1572)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.44% (0.3304 => 0.2926, std.dev.: 0.0037)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.86% (50.0284 => 44.5959, std.dev.: 0.3575)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.27% (3.4956 => 3.1365, std.dev.: 0.0378)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.92% (4.3592 => 4.1882, std.dev.: 0.0258)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.16% (2.5938 => 2.5119, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.89% (17.1431 => 16.6470, std.dev.: 0.0377)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.86% (5.2422 => 5.0924, std.dev.: 0.0262)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.50% (0.6563 => 0.6399, std.dev.: 0.0055)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.61% (89.7126 => 88.2714, std.dev.: 0.1503)
  MultiSource/Applications/viterbi/viterbi: -1.31% (2.6736 => 2.6387, std.dev.: 0.0096)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.37% (0.1348 => 0.1343, std.dev.: 0.0043)

Report Time: 1.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130920/056b3c74/attachment.html>


More information about the llvm-testresults mailing list