[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 30 12:08:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16842?compare_to=16839&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16842, Order: 193696, Start Time: 2013-10-30 17:11:51, End Time: 2013-10-30 19:11:42
      To: 16839, Order: 193684, Start Time: 2013-10-30 14:49:23, End Time: 2013-10-30 16:48:25
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 16 (36 on baseline)
Performance Improvements: 24 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1067 (1051 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 56.27% (0.1251 => 0.1955, std.dev.: 0.0159)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 41.20% (0.1051 => 0.1484, std.dev.: 0.0089)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 31.20% (0.0516 => 0.0677, std.dev.: 0.0055)
  MultiSource/Benchmarks/McCat/05-eks/eks: 27.12% (0.5417 => 0.6886, std.dev.: 0.0448)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 26.12% (0.0804 => 0.1014, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 16.17% (1.3671 => 1.5881, std.dev.: 0.0639)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 15.10% (1.3389 => 1.5411, std.dev.: 0.0570)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.54% (0.1636 => 0.1972, std.dev.: 0.0101)
  SingleSource/Benchmarks/Linpack/linpack-pc: 13.44% (45.1310 => 51.1983, std.dev.: 0.9993)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.86% (4.1029 => 4.3022, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.59% (5.9803 => 6.1947, std.dev.: 0.0374)
  SingleSource/Benchmarks/Dhrystone/dry: 3.55% (0.4874 => 0.5047, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.41% (3.5817 => 3.6679, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.30% (5.7729 => 5.9054, std.dev.: 0.0141)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.43% (18.6225 => 18.8892, std.dev.: 0.0212)
  SingleSource/Benchmarks/Shootout/fib2: 1.27% (3.6074 => 3.6533, std.dev.: 0.0021)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/n-body: -45.55% (0.1383 => 0.0753, std.dev.: 0.0039)
  SingleSource/UnitTests/stmtexpr: -41.33% (0.0346 => 0.0203, std.dev.: 0.0031)
  SingleSource/UnitTests/member-function-pointers: -35.63% (0.0348 => 0.0224, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/ffbench: -21.07% (0.0987 => 0.0779, std.dev.: 0.0044)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -19.32% (0.0621 => 0.0501, std.dev.: 0.0033)
  SingleSource/Benchmarks/Stanford/Towers: -17.43% (0.0637 => 0.0526, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -16.13% (0.1141 => 0.0957, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -15.07% (2.4082 => 2.0452, std.dev.: 0.1343)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -13.63% (0.1717 => 0.1483, std.dev.: 0.0080)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -13.34% (53.9106 => 46.7184, std.dev.: 2.6394)
  SingleSource/Benchmarks/Misc/flops: -10.62% (0.1224 => 0.1094, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.36% (0.3457 => 0.3237, std.dev.: 0.0081)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -7.71% (0.7040 => 0.6497, std.dev.: 0.0132)
  SingleSource/Benchmarks/Misc/salsa20: -7.65% (8.1748 => 7.5497, std.dev.: 0.1660)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -7.39% (1.5347 => 1.4213, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/flops-3: -5.69% (2.1639 => 2.0408, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.60% (5.4449 => 5.1946, std.dev.: 0.0517)
  SingleSource/Benchmarks/Misc/flops: -3.76% (9.6340 => 9.2720, std.dev.: 0.1395)
  SingleSource/Benchmarks/Misc/flops-4: -3.33% (1.7948 => 1.7350, std.dev.: 0.0050)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.04% (3.5614 => 3.4532, std.dev.: 0.0165)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -2.87% (2.9711 => 2.8857, std.dev.: 0.0236)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.80% (1.8733 => 1.8208, std.dev.: 0.0096)
  SingleSource/Benchmarks/Shootout/lists: -1.45% (7.3275 => 7.2213, std.dev.: 0.0409)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.29% (4.1545 => 4.1007, std.dev.: 0.0084)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.68% (0.1429 => 0.1453, std.dev.: 0.0024)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-26-Shorts: 66.82% (0.0214 => 0.0357, std.dev.: 0.0044)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 60.38% (0.1219 => 0.1955, std.dev.: 0.0159)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 46.50% (0.1013 => 0.1484, std.dev.: 0.0089)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 33.27% (0.0508 => 0.0677, std.dev.: 0.0055)
  MultiSource/Benchmarks/McCat/05-eks/eks: 32.81% (0.5185 => 0.6886, std.dev.: 0.0448)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 26.91% (0.0799 => 0.1014, std.dev.: 0.0052)
  MultiSource/Applications/kimwitu++/kc: 19.75% (18.3608 => 21.9864, std.dev.: 0.8524)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.50% (1.2468 => 1.4899, std.dev.: 0.0334)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.65% (1.3499 => 1.5881, std.dev.: 0.0639)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.50% (0.0709 => 0.0826, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 16.32% (1.3249 => 1.5411, std.dev.: 0.0570)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 16.15% (1.2116 => 1.4073, std.dev.: 0.0301)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 15.01% (1.2235 => 1.4072, std.dev.: 0.0258)
  MultiSource/Benchmarks/Bullet/bullet: 14.73% (32.7552 => 37.5795, std.dev.: 1.6490)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.43% (1.2948 => 1.4557, std.dev.: 0.0594)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.77% (0.1402 => 0.1511, std.dev.: 0.0011)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.91% (7.6426 => 12.2974, std.dev.: 0.0498)
  SingleSource/Benchmarks/Shootout-C++/matrix: 46.82% (2.8554 => 4.1924, std.dev.: 0.0430)
  MultiSource/Applications/SPASS/SPASS: 30.96% (8.2311 => 10.7795, std.dev.: 0.9874)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.11% (1.1431 => 1.3730, std.dev.: 0.0642)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.07% (2.3084 => 2.6331, std.dev.: 0.1187)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 11.37% (0.8273 => 0.9214, std.dev.: 0.0292)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.59% (96.7834 => 105.0940, std.dev.: 1.8053)
  SingleSource/UnitTests/Vector/multiplies: 6.92% (0.5561 => 0.5946, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.49% (3.1730 => 3.3789, std.dev.: 0.0443)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.90% (4.1011 => 4.3022, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.89% (5.9061 => 6.1947, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.69% (5.6951 => 5.9054, std.dev.: 0.0141)
  SingleSource/Benchmarks/Dhrystone/dry: 3.57% (0.4873 => 0.5047, std.dev.: 0.0050)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.12% (89.7126 => 92.5150, std.dev.: 0.2315)
  MultiSource/Applications/hexxagon/hexxagon: 2.70% (14.7810 => 15.1795, std.dev.: 0.1379)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.60% (5.3022 => 5.4400, std.dev.: 0.0446)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.66% (1.6182 => 1.6451, std.dev.: 0.0081)
  SingleSource/Benchmarks/Shootout/fib2: 1.58% (3.5966 => 3.6533, std.dev.: 0.0021)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.19% (8.8798 => 8.9855, std.dev.: 0.0155)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (4.0596 => 4.1007, std.dev.: 0.0084)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/sgefa/sgefa: -43.90% (1.5790 => 0.8858, std.dev.: 0.0134)
  MultiSource/Benchmarks/FreeBench/neural/neural: -41.14% (0.5226 => 0.3076, std.dev.: 0.0307)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.04% (15.9508 => 13.3920, std.dev.: 0.3885)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.95% (3.4956 => 3.1129, std.dev.: 0.0254)
  SingleSource/Benchmarks/Linpack/linpack-pc: -10.55% (57.2347 => 51.1983, std.dev.: 0.9993)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.29% (20.8247 => 18.8892, std.dev.: 0.0212)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.73% (50.0284 => 45.6630, std.dev.: 1.0110)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.76% (3.7437 => 3.4532, std.dev.: 0.0165)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.58% (3.0561 => 2.8857, std.dev.: 0.0236)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.12% (8.1346 => 7.7998, std.dev.: 0.0932)
  SingleSource/Regression/C/uint64_to_float: -4.05% (1.4528 => 1.3940, std.dev.: 0.0218)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.94% (2.5938 => 2.4915, std.dev.: 0.0358)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.34% (5.4473 => 5.2651, std.dev.: 0.0691)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.16% (3.7874 => 3.6677, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.53% (17.1431 => 16.7098, std.dev.: 0.0309)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.38% (4.3592 => 4.2554, std.dev.: 0.0287)
  MultiSource/Benchmarks/Olden/power/power: -2.37% (1.2170 => 1.1882, std.dev.: 0.0108)
  SingleSource/Benchmarks/Shootout/lists: -2.02% (7.3703 => 7.2213, std.dev.: 0.0409)
  SingleSource/Benchmarks/Misc/oourafft: -2.00% (3.7484 => 3.6735, std.dev.: 0.0240)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.68% (1.8519 => 1.8208, std.dev.: 0.0096)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 7.79% (0.1348 => 0.1453, std.dev.: 0.0024)

Report Time: 1.39s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131030/3bcfa449/attachment.html>


More information about the llvm-testresults mailing list