[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed May 29 16:06:20 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11855?compare_to=11852&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11855, Order: 182879, Start Time: 2013-05-29 21:18:48, End Time: 2013-05-29 23:06:53
      To: 11852, Order: 182870, Start Time: 2013-05-29 19:08:11, End Time: 2013-05-29 20:54:38
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 21 (21 on baseline)
Performance Improvements: 4 (34 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1082 (1052 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-6: 46.50% (0.0329 => 0.0482, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 41.15% (0.0763 => 0.1077, std.dev.: 0.0075)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.59% (6.3030 => 6.8442, std.dev.: 0.0334)
  SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.1941 => 0.2054, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.43% (0.5197 => 0.5479, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.22% (0.4696 => 0.4941, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc/oourafft: 5.21% (0.2247 => 0.2364, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.10% (1.3877 => 1.4029, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.58% (4.5799 => 5.9806, std.dev.: 0.0734)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.00% (0.2119 => 0.2564, std.dev.: 0.0102)
  MultiSource/Applications/sgefa/sgefa: 18.17% (1.1661 => 1.3780, std.dev.: 0.0130)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.68% (2.1110 => 2.4209, std.dev.: 0.0402)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 9.78% (0.3047 => 0.3345, std.dev.: 0.0107)
  MultiSource/Applications/SIBsim4/SIBsim4: 9.13% (3.1014 => 3.3847, std.dev.: 0.0762)
  SingleSource/Benchmarks/Misc/lowercase: 7.03% (0.7794 => 0.8342, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.86% (21.4568 => 22.5000, std.dev.: 0.2609)
  SingleSource/Benchmarks/Misc/mandel-2: 4.58% (0.8319 => 0.8700, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.84% (1.0554 => 1.0959, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.95% (5.0182 => 5.1662, std.dev.: 0.0197)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.24% (1.4757 => 1.5088, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc/mandel: 1.33% (1.0243 => 1.0379, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -12.38% (1.0948 => 0.9593, std.dev.: 0.0057)
  MultiSource/Applications/lambda-0_1_3/lambda: -2.45% (8.9745 => 8.7547, std.dev.: 0.0130)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.19% (3.0317 => 2.9654, std.dev.: 0.0157)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.87% (4.0627 => 3.9867, std.dev.: 0.0202)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.31% (0.1448 => 0.1496, std.dev.: 0.0067)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-6: 46.95% (0.0328 => 0.0482, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 38.25% (0.0779 => 0.1077, std.dev.: 0.0075)
  SingleSource/Benchmarks/Shootout-C++/hello: 6.20% (0.1934 => 0.2054, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.2239 => 0.2364, std.dev.: 0.0026)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.45% (0.5196 => 0.5479, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.24% (0.4740 => 0.4941, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.42% (1.4131 => 1.4614, std.dev.: 0.0172)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.33% (6.6236 => 6.8442, std.dev.: 0.0334)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.42% (1.3832 => 1.4029, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.75% (4.6452 => 5.9806, std.dev.: 0.0734)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 23.75% (0.2072 => 0.2564, std.dev.: 0.0102)
  MultiSource/Applications/sgefa/sgefa: 17.83% (1.1695 => 1.3780, std.dev.: 0.0130)
  SingleSource/Benchmarks/Misc/pi: 13.35% (1.8318 => 2.0763, std.dev.: 0.0629)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.56% (0.8276 => 0.9067, std.dev.: 0.0176)
  SingleSource/Benchmarks/Misc/lowercase: 7.69% (0.7746 => 0.8342, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.71% (21.4874 => 22.5000, std.dev.: 0.2609)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.67% (1.0571 => 1.0959, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/mandel-2: 3.45% (0.8410 => 0.8700, std.dev.: 0.0074)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.35% (16.4665 => 16.8528, std.dev.: 0.0830)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.34% (88.2998 => 89.4801, std.dev.: 0.0760)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.03% (1.6980 => 1.7155, std.dev.: 0.0030)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.69% (0.0803 => 0.0669, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.03% (0.1151 => 0.1001, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.70% (0.1646 => 0.1437, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.91% (0.1075 => 0.0947, std.dev.: 0.0008)
  MultiSource/Applications/JM/lencod/lencod: -10.98% (18.9387 => 16.8584, std.dev.: 0.6491)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.48% (1.5932 => 1.4262, std.dev.: 0.0351)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.83% (0.1322 => 0.1192, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.89% (5.4314 => 4.9487, std.dev.: 0.0498)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -7.32% (0.1886 => 0.1748, std.dev.: 0.0020)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.66% (0.2416 => 0.2255, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.35% (0.7381 => 0.6912, std.dev.: 0.0092)
  MultiSource/Applications/oggenc/oggenc: -6.25% (5.9886 => 5.6142, std.dev.: 0.1363)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.03% (2.0439 => 1.9206, std.dev.: 0.0190)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.65% (0.3853 => 0.3751, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.47% (1.2911 => 0.7299, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.33% (4.4050 => 3.2451, std.dev.: 0.1403)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.42% (6.2328 => 5.0221, std.dev.: 0.0126)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.52% (25.3677 => 21.1772, std.dev.: 0.0315)
  SingleSource/Benchmarks/Misc/salsa20: -12.84% (10.3398 => 9.0119, std.dev.: 0.0197)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.39% (0.7941 => 0.7275, std.dev.: 0.0118)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.90% (48.3307 => 44.5120, std.dev.: 0.1060)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.42% (3.2030 => 2.9654, std.dev.: 0.0157)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.84% (0.1945 => 0.1812, std.dev.: 0.0011)
  MultiSource/Applications/sqlite3/sqlite3: -6.59% (4.6358 => 4.3303, std.dev.: 0.0555)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.46% (4.5717 => 4.3220, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.61% (0.2777 => 0.2649, std.dev.: 0.0018)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.90% (9.1099 => 8.7547, std.dev.: 0.0130)
  MultiSource/Benchmarks/Bullet/bullet: -3.68% (7.1938 => 6.9291, std.dev.: 0.1018)
  SingleSource/Benchmarks/Misc/flops: -3.51% (10.2170 => 9.8583, std.dev.: 0.0195)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.92% (5.7342 => 5.5669, std.dev.: 0.0463)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.67% (1.6679 => 1.6233, std.dev.: 0.0005)
  MultiSource/Applications/JM/lencod/lencod: -2.20% (7.0353 => 6.8806, std.dev.: 0.0347)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.17% (0.9806 => 0.9593, std.dev.: 0.0057)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.20% (2.8573 => 2.8229, std.dev.: 0.0091)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.82% (0.1441 => 0.1496, std.dev.: 0.0067)

Report Time: 1.36s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130529/5dcddeee/attachment.html>


More information about the llvm-testresults mailing list