[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jul 25 12:58:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13759?compare_to=13756&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13759, Order: 187133, Start Time: 2013-07-25 18:09:56, End Time: 2013-07-25 20:00:26
      To: 13756, Order: 187124, Start Time: 2013-07-25 15:57:26, End Time: 2013-07-25 17:45:59
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 27 (25 on baseline)
Performance Improvements: 17 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1063 (1065 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/fbench: 44.34% (0.0733 => 0.1058, std.dev.: 0.0113)
  SingleSource/Benchmarks/Misc/lowercase: 37.18% (0.0312 => 0.0428, std.dev.: 0.0037)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 33.83% (0.0541 => 0.0724, std.dev.: 0.0065)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 33.24% (1.0074 => 1.3423, std.dev.: 0.0731)
  MultiSource/Benchmarks/mafft/pairlocalalign: 13.65% (10.7740 => 12.2448, std.dev.: 0.1991)
  SingleSource/Benchmarks/Shootout-C++/matrix: 8.40% (0.2618 => 0.2838, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/hash2: 8.31% (0.4935 => 0.5345, std.dev.: 0.0128)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 6.18% (0.2393 => 0.2541, std.dev.: 0.0033)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.12% (1.9438 => 2.0628, std.dev.: 0.0320)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 77.47% (5.7779 => 10.2543, std.dev.: 0.4190)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 66.03% (0.0936 => 0.1554, std.dev.: 0.0100)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 42.22% (2.9181 => 4.1502, std.dev.: 0.3523)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 28.45% (0.0362 => 0.0465, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 27.18% (4.5558 => 5.7941, std.dev.: 0.2740)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.89% (29.7198 => 34.4424, std.dev.: 1.1130)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.17% (9.2819 => 10.2257, std.dev.: 0.2196)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.07% (0.8421 => 0.9185, std.dev.: 0.0292)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.00% (2.7353 => 2.9540, std.dev.: 0.0502)
  SingleSource/Benchmarks/Shootout-C++/ary3: 7.32% (2.0211 => 2.1691, std.dev.: 0.0219)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.50% (40.6100 => 42.8436, std.dev.: 0.1031)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.97% (0.4893 => 0.5136, std.dev.: 0.0064)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.84% (2.5995 => 2.7254, std.dev.: 0.0479)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.52% (1.0553 => 1.1030, std.dev.: 0.0036)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.21% (2.3654 => 2.4649, std.dev.: 0.0261)
  SingleSource/Benchmarks/Shootout-C++/lists: 3.82% (16.5995 => 17.2338, std.dev.: 0.2228)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.99% (1.5857 => 1.6172, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/fibo: 1.34% (4.8145 => 4.8790, std.dev.: 0.0028)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -34.37% (0.2520 => 0.1654, std.dev.: 0.0308)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -26.71% (0.9690 => 0.7102, std.dev.: 0.0623)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -22.81% (0.0697 => 0.0538, std.dev.: 0.0060)
  MultiSource/Applications/obsequi/Obsequi: -18.01% (1.4465 => 1.1860, std.dev.: 0.0973)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -10.07% (0.3237 => 0.2911, std.dev.: 0.0065)
  MultiSource/Benchmarks/FreeBench/neural/neural: -8.72% (0.2270 => 0.2072, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/em3d/em3d: -7.07% (0.2178 => 0.2024, std.dev.: 0.0052)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.31% (1.2498 => 1.1959, std.dev.: 0.0194)
  MultiSource/Benchmarks/sim/sim: -3.14% (0.3949 => 0.3825, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -26.50% (0.1596 => 0.1173, std.dev.: 0.0059)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.62% (0.0807 => 0.0689, std.dev.: 0.0006)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -9.37% (0.4730 => 0.4287, std.dev.: 0.0085)
  MultiSource/Benchmarks/FreeBench/neural/neural: -8.21% (0.3411 => 0.3131, std.dev.: 0.0059)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.21% (96.3868 => 91.3681, std.dev.: 1.4474)
  MultiSource/Benchmarks/Olden/tsp/tsp: -4.21% (1.4926 => 1.4298, std.dev.: 0.0109)
  MultiSource/Benchmarks/Olden/bh/bh: -1.63% (2.4524 => 2.4124, std.dev.: 0.0150)
  MultiSource/Benchmarks/Olden/em3d/em3d: -1.03% (5.2202 => 5.1662, std.dev.: 0.0040)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.30% (0.1336 => 0.1332, std.dev.: 0.0036)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/fbench: 41.82% (0.0746 => 0.1058, std.dev.: 0.0113)
  SingleSource/Benchmarks/Misc/lowercase: 37.18% (0.0312 => 0.0428, std.dev.: 0.0037)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 35.58% (0.0534 => 0.0724, std.dev.: 0.0065)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.89% (1.1012 => 1.3423, std.dev.: 0.0731)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.99% (1.6686 => 1.9688, std.dev.: 0.0663)
  MultiSource/Benchmarks/mafft/pairlocalalign: 12.81% (10.8541 => 12.2448, std.dev.: 0.1991)
  SingleSource/Benchmarks/Shootout-C++/matrix: 8.78% (0.2609 => 0.2838, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/hash2: 8.66% (0.4919 => 0.5345, std.dev.: 0.0128)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.79% (1.9317 => 2.0628, std.dev.: 0.0320)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 5.92% (0.2399 => 0.2541, std.dev.: 0.0033)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 76.32% (5.8158 => 10.2543, std.dev.: 0.4190)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 62.55% (0.0956 => 0.1554, std.dev.: 0.0100)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 42.95% (2.9033 => 4.1502, std.dev.: 0.3523)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 27.30% (4.5517 => 5.7941, std.dev.: 0.2740)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.48% (1.5030 => 1.8709, std.dev.: 0.0196)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.53% (29.8131 => 34.4424, std.dev.: 1.1130)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 15.10% (2.1022 => 2.4196, std.dev.: 0.0154)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.21% (2.6094 => 2.9540, std.dev.: 0.0502)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.93% (9.1355 => 10.2257, std.dev.: 0.2196)
  SingleSource/Benchmarks/Shootout-C++/ary3: 7.23% (2.0229 => 2.1691, std.dev.: 0.0219)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.78% (40.5028 => 42.8436, std.dev.: 0.1031)
  SingleSource/Benchmarks/Shootout-C++/lists: 4.26% (16.5294 => 17.2338, std.dev.: 0.2228)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.16% (2.3894 => 2.4649, std.dev.: 0.0261)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.35% (1.5957 => 1.6172, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/fibo: 1.01% (4.8303 => 4.8790, std.dev.: 0.0028)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.54% (0.2237 => 0.1442, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.09% (0.1072 => 0.0728, std.dev.: 0.0032)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.64% (0.1818 => 0.1370, std.dev.: 0.0071)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -22.81% (0.0675 => 0.0521, std.dev.: 0.0054)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.95% (1.5228 => 1.2038, std.dev.: 0.1214)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.69% (0.3576 => 0.2872, std.dev.: 0.0195)
  MultiSource/Applications/obsequi/Obsequi: -19.24% (1.4685 => 1.1860, std.dev.: 0.0973)
  MultiSource/Benchmarks/Olden/em3d/em3d: -14.49% (0.2367 => 0.2024, std.dev.: 0.0052)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -9.86% (0.1947 => 0.1755, std.dev.: 0.0020)
  MultiSource/Applications/kimwitu++/kc: -7.58% (21.0770 => 19.4802, std.dev.: 0.6007)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.16% (0.9545 => 0.6762, std.dev.: 0.1080)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -26.96% (0.0816 => 0.0596, std.dev.: 0.0055)
  MultiSource/Applications/JM/ldecod/ldecod: -26.54% (0.0859 => 0.0631, std.dev.: 0.0067)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -19.62% (1.0962 => 0.8811, std.dev.: 0.0710)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.68% (0.3557 => 0.3106, std.dev.: 0.0101)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.79% (1.5339 => 1.4298, std.dev.: 0.0109)
  MultiSource/Benchmarks/Olden/bh/bh: -3.03% (2.4879 => 2.4124, std.dev.: 0.0150)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.34% (0.1378 => 0.1332, std.dev.: 0.0036)

Report Time: 1.37s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130725/57a75e10/attachment.html>


More information about the llvm-testresults mailing list