[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Mon Oct 14 22:35:55 PDT 2013

http://llvm.org/perf/db_default/v4/nts/16327?compare_to=16323&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16327, Order: 192668, Start Time: 2013-10-15 03:48:04, End Time: 2013-10-15 05:39:03
      To: 16323, Order: 192660, Start Time: 2013-10-15 01:31:53, End Time: 2013-10-15 03:26:36
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 46 (65 on baseline)
Performance Improvements: 11 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1050 (1027 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 63.48% (0.3650 => 0.5967, std.dev.: 0.0336)
  MultiSource/Benchmarks/Olden/em3d/em3d: 42.83% (0.1987 => 0.2838, std.dev.: 0.0271)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 42.30% (0.1130 => 0.1608, std.dev.: 0.0106)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 41.12% (0.9628 => 1.3587, std.dev.: 0.0670)
  MultiSource/Benchmarks/MallocBench/gs/gs: 39.78% (4.8364 => 6.7602, std.dev.: 0.1997)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 38.81% (0.7541 => 1.0468, std.dev.: 0.1069)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 38.66% (0.2936 => 0.4071, std.dev.: 0.0416)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 38.34% (0.3988 => 0.5517, std.dev.: 0.0341)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 33.51% (0.0946 => 0.1263, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 31.47% (1.6515 => 2.1712, std.dev.: 0.0429)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 26.12% (10.0825 => 12.7160, std.dev.: 0.6723)
  MultiSource/Applications/lua/lua: 26.09% (4.4263 => 5.5811, std.dev.: 0.0511)
  MultiSource/Applications/hbd/hbd: 24.35% (1.5879 => 1.9745, std.dev.: 0.0484)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.40% (5.7090 => 6.8736, std.dev.: 0.1225)
  MultiSource/Applications/ClamAV/clamscan: 19.32% (17.6923 => 21.1108, std.dev.: 0.2477)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.80% (0.9765 => 1.1308, std.dev.: 0.0417)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 15.02% (1.3645 => 1.5695, std.dev.: 0.0778)
  MultiSource/Applications/SIBsim4/SIBsim4: 14.78% (1.6145 => 1.8532, std.dev.: 0.0238)
  MultiSource/Applications/sqlite3/sqlite3: 13.98% (16.8349 => 19.1887, std.dev.: 0.1740)
  MultiSource/Applications/hexxagon/hexxagon: 12.39% (1.0445 => 1.1739, std.dev.: 0.0231)
  MultiSource/Applications/kimwitu++/kc: 9.29% (19.1413 => 20.9196, std.dev.: 0.4746)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.59% (1.1138 => 1.1872, std.dev.: 0.0236)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.2298 => 0.2423, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 93.45% (0.1420 => 0.2747, std.dev.: 0.0385)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 80.09% (0.7591 => 1.3671, std.dev.: 0.0668)
  MultiSource/Applications/lemon/lemon: 53.18% (0.9091 => 1.3926, std.dev.: 0.1030)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 51.35% (0.0222 => 0.0336, std.dev.: 0.0008)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 45.48% (0.0862 => 0.1254, std.dev.: 0.0066)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 39.93% (1.3239 => 1.8525, std.dev.: 0.0801)
  MultiSource/Applications/minisat/minisat: 33.56% (6.5217 => 8.7103, std.dev.: 0.0956)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.19% (2.4418 => 3.0081, std.dev.: 0.1410)
  MultiSource/Benchmarks/llubenchmark/llu: 20.98% (1.9748 => 2.3891, std.dev.: 0.0922)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.23% (1.3068 => 1.5319, std.dev.: 0.0551)
  MultiSource/Benchmarks/Olden/tsp/tsp: 8.52% (1.5635 => 1.6967, std.dev.: 0.0228)
  MultiSource/Applications/sqlite3/sqlite3: 3.74% (4.2890 => 4.4496, std.dev.: 0.0614)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.42% (1.2591 => 1.3021, std.dev.: 0.0114)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.62% (5.4250 => 5.5670, std.dev.: 0.0314)
  MultiSource/Applications/sgefa/sgefa: 2.34% (0.8984 => 0.9194, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (4.2213 => 4.3122, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.06% (4.4372 => 4.5287, std.dev.: 0.0118)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.94% (23.3543 => 23.8070, std.dev.: 0.0338)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.64% (1.4864 => 1.5108, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/em3d/em3d: 1.47% (3.5598 => 3.6122, std.dev.: 0.0176)
  SingleSource/Regression/C/uint64_to_float: 1.31% (1.4673 => 1.4865, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.22% (3.5439 => 3.5873, std.dev.: 0.0155)
  SingleSource/Benchmarks/Misc/flops-5: 1.19% (2.7741 => 2.8072, std.dev.: 0.0047)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -28.22% (0.1963 => 0.1409, std.dev.: 0.0104)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (0.1201 => 0.1100, std.dev.: 0.0032)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -5.47% (0.4188 => 0.3959, std.dev.: 0.0017)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.62% (0.5429 => 0.5287, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.05% (5.0697 => 4.9656, std.dev.: 0.0259)
  MultiSource/Applications/obsequi/Obsequi: -1.82% (1.2001 => 1.1782, std.dev.: 0.0071)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.82% (7.5768 => 7.4390, std.dev.: 0.0457)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.35% (1.1295 => 1.1142, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -27.87% (2.0155 => 1.4537, std.dev.: 0.1764)
  SingleSource/Benchmarks/Misc/fbench: -1.16% (4.9994 => 4.9412, std.dev.: 0.0194)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.13% (35.4893 => 35.0884, std.dev.: 0.0336)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.33% (0.1358 => 0.1376, std.dev.: 0.0345)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 71.47% (0.3480 => 0.5967, std.dev.: 0.0336)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 58.42% (0.1015 => 0.1608, std.dev.: 0.0106)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 47.49% (0.9212 => 1.3587, std.dev.: 0.0670)
  MultiSource/Benchmarks/MallocBench/gs/gs: 47.34% (4.5883 => 6.7602, std.dev.: 0.1997)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 44.35% (0.3822 => 0.5517, std.dev.: 0.0341)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 44.31% (0.2821 => 0.4071, std.dev.: 0.0416)
  MultiSource/Benchmarks/Olden/em3d/em3d: 43.91% (0.1972 => 0.2838, std.dev.: 0.0271)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 41.18% (0.0748 => 0.1056, std.dev.: 0.0119)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 40.30% (0.7461 => 1.0468, std.dev.: 0.1069)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 35.30% (1.6047 => 2.1712, std.dev.: 0.0429)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 33.51% (0.0946 => 0.1263, std.dev.: 0.0014)
  MultiSource/Applications/lua/lua: 32.12% (4.2242 => 5.5811, std.dev.: 0.0511)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 30.62% (9.7354 => 12.7160, std.dev.: 0.6723)
  MultiSource/Applications/ClamAV/clamscan: 27.64% (16.5398 => 21.1108, std.dev.: 0.2477)
  MultiSource/Applications/hbd/hbd: 25.80% (1.5696 => 1.9745, std.dev.: 0.0484)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.94% (5.5014 => 6.8736, std.dev.: 0.1225)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 23.31% (1.2728 => 1.5695, std.dev.: 0.0778)
  MultiSource/Applications/SIBsim4/SIBsim4: 20.86% (1.5333 => 1.8532, std.dev.: 0.0238)
  MultiSource/Benchmarks/BitBench/five11/five11: 19.24% (0.0603 => 0.0719, std.dev.: 0.0015)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.11% (0.9494 => 1.1308, std.dev.: 0.0417)
  MultiSource/Applications/sqlite3/sqlite3: 17.80% (16.2888 => 19.1887, std.dev.: 0.1740)
  MultiSource/Benchmarks/Olden/mst/mst: 16.48% (0.1311 => 0.1527, std.dev.: 0.0073)
  MultiSource/Applications/hexxagon/hexxagon: 14.24% (1.0276 => 1.1739, std.dev.: 0.0231)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.19% (0.1219 => 0.1392, std.dev.: 0.0052)
  MultiSource/Applications/kimwitu++/kc: 13.94% (18.3608 => 20.9196, std.dev.: 0.4746)
  MultiSource/Applications/JM/lencod/lencod: 11.38% (16.5902 => 18.4789, std.dev.: 0.5711)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.69% (0.2189 => 0.2423, std.dev.: 0.0036)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.38% (1.0756 => 1.1872, std.dev.: 0.0236)
  MultiSource/Applications/oggenc/oggenc: 7.96% (5.3339 => 5.7587, std.dev.: 0.0924)
  MultiSource/Benchmarks/FreeBench/neural/neural: 7.28% (0.1882 => 0.2019, std.dev.: 0.0047)
  MultiSource/Applications/SPASS/SPASS: 3.38% (16.1646 => 16.7102, std.dev.: 0.2097)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.38% (7.2661 => 7.4390, std.dev.: 0.0457)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.36% (1.3365 => 1.3680, std.dev.: 0.0093)
  MultiSource/Applications/obsequi/Obsequi: 2.00% (1.1551 => 1.1782, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.73% (1.0952 => 1.1142, std.dev.: 0.0054)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 99.49% (0.1377 => 0.2747, std.dev.: 0.0385)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 84.49% (0.7410 => 1.3671, std.dev.: 0.0668)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.34% (7.6426 => 12.4833, std.dev.: 0.1058)
  MultiSource/Applications/lemon/lemon: 63.34% (0.8526 => 1.3926, std.dev.: 0.1030)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 52.73% (0.0220 => 0.0336, std.dev.: 0.0008)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 45.31% (0.0863 => 0.1254, std.dev.: 0.0066)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 40.95% (1.3143 => 1.8525, std.dev.: 0.0801)
  MultiSource/Applications/minisat/minisat: 38.79% (6.2760 => 8.7103, std.dev.: 0.0956)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 32.00% (1.1431 => 1.5089, std.dev.: 0.0452)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.29% (2.4010 => 3.0081, std.dev.: 0.1410)
  MultiSource/Benchmarks/llubenchmark/llu: 20.12% (1.9889 => 2.3891, std.dev.: 0.0922)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.77% (1.3008 => 1.5319, std.dev.: 0.0551)
  MultiSource/Applications/obsequi/Obsequi: 13.65% (2.1884 => 2.4872, std.dev.: 0.0441)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.13% (2.4753 => 2.7012, std.dev.: 0.0336)
  MultiSource/Benchmarks/Olden/tsp/tsp: 9.09% (1.5553 => 1.6967, std.dev.: 0.0228)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.58% (3.1730 => 3.3501, std.dev.: 0.0352)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.77% (2.5368 => 2.6578, std.dev.: 0.0322)
  MultiSource/Applications/sqlite3/sqlite3: 4.13% (4.2733 => 4.4496, std.dev.: 0.0614)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.03% (1.2516 => 1.3021, std.dev.: 0.0114)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.64% (5.3716 => 5.5670, std.dev.: 0.0314)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.57% (0.3836 => 0.3973, std.dev.: 0.0019)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.14% (89.7126 => 92.5262, std.dev.: 0.0436)
  MultiSource/Applications/hexxagon/hexxagon: 2.72% (14.7810 => 15.1832, std.dev.: 0.0184)
  SingleSource/Regression/C/uint64_to_float: 2.32% (1.4528 => 1.4865, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.26% (3.5683 => 3.6490, std.dev.: 0.0195)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.90% (1.7652 => 1.7987, std.dev.: 0.0049)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.87% (1.4830 => 1.5108, std.dev.: 0.0020)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.43% (23.4704 => 23.8070, std.dev.: 0.0338)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.35% (16.7972 => 17.0242, std.dev.: 0.0505)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.17% (0.1483 => 0.1169, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/sgefa/sgefa: -41.77% (1.5790 => 0.9194, std.dev.: 0.0006)
  MultiSource/Benchmarks/FreeBench/neural/neural: -38.31% (0.5226 => 0.3224, std.dev.: 0.0597)
  MultiSource/Benchmarks/Olden/em3d/em3d: -28.17% (5.0288 => 3.6122, std.dev.: 0.0176)
  SingleSource/Benchmarks/Linpack/linpack-pc: -24.83% (57.2347 => 43.0250, std.dev.: 3.4072)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.84% (15.9508 => 12.7867, std.dev.: 0.2164)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -11.88% (0.1027 => 0.0905, std.dev.: 0.0039)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.78% (20.8247 => 18.3709, std.dev.: 0.2099)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.66% (3.4956 => 3.1228, std.dev.: 0.0291)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.58% (50.0284 => 44.7349, std.dev.: 1.4986)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.93% (3.0561 => 2.8750, std.dev.: 0.0257)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.57% (2.5938 => 2.5013, std.dev.: 0.0216)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.77% (3.7874 => 3.6824, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.73% (17.1431 => 16.6753, std.dev.: 0.0431)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.08% (4.3592 => 4.3122, std.dev.: 0.0094)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.08% (0.1348 => 0.1376, std.dev.: 0.0345)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131015/de8e508b/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results