[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Nov 1 15:44:20 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16908?compare_to=16905&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16908, Order: 193878, Start Time: 2013-11-01 20:51:51, End Time: 2013-11-01 22:47:49
      To: 16905, Order: 193874, Start Time: 2013-11-01 18:42:30, End Time: 2013-11-01 20:30:24
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 32 (40 on baseline)
Performance Improvements: 1 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1074 (1050 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 88.73% (0.0346 => 0.0653, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 55.85% (0.6822 => 1.0632, std.dev.: 0.0914)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 53.51% (0.3779 => 0.5801, std.dev.: 0.0641)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 47.41% (0.7306 => 1.0770, std.dev.: 0.1003)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 47.11% (0.0225 => 0.0331, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 36.30% (1.7089 => 2.3293, std.dev.: 0.2231)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 36.15% (1.1023 => 1.5008, std.dev.: 0.0667)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.39% (1.6645 => 2.2535, std.dev.: 0.1619)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 32.41% (0.1228 => 0.1626, std.dev.: 0.0122)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 29.25% (0.1470 => 0.1900, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.53% (1.4769 => 1.8392, std.dev.: 0.1253)
  MultiSource/Benchmarks/nbench/nbench: 23.08% (1.2582 => 1.5486, std.dev.: 0.0596)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.91% (0.0703 => 0.0857, std.dev.: 0.0034)
  MultiSource/Benchmarks/Bullet/bullet: 18.02% (33.6070 => 39.6633, std.dev.: 1.0661)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.52% (0.1018 => 0.1176, std.dev.: 0.0054)
  MultiSource/Benchmarks/PAQ8p/paq8p: 13.64% (2.5813 => 2.9334, std.dev.: 0.0672)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.60% (1.2467 => 1.4163, std.dev.: 0.0568)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.20% (0.2946 => 0.3335, std.dev.: 0.0044)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 100.66% (0.1366 => 0.2741, std.dev.: 0.0314)
  MultiSource/Applications/minisat/minisat: 20.73% (6.3934 => 7.7186, std.dev.: 0.2570)
  SingleSource/Benchmarks/Shootout/matrix: 19.98% (1.7609 => 2.1128, std.dev.: 0.0013)
  MultiSource/Applications/obsequi/Obsequi: 18.01% (2.3092 => 2.7250, std.dev.: 0.0609)
  SingleSource/Benchmarks/Misc/flops: 17.32% (7.9036 => 9.2723, std.dev.: 0.1965)
  MultiSource/Benchmarks/Bullet/bullet: 14.30% (6.9904 => 7.9902, std.dev.: 0.0512)
  MultiSource/Benchmarks/PAQ8p/paq8p: 9.98% (96.1194 => 105.7090, std.dev.: 0.4853)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 6.77% (6.2558 => 6.6796, std.dev.: 0.0493)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.97% (5.9028 => 6.1960, std.dev.: 0.0911)
  MultiSource/Applications/lua/lua: 4.95% (29.5282 => 30.9912, std.dev.: 0.2936)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.01% (5.8960 => 6.0145, std.dev.: 0.0300)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.26% (23.5521 => 23.8480, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.12% (4.9511 => 5.0066, std.dev.: 0.0172)
  SingleSource/Benchmarks/Shootout/hash: 1.00% (5.1447 => 5.1964, std.dev.: 0.0156)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: -6.95% (4.8900 => 4.5503, std.dev.: 0.0359)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.53% (0.1305 => 0.1325, std.dev.: 0.0248)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 97.28% (0.0331 => 0.0653, std.dev.: 0.0012)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 56.49% (0.3707 => 0.5801, std.dev.: 0.0641)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 56.13% (0.0212 => 0.0331, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 54.80% (0.6868 => 1.0632, std.dev.: 0.0914)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 45.15% (1.6047 => 2.3293, std.dev.: 0.2231)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 44.35% (0.7461 => 1.0770, std.dev.: 0.1003)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 37.25% (1.0935 => 1.5008, std.dev.: 0.0667)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.87% (1.6465 => 2.2535, std.dev.: 0.1619)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 33.39% (0.1219 => 0.1626, std.dev.: 0.0122)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 29.52% (0.1467 => 0.1900, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.73% (1.4746 => 1.8392, std.dev.: 0.1253)
  MultiSource/Benchmarks/nbench/nbench: 24.05% (1.2484 => 1.5486, std.dev.: 0.0596)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.43% (0.0700 => 0.0857, std.dev.: 0.0034)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 22.11% (0.0484 => 0.0591, std.dev.: 0.0016)
  MultiSource/Benchmarks/Bullet/bullet: 21.09% (32.7552 => 39.6633, std.dev.: 1.0661)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.68% (0.2908 => 0.3335, std.dev.: 0.0044)
  MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.5666 => 2.9334, std.dev.: 0.0672)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.21% (1.2622 => 1.4163, std.dev.: 0.0568)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 99.06% (0.1377 => 0.2741, std.dev.: 0.0314)
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.80% (7.6426 => 12.2896, std.dev.: 0.1331)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 55.69% (4.4696 => 6.9585, std.dev.: 0.1031)
  SingleSource/Benchmarks/Shootout-C++/matrix: 47.35% (2.8554 => 4.2075, std.dev.: 0.0410)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 35.99% (4.2391 => 5.7649, std.dev.: 0.2177)
  MultiSource/Applications/obsequi/Obsequi: 24.52% (2.1884 => 2.7250, std.dev.: 0.0609)
  MultiSource/Applications/minisat/minisat: 22.99% (6.2760 => 7.7186, std.dev.: 0.2570)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 21.38% (1.1431 => 1.3875, std.dev.: 0.0531)
  SingleSource/Benchmarks/Shootout/matrix: 18.64% (1.7809 => 2.1128, std.dev.: 0.0013)
  MultiSource/Benchmarks/Bullet/bullet: 13.61% (7.0333 => 7.9902, std.dev.: 0.0512)
  SingleSource/Benchmarks/McGill/misr: 10.16% (0.3771 => 0.4154, std.dev.: 0.0058)
  MultiSource/Benchmarks/PAQ8p/paq8p: 9.22% (96.7834 => 105.7090, std.dev.: 0.4853)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.55% (3.1730 => 3.3808, std.dev.: 0.0230)
  MultiSource/Benchmarks/BitBench/five11/five11: 6.53% (5.3716 => 5.7221, std.dev.: 0.1254)
  SingleSource/UnitTests/Vector/multiplies: 5.12% (0.5561 => 0.5846, std.dev.: 0.0065)
  MultiSource/Applications/lua/lua: 4.98% (29.5202 => 30.9912, std.dev.: 0.2936)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.91% (5.9061 => 6.1960, std.dev.: 0.0911)
  MultiSource/Applications/aha/aha: 4.14% (3.5731 => 3.7211, std.dev.: 0.0286)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.34% (89.7126 => 92.7071, std.dev.: 0.1582)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.44% (5.7757 => 5.9164, std.dev.: 0.0501)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.61% (23.4704 => 23.8480, std.dev.: 0.0101)
  SingleSource/Benchmarks/Shootout/fib2: 1.46% (3.5966 => 3.6491, std.dev.: 0.0059)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -49.33% (0.5226 => 0.2648, std.dev.: 0.0538)
  MultiSource/Applications/sgefa/sgefa: -42.71% (1.5790 => 0.9046, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -21.18% (4.0181 => 3.1671, std.dev.: 0.1651)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.59% (15.9508 => 12.9856, std.dev.: 0.7250)
  SingleSource/Benchmarks/Shootout-C++/moments: -16.34% (0.1285 => 0.1075, std.dev.: 0.0028)
  SingleSource/Benchmarks/Linpack/linpack-pc: -13.15% (57.2347 => 49.7067, std.dev.: 0.9241)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.62% (20.8247 => 18.6127, std.dev.: 0.0884)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.27% (3.4956 => 3.1365, std.dev.: 0.0225)
  MultiSource/Benchmarks/Olden/em3d/em3d: -9.52% (5.0288 => 4.5503, std.dev.: 0.0359)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.31% (3.7437 => 3.4327, std.dev.: 0.0176)
  MultiSource/Benchmarks/nbench/nbench: -7.86% (22.1263 => 20.3866, std.dev.: 0.6751)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.82% (8.1346 => 7.6609, std.dev.: 0.1146)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.71% (5.4473 => 5.2451, std.dev.: 0.0403)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.09% (3.7874 => 3.6704, std.dev.: 0.0098)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.79% (2.5938 => 2.5215, std.dev.: 0.0217)
  MultiSource/Benchmarks/Olden/power/power: -2.68% (1.2170 => 1.1844, std.dev.: 0.0046)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.53% (4.3592 => 4.2488, std.dev.: 0.0245)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.71% (0.1348 => 0.1325, std.dev.: 0.0248)

Report Time: 1.89s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131101/e84d11cd/attachment.html>


More information about the llvm-testresults mailing list