[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Sep 23 13:17:39 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15591?compare_to=15587&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15591, Order: 191209, Start Time: 2013-09-23 18:28:05, End Time: 2013-09-23 20:20:22
      To: 15587, Order: 191206, Start Time: 2013-09-23 16:16:41, End Time: 2013-09-23 18:01:49
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 34 (39 on baseline)
Performance Improvements: 6 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1067 (1052 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 88.65% (0.1031 => 0.1945, std.dev.: 0.0099)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 66.80% (0.0500 => 0.0834, std.dev.: 0.0112)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 60.90% (0.1422 => 0.2288, std.dev.: 0.0132)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 53.31% (0.1223 => 0.1875, std.dev.: 0.0215)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 51.03% (0.9710 => 1.4665, std.dev.: 0.1009)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 48.61% (0.0502 => 0.0746, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 39.67% (1.4125 => 1.9728, std.dev.: 0.1029)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 37.78% (4.9619 => 6.8364, std.dev.: 0.3796)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.58% (1.6399 => 2.1906, std.dev.: 0.0327)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 30.78% (4.9590 => 6.4856, std.dev.: 0.3918)
  MultiSource/Benchmarks/nbench/nbench: 21.03% (1.2908 => 1.5623, std.dev.: 0.0714)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.44% (14.8791 => 17.7710, std.dev.: 0.4428)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.92% (1.9217 => 2.2277, std.dev.: 0.1040)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.33% (1.2594 => 1.4273, std.dev.: 0.0364)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 7.93% (1.2351 => 1.3330, std.dev.: 0.0270)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.57% (1.3378 => 1.3855, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.90% (1.2809 => 1.3052, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.16% (1.3232 => 1.3386, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 93.82% (0.0453 => 0.0878, std.dev.: 0.0037)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 72.30% (0.0213 => 0.0367, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.61% (0.0573 => 0.0863, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.20% (1.4831 => 1.8865, std.dev.: 0.0192)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.30% (2.4913 => 3.1215, std.dev.: 0.1986)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 21.58% (1.2337 => 1.4999, std.dev.: 0.0870)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.14% (13.9869 => 16.8045, std.dev.: 0.0715)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.93% (13.0058 => 13.6476, std.dev.: 0.2416)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 4.54% (0.4669 => 0.4881, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.49% (5.9020 => 6.1671, std.dev.: 0.0987)
  MultiSource/Applications/spiff/spiff: 3.42% (2.8291 => 2.9258, std.dev.: 0.0234)
  MultiSource/Applications/viterbi/viterbi: 2.41% (2.6359 => 2.6993, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.75% (5.6079 => 5.7060, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.45% (4.0845 => 4.1439, std.dev.: 0.0153)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.21% (12.1485 => 12.2959, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.20% (3.1843 => 3.2225, std.dev.: 0.0035)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -13.45% (0.1234 => 0.1068, std.dev.: 0.0063)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: -6.58% (7.8185 => 7.3042, std.dev.: 0.1988)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.01% (1.8916 => 1.8157, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.75% (3.5879 => 3.4892, std.dev.: 0.0149)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.02% (46.8353 => 45.8914, std.dev.: 0.2907)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.10% (1.6302 => 1.6123, std.dev.: 0.0063)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.53% (0.1346 => 0.1312, std.dev.: 0.0158)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 78.28% (0.1091 => 0.1945, std.dev.: 0.0099)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 72.31% (0.0484 => 0.0834, std.dev.: 0.0112)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 63.20% (0.1402 => 0.2288, std.dev.: 0.0132)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 54.47% (0.9494 => 1.4665, std.dev.: 0.1009)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 53.81% (0.1219 => 0.1875, std.dev.: 0.0215)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 48.02% (0.0504 => 0.0746, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 40.58% (1.4033 => 1.9728, std.dev.: 0.1029)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 39.22% (4.9105 => 6.8364, std.dev.: 0.3796)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.05% (1.6465 => 2.1906, std.dev.: 0.0327)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 31.57% (4.9293 => 6.4856, std.dev.: 0.3918)
  MultiSource/Benchmarks/nbench/nbench: 25.14% (1.2484 => 1.5623, std.dev.: 0.0714)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.76% (14.4764 => 17.7710, std.dev.: 0.4428)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.65% (1.8775 => 2.2277, std.dev.: 0.1040)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.08% (1.2622 => 1.4273, std.dev.: 0.0364)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.82% (1.2250 => 1.3330, std.dev.: 0.0270)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.68% (1.3235 => 1.3855, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.10% (1.2660 => 1.3052, std.dev.: 0.0022)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.41% (0.6297 => 0.6449, std.dev.: 0.0010)
  MultiSource/Applications/minisat/minisat: 2.15% (0.7439 => 0.7599, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.00% (1.3123 => 1.3386, std.dev.: 0.0038)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.53% (1.1580 => 1.1757, std.dev.: 0.0054)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 55.12% (0.0566 => 0.0878, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 49.83% (0.0576 => 0.0863, std.dev.: 0.0043)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 48.58% (0.0247 => 0.0367, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/pi: 31.63% (1.6574 => 2.1817, std.dev.: 0.2026)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.01% (2.4010 => 3.1215, std.dev.: 0.1986)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.21% (1.4830 => 1.8865, std.dev.: 0.0192)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.63% (0.1374 => 0.1630, std.dev.: 0.0095)
  SingleSource/UnitTests/Vector/multiplies: 6.65% (0.5561 => 0.5931, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.42% (5.9061 => 6.1671, std.dev.: 0.0987)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.25% (6.5990 => 6.8792, std.dev.: 0.0897)
  MultiSource/Applications/spiff/spiff: 3.77% (2.8194 => 2.9258, std.dev.: 0.0234)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.13% (4.0181 => 4.1439, std.dev.: 0.0153)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.64% (3.5683 => 3.6626, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.08% (3.1569 => 3.2225, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.73% (5.6092 => 5.7060, std.dev.: 0.0192)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.15% (1.5940 => 1.6123, std.dev.: 0.0063)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.12% (3.7874 => 3.8300, std.dev.: 0.0098)
  SingleSource/Benchmarks/Shootout/methcall: 1.04% (8.5434 => 8.6326, std.dev.: 0.0334)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.27% (0.2571 => 0.2384, std.dev.: 0.0008)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.55% (0.5226 => 0.2375, std.dev.: 0.0071)
  MultiSource/Applications/sgefa/sgefa: -46.78% (1.5790 => 0.8404, std.dev.: 0.0391)
  SingleSource/Benchmarks/Linpack/linpack-pc: -20.88% (57.2347 => 45.2868, std.dev.: 3.8639)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.44% (15.9508 => 13.6476, std.dev.: 0.2416)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.51% (20.8247 => 18.6370, std.dev.: 0.2291)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.24% (3.4956 => 3.1378, std.dev.: 0.0369)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.3304 => 0.2977, std.dev.: 0.0037)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.27% (50.0284 => 45.8914, std.dev.: 0.2907)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.91% (4.3592 => 4.1888, std.dev.: 0.0560)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.69% (5.4473 => 5.2461, std.dev.: 0.0164)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.79% (3.7437 => 3.6391, std.dev.: 0.0073)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.66% (2.5938 => 2.5249, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.10% (3.5642 => 3.4892, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.98% (17.1431 => 16.8045, std.dev.: 0.0715)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.18% (3.8582 => 3.8125, std.dev.: 0.0059)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.67% (0.1348 => 0.1312, std.dev.: 0.0158)

Report Time: 0.96s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130923/772755a9/attachment.html>


More information about the llvm-testresults mailing list