[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 12 11:53:27 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14336?compare_to=14332&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14336, Order: 188182, Start Time: 2013-08-12 17:02:31, End Time: 2013-08-12 18:55:25
      To: 14332, Order: 188178, Start Time: 2013-08-12 14:52:09, End Time: 2013-08-12 16:33:17
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 29 (44 on baseline)
Performance Improvements: 1 (32 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1077 (1031 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 67.46% (0.2747 => 0.4600, std.dev.: 0.0116)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 47.22% (0.9584 => 1.4110, std.dev.: 0.1192)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 35.45% (5.0723 => 6.8705, std.dev.: 0.1002)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 33.19% (5.0474 => 6.7225, std.dev.: 0.0941)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 28.84% (7.5675 => 9.7496, std.dev.: 0.3196)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.83% (1.6360 => 2.0749, std.dev.: 0.1415)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 25.49% (4.7504 => 5.9611, std.dev.: 0.1737)
  MultiSource/Benchmarks/nbench/nbench: 21.08% (1.3057 => 1.5810, std.dev.: 0.0630)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.46% (15.1967 => 18.3061, std.dev.: 0.2417)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.22% (26.0372 => 29.4803, std.dev.: 0.2740)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.45% (1.4643 => 1.6466, std.dev.: 0.0309)
  MultiSource/Benchmarks/Bullet/bullet: 11.75% (35.9131 => 40.1322, std.dev.: 0.6636)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 11.65% (1.4647 => 1.6353, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.13% (1.5066 => 1.6743, std.dev.: 0.0584)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.71% (1.3386 => 1.4819, std.dev.: 0.0519)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.31% (1.4002 => 1.5445, std.dev.: 0.0227)
  SingleSource/Benchmarks/Shootout-C++/hello: 5.27% (0.1972 => 0.2076, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.02% (1.3639 => 1.3915, std.dev.: 0.0062)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 54.59% (0.0229 => 0.0354, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.45% (1.4777 => 1.8833, std.dev.: 0.0184)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 27.02% (2.7014 => 3.4312, std.dev.: 0.0340)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.46% (2.3347 => 2.9525, std.dev.: 0.2033)
  MultiSource/Benchmarks/Bullet/bullet: 9.92% (7.0666 => 7.7676, std.dev.: 0.0878)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.13% (90.5404 => 96.0877, std.dev.: 1.8142)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.16% (2.8170 => 2.9061, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.74% (12.8714 => 13.2245, std.dev.: 0.1240)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.63% (3.5895 => 3.6838, std.dev.: 0.0256)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.47% (1.6301 => 1.6703, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.33% (4.2436 => 4.3001, std.dev.: 0.0086)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.60% (46.4910 => 44.3526, std.dev.: 0.2118)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.61% (0.1264 => 0.1297, std.dev.: 0.0078)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 49.69% (0.3073 => 0.4600, std.dev.: 0.0116)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 28.48% (5.3476 => 6.8705, std.dev.: 0.1002)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.13% (1.1012 => 1.4110, std.dev.: 0.1192)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 27.20% (5.2851 => 6.7225, std.dev.: 0.0941)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 26.56% (7.7035 => 9.7496, std.dev.: 0.3196)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 24.94% (4.7710 => 5.9611, std.dev.: 0.1737)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.35% (1.6686 => 2.0749, std.dev.: 0.1415)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.73% (15.5498 => 18.3061, std.dev.: 0.2417)
  MultiSource/Benchmarks/nbench/nbench: 15.60% (1.3677 => 1.5810, std.dev.: 0.0630)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.75% (1.5037 => 1.6353, std.dev.: 0.0061)
  MultiSource/Benchmarks/Bullet/bullet: 7.06% (37.4863 => 40.1322, std.dev.: 0.6636)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.65% (27.6418 => 29.4803, std.dev.: 0.2740)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 72.72% (3.7285 => 6.4397, std.dev.: 0.0591)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.61% (2.8867 => 4.2899, std.dev.: 0.0344)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 41.64% (0.0341 => 0.0483, std.dev.: 0.0036)
  MultiSource/Benchmarks/FreeBench/neural/neural: 32.61% (0.3171 => 0.4205, std.dev.: 0.0132)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 27.12% (2.6992 => 3.4312, std.dev.: 0.0340)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.30% (1.5030 => 1.8833, std.dev.: 0.0184)
  SingleSource/Benchmarks/Shootout/hash: 24.17% (4.1846 => 5.1959, std.dev.: 0.2231)
  SingleSource/Benchmarks/Shootout-C++/hash: 18.49% (0.6295 => 0.7459, std.dev.: 0.0238)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.12% (7.0762 => 7.8628, std.dev.: 0.2024)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.98% (5.4910 => 5.9842, std.dev.: 0.1095)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.17% (48.3256 => 52.2730, std.dev.: 0.3158)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.55% (14.9584 => 16.0871, std.dev.: 0.4059)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.48% (3.2027 => 3.4422, std.dev.: 0.0271)
  MultiSource/Applications/JM/lencod/lencod: 7.39% (7.1799 => 7.7105, std.dev.: 0.1550)
  SingleSource/Benchmarks/McGill/chomp: 7.10% (1.0051 => 1.0765, std.dev.: 0.0045)
  MultiSource/Benchmarks/Bullet/bullet: 6.41% (7.2995 => 7.7676, std.dev.: 0.0878)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.01% (5.3042 => 5.6230, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.78% (3.4085 => 3.6054, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.76% (5.5008 => 5.8179, std.dev.: 0.0293)
  MultiSource/Applications/siod/siod: 4.93% (3.3761 => 3.5426, std.dev.: 0.0423)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.42% (4.3151 => 4.5058, std.dev.: 0.0614)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.32% (5.1471 => 5.3692, std.dev.: 0.0089)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.21% (3.5351 => 3.6838, std.dev.: 0.0256)
  MultiSource/Applications/spiff/spiff: 4.08% (2.7609 => 2.8735, std.dev.: 0.0403)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.50% (6.1245 => 6.3386, std.dev.: 0.0487)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.22% (25.0200 => 25.8263, std.dev.: 0.0189)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.21% (2.8156 => 2.9061, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc/whetstone: 3.20% (3.4559 => 3.5665, std.dev.: 0.0212)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.91% (3.3877 => 3.4862, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (12.8625 => 13.2245, std.dev.: 0.1240)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.76% (1.3104 => 1.3466, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/flops-6: 1.17% (2.4246 => 2.4530, std.dev.: 0.0110)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.36% (0.2237 => 0.1446, std.dev.: 0.0219)
  MultiSource/Benchmarks/Olden/bisort/bisort: -31.81% (0.1072 => 0.0731, std.dev.: 0.0065)
  MultiSource/Applications/hbd/hbd: -16.04% (2.0193 => 1.6955, std.dev.: 0.0905)
  MultiSource/Applications/sgefa/sgefa: -13.41% (0.4809 => 0.4164, std.dev.: 0.0116)
  MultiSource/Applications/ClamAV/clamscan: -12.30% (19.4145 => 17.0263, std.dev.: 0.4354)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.35% (0.7091 => 0.6286, std.dev.: 0.0248)
  MultiSource/Applications/sqlite3/sqlite3: -10.07% (19.1635 => 17.2340, std.dev.: 0.5528)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.24% (1.4514 => 1.3609, std.dev.: 0.0339)
  MultiSource/Applications/lemon/lemon: -4.85% (1.2976 => 1.2347, std.dev.: 0.0198)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.09% (2.1022 => 1.4277, std.dev.: 0.0112)
  MultiSource/Applications/viterbi/viterbi: -27.18% (3.4923 => 2.5430, std.dev.: 0.0051)
  MultiSource/Applications/JM/ldecod/ldecod: -24.68% (0.0859 => 0.0647, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -23.68% (6.9552 => 5.3084, std.dev.: 0.0434)
  MultiSource/Applications/minisat/minisat: -21.63% (8.0162 => 6.2826, std.dev.: 0.4291)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6170, std.dev.: 0.0114)
  SingleSource/Benchmarks/Misc/mandel: -11.35% (1.1996 => 1.0635, std.dev.: 0.0194)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.02% (3.5791 => 3.2919, std.dev.: 0.1030)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -7.69% (0.2849 => 0.2630, std.dev.: 0.0057)
  MultiSource/Benchmarks/nbench/nbench: -7.05% (22.0083 => 20.4576, std.dev.: 0.4378)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.08% (47.2250 => 44.3526, std.dev.: 0.2118)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.52% (3.8119 => 3.6395, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/fbench: -4.42% (4.9602 => 4.7408, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.20% (1.1024 => 1.0561, std.dev.: 0.0062)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.17% (0.7355 => 0.7048, std.dev.: 0.0065)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.93% (1.7207 => 1.6703, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.92% (6.1482 => 5.9688, std.dev.: 0.0237)
  MultiSource/Applications/sgefa/sgefa: -2.80% (1.4030 => 1.3637, std.dev.: 0.0036)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.54% (0.7806 => 0.7608, std.dev.: 0.0030)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.49% (21.6864 => 21.1459, std.dev.: 0.1181)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.87% (34.8438 => 34.1924, std.dev.: 0.0749)
  SingleSource/Benchmarks/Misc/oourafft: -1.64% (3.7891 => 3.7270, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.25% (5.8810 => 5.8072, std.dev.: 0.0073)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.88% (0.1378 => 0.1297, std.dev.: 0.0078)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130812/155dd9f0/attachment.html>


More information about the llvm-testresults mailing list