[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 8 00:53:40 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16096?compare_to=16092&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16096, Order: 192168, Start Time: 2013-10-08 06:02:24, End Time: 2013-10-08 07:56:41
      To: 16092, Order: 192160, Start Time: 2013-10-08 03:54:26, End Time: 2013-10-08 05:41:02
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 44 (59 on baseline)
Performance Improvements: 3 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1060 (1030 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.97% (0.0566 => 0.0979, std.dev.: 0.0026)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 70.28% (0.0737 => 0.1255, std.dev.: 0.0091)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 25.91% (4.9762 => 6.2657, std.dev.: 0.4677)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.24% (1.6655 => 2.0693, std.dev.: 0.1497)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.85% (7.4471 => 8.9999, std.dev.: 0.2639)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.92% (4.6711 => 5.4616, std.dev.: 0.3034)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 16.67% (1.3213 => 1.5416, std.dev.: 0.0200)
  MultiSource/Benchmarks/nbench/nbench: 13.88% (1.2594 => 1.4342, std.dev.: 0.0443)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.65% (5.5727 => 6.2775, std.dev.: 0.1965)
  MultiSource/Applications/sqlite3/sqlite3: 12.58% (16.9484 => 19.0805, std.dev.: 0.4199)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 12.47% (1.2833 => 1.4433, std.dev.: 0.0569)
  SingleSource/Benchmarks/Misc/flops: 11.02% (0.1080 => 0.1199, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 9.69% (0.1879 => 0.2061, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout-C++/strcat: 8.79% (0.2024 => 0.2202, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.36% (1.2984 => 1.4069, std.dev.: 0.0151)
  MultiSource/Applications/oggenc/oggenc: 5.59% (5.4625 => 5.7680, std.dev.: 0.0853)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.53% (0.8341 => 0.8552, std.dev.: 0.0028)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.48% (1.5562 => 1.5948, std.dev.: 0.0100)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 151.25% (0.0160 => 0.0402, std.dev.: 0.0030)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 50.52% (0.0289 => 0.0435, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 39.02% (0.0346 => 0.0481, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.77% (60.9886 => 74.8776, std.dev.: 1.2715)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.18% (0.1199 => 0.1453, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 16.09% (40.1538 => 46.6147, std.dev.: 2.0866)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.62% (2.4786 => 2.8657, std.dev.: 0.1359)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 12.04% (21.5216 => 24.1131, std.dev.: 0.8367)
  SingleSource/Benchmarks/McGill/chomp: 11.81% (1.0183 => 1.1386, std.dev.: 0.0164)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 11.64% (0.2620 => 0.2925, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.04% (0.3357 => 0.3694, std.dev.: 0.0063)
  SingleSource/Benchmarks/Misc/salsa20: 9.28% (7.4894 => 8.1843, std.dev.: 0.0547)
  MultiSource/Applications/sgefa/sgefa: 9.00% (0.8343 => 0.9094, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.92% (4.5768 => 4.8935, std.dev.: 0.0505)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.57% (4.1021 => 4.3305, std.dev.: 0.0674)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 5.47% (3.6372 => 3.8363, std.dev.: 0.0692)
  MultiSource/Applications/spiff/spiff: 4.30% (2.8132 => 2.9342, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.20% (6.6367 => 6.9153, std.dev.: 0.0446)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.94% (4.0731 => 4.2334, std.dev.: 0.0088)
  MultiSource/Applications/siod/siod: 3.27% (3.6376 => 3.7564, std.dev.: 0.0122)
  MultiSource/Applications/lua/lua: 3.26% (29.7296 => 30.6994, std.dev.: 0.0830)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.23% (4.8474 => 5.0040, std.dev.: 0.0203)
  SingleSource/Benchmarks/Misc/pi: 2.87% (1.6040 => 1.6501, std.dev.: 0.0142)
  SingleSource/Benchmarks/Misc/flops: 2.65% (9.3639 => 9.6118, std.dev.: 0.0222)
  SingleSource/Benchmarks/Misc/ReedSolomon: 1.55% (8.5206 => 8.6529, std.dev.: 0.0109)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.53% (23.3358 => 23.6918, std.dev.: 0.0651)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/lists: -4.57% (7.5130 => 7.1693, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.67% (16.8490 => 16.5677, std.dev.: 0.0572)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.03% (12.0334 => 11.9093, std.dev.: 0.0277)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.59% (0.1360 => 0.1352, std.dev.: 0.0065)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 73.34% (0.0724 => 0.1255, std.dev.: 0.0091)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.36% (0.0568 => 0.0979, std.dev.: 0.0026)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 27.11% (4.9293 => 6.2657, std.dev.: 0.4677)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.68% (1.6465 => 2.0693, std.dev.: 0.1497)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 23.86% (7.2661 => 8.9999, std.dev.: 0.2639)
  SingleSource/Benchmarks/Stanford/Towers: 21.41% (0.0495 => 0.0601, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.26% (1.3036 => 1.5416, std.dev.: 0.0200)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.65% (4.6423 => 5.4616, std.dev.: 0.3034)
  MultiSource/Applications/sqlite3/sqlite3: 17.14% (16.2888 => 19.0805, std.dev.: 0.4199)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 16.96% (1.9476 => 2.2779, std.dev.: 0.1059)
  SingleSource/Benchmarks/SmallPT/smallpt: 16.56% (0.1395 => 0.1626, std.dev.: 0.0076)
  SingleSource/Benchmarks/Misc/flops: 15.96% (0.1034 => 0.1199, std.dev.: 0.0044)
  MultiSource/Benchmarks/nbench/nbench: 14.88% (1.2484 => 1.4342, std.dev.: 0.0443)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.11% (5.5014 => 6.2775, std.dev.: 0.1965)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.08% (1.2652 => 1.4433, std.dev.: 0.0569)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.35% (6.0284 => 6.5919, std.dev.: 0.2162)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.28% (1.4304 => 1.5632, std.dev.: 0.0495)
  SingleSource/Benchmarks/Shootout-C++/strcat: 8.96% (0.2021 => 0.2202, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 8.19% (0.1905 => 0.2061, std.dev.: 0.0029)
  MultiSource/Applications/oggenc/oggenc: 8.14% (5.3339 => 5.7680, std.dev.: 0.0853)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.66% (1.3068 => 1.4069, std.dev.: 0.0151)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.33% (1.8775 => 2.0152, std.dev.: 0.0409)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.01% (1.5333 => 1.5948, std.dev.: 0.0100)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.87% (0.8233 => 0.8552, std.dev.: 0.0028)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.85% (2.5666 => 2.6653, std.dev.: 0.0335)
  MultiSource/Applications/ClamAV/clamscan: 3.70% (16.5398 => 17.1510, std.dev.: 0.2108)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.96% (1.3235 => 1.3627, std.dev.: 0.0093)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.28% (7.6426 => 12.4792, std.dev.: 0.0270)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 62.75% (0.0247 => 0.0402, std.dev.: 0.0030)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 50.52% (0.0289 => 0.0435, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 39.42% (0.0345 => 0.0481, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 23.33% (60.7119 => 74.8776, std.dev.: 1.2715)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.08% (0.1210 => 0.1453, std.dev.: 0.0044)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.77% (2.4753 => 2.8657, std.dev.: 0.1359)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.93% (40.5588 => 46.6147, std.dev.: 2.0866)
  SingleSource/Benchmarks/McGill/chomp: 12.06% (1.0161 => 1.1386, std.dev.: 0.0164)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 12.04% (21.5217 => 24.1131, std.dev.: 0.8367)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 11.13% (0.2632 => 0.2925, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.98% (4.5744 => 4.8935, std.dev.: 0.0505)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (8.1346 => 8.6835, std.dev.: 0.0470)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0050)
  MultiSource/Applications/siod/siod: 6.38% (3.5310 => 3.7564, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.59% (4.1011 => 4.3305, std.dev.: 0.0674)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (0.3501 => 0.3694, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 5.39% (3.6401 => 3.8363, std.dev.: 0.0692)
  SingleSource/Benchmarks/Misc/salsa20: 4.98% (7.7964 => 8.1843, std.dev.: 0.0547)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.79% (6.5990 => 6.9153, std.dev.: 0.0446)
  MultiSource/Applications/hexxagon/hexxagon: 4.56% (14.7810 => 15.4556, std.dev.: 0.1265)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.28% (4.0596 => 4.2334, std.dev.: 0.0088)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 4.09% (1.1013 => 1.1463, std.dev.: 0.0159)
  MultiSource/Applications/spiff/spiff: 4.07% (2.8194 => 2.9342, std.dev.: 0.0177)
  MultiSource/Applications/lua/lua: 3.99% (29.5202 => 30.6994, std.dev.: 0.0830)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.62% (4.0181 => 4.1235, std.dev.: 0.0308)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.08% (4.9022 => 5.0040, std.dev.: 0.0203)
  SingleSource/Benchmarks/Misc/flops: 1.78% (9.4433 => 9.6118, std.dev.: 0.0222)
  SingleSource/Benchmarks/Misc/ReedSolomon: 1.49% (8.5256 => 8.6529, std.dev.: 0.0109)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.45% (16.7972 => 17.0406, std.dev.: 0.0238)
  SingleSource/Benchmarks/Shootout/methcall: 1.17% (8.5434 => 8.6433, std.dev.: 0.0209)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.13% (3.8582 => 3.9017, std.dev.: 0.0158)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.62% (0.2571 => 0.2375, std.dev.: 0.0005)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -48.78% (0.5226 => 0.2677, std.dev.: 0.0265)
  MultiSource/Applications/sgefa/sgefa: -42.41% (1.5790 => 0.9094, std.dev.: 0.0017)
  SingleSource/Benchmarks/Linpack/linpack-pc: -22.13% (57.2347 => 44.5660, std.dev.: 3.1342)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.99% (15.9508 => 13.2405, std.dev.: 0.2954)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.08% (0.3304 => 0.2905, std.dev.: 0.0065)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.40% (20.8247 => 18.4504, std.dev.: 0.1510)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.36% (3.4956 => 3.1335, std.dev.: 0.0397)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.46% (50.0284 => 46.2948, std.dev.: 0.2494)
  MultiSource/Applications/JM/lencod/lencod: -6.93% (8.1785 => 7.6119, std.dev.: 0.1973)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.55% (3.7437 => 3.5361, std.dev.: 0.0699)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.15% (1.0695 => 1.0144, std.dev.: 0.0158)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.01% (4.3592 => 4.1844, std.dev.: 0.0625)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.90% (0.6563 => 0.6307, std.dev.: 0.0085)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.53% (2.5938 => 2.5023, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.36% (17.1431 => 16.5677, std.dev.: 0.0572)
  SingleSource/Benchmarks/Shootout/lists: -2.73% (7.3703 => 7.1693, std.dev.: 0.0342)
  SingleSource/Benchmarks/Misc/fp-convert: -2.29% (7.5877 => 7.4138, std.dev.: 0.0631)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.30% (0.1348 => 0.1352, std.dev.: 0.0065)

Report Time: 1.12s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131008/281d46b5/attachment.html>


More information about the llvm-testresults mailing list