[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Wed Mar 6 15:24:10 PST 2013

http://llvm.org/perf/db_default/v4/nts/9163?compare_to=9160&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9163, Order: 176577, Start Time: 2013-03-06 21:41:09, End Time: 2013-03-06 23:24:40
      To: 9160, Order: 176572, Start Time: 2013-03-06 19:40:00, End Time: 2013-03-06 21:21:56
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 11 (36 on baseline)
Performance Improvements: 3 (14 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1059 (1022 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/18-imp/imp: 3.04% (0.3722 => 0.3835, std.dev.: 0.0023)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.67% (0.5386 => 0.5530, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.6727 => 0.6861, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.47% (0.8361 => 0.8484, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.22% (4.1203 => 4.8298, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc/flops-7: 13.53% (1.7300 => 1.9640, std.dev.: 0.0738)
  SingleSource/Benchmarks/Misc/flops: 9.73% (8.5508 => 9.3832, std.dev.: 0.0061)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.10% (0.3314 => 0.3483, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/methcall: 3.69% (8.6616 => 8.9808, std.dev.: 0.0352)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.40% (3.3441 => 3.3910, std.dev.: 0.0173)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.28% (3.3221 => 3.3645, std.dev.: 0.0040)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (7.5629 => 7.4810, std.dev.: 0.0082)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.02% (15.2580 => 15.1020, std.dev.: 0.0213)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.93% (0.4443 => 0.4224, std.dev.: 0.0061)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.66% (1.1116 => 1.1301, std.dev.: 0.0118)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.43% (0.0232 => 0.0233, std.dev.: 0.0007)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: 0.41% (0.1454 => 0.1460, std.dev.: 0.0003)
  MultiSource/Applications/lemon/lemon: 3.07% (1.1433 => 1.1784, std.dev.: 0.0138)
  MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.45% (0.1229 => 0.1296, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.47% (0.0661 => 0.0605, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0274 => 0.0274, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.84% (0.0640 => 0.0703, std.dev.: 0.0005)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1653 => 1.1648, std.dev.: 0.0018)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.03% (0.0029 => 0.0020, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0018 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.03% (0.0591 => 0.0579, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.25% (0.0352 => 0.0330, std.dev.: 0.0013)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.56% (1.6671 => 1.6765, std.dev.: 0.0117)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 35.05% (0.0097 => 0.0131, std.dev.: 0.0037)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.30% (29.3008 => 29.2120, std.dev.: 2.6345)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 350.00% (0.0002 => 0.0009, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -90.91% (0.0011 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -98.04% (0.0051 => 0.0001, std.dev.: 0.0034)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.01% (26.5032 => 26.5070, std.dev.: 0.2262)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.40% (0.4125 => 0.4224, std.dev.: 0.0061)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: 8.05% (0.1292 => 0.1396, std.dev.: 0.0020)
  MultiSource/Applications/JM/lencod/lencod: 6.18% (16.7203 => 17.7540, std.dev.: 0.3607)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.37% (7.0997 => 7.4810, std.dev.: 0.0082)
  MultiSource/Applications/JM/ldecod/ldecod: 5.07% (7.2467 => 7.6142, std.dev.: 0.0655)
  MultiSource/Benchmarks/sim/sim: 4.51% (0.3567 => 0.3728, std.dev.: 0.0010)
  MultiSource/Applications/lemon/lemon: 4.21% (1.2932 => 1.3477, std.dev.: 0.0166)
  MultiSource/Benchmarks/McCat/09-vor/vor: 4.08% (0.3358 => 0.3495, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.70% (0.7182 => 0.7448, std.dev.: 0.0023)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.99% (0.8843 => 0.9107, std.dev.: 0.0052)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (4.8288 => 4.9711, std.dev.: 0.0079)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.58% (9.4701 => 9.7148, std.dev.: 0.0204)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.9184 => 0.9395, std.dev.: 0.0079)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (14.7643 => 15.1020, std.dev.: 0.0213)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (10.6134 => 10.8475, std.dev.: 0.0681)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.18% (0.5412 => 0.5530, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.10% (1.8668 => 1.9060, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.07% (4.8791 => 4.9799, std.dev.: 0.0160)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.79% (1.2600 => 1.2825, std.dev.: 0.0072)
  MultiSource/Applications/ClamAV/clamscan: 1.73% (16.1821 => 16.4621, std.dev.: 0.0582)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3183 => 1.3405, std.dev.: 0.0050)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.58% (4.4482 => 4.5185, std.dev.: 0.0222)
  MultiSource/Applications/hbd/hbd: 1.50% (1.5307 => 1.5537, std.dev.: 0.0076)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.43% (1.4308 => 1.4512, std.dev.: 0.0013)
  MultiSource/Applications/oggenc/oggenc: 1.40% (5.4527 => 5.5292, std.dev.: 0.0234)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.33% (4.5532 => 4.6136, std.dev.: 0.0037)
  MultiSource/Applications/kimwitu++/kc: 1.06% (18.4474 => 18.6432, std.dev.: 0.0354)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.02% (5.3794 => 5.4345, std.dev.: 0.0199)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.01% (1.1555 => 1.1672, std.dev.: 0.0007)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.07% (2.9511 => 3.1302, std.dev.: 0.0264)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.79% (0.8330 => 0.8812, std.dev.: 0.0169)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.76% (6.2349 => 6.5315, std.dev.: 0.0503)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.20% (8.6184 => 8.9808, std.dev.: 0.0352)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (57.5400 => 59.6168, std.dev.: 0.1197)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.18% (1.5783 => 1.6127, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout/fib2: 1.07% (4.9040 => 4.9566, std.dev.: 0.0108)
  SingleSource/Benchmarks/McGill/queens: 1.02% (1.7928 => 1.8110, std.dev.: 0.0046)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -47.16% (0.0810 => 0.0428, std.dev.: 0.0020)
  MultiSource/Benchmarks/FreeBench/neural/neural: -18.80% (0.2542 => 0.2064, std.dev.: 0.0005)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.74% (0.3990 => 0.3681, std.dev.: 0.0041)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.53% (0.2341 => 0.2235, std.dev.: 0.0033)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.85% (0.5956 => 0.5846, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.70% (0.8631 => 0.8484, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -9.67% (1.3761 => 1.2430, std.dev.: 0.0065)
  MultiSource/Benchmarks/Olden/bisort/bisort: -8.33% (0.6971 => 0.6390, std.dev.: 0.0017)
  SingleSource/Benchmarks/Dhrystone/dry: -4.32% (0.5278 => 0.5050, std.dev.: 0.0059)
  MultiSource/Applications/SPASS/SPASS: -2.39% (8.4733 => 8.2708, std.dev.: 0.0507)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.64% (3.4205 => 3.3645, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/ffbench: -1.49% (1.4279 => 1.4066, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.36% (7.1548 => 7.0575, std.dev.: 0.0206)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.01% (1.1828 => 1.1708, std.dev.: 0.0037)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.12% (1.1288 => 1.1301, std.dev.: 0.0118)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -6.05% (0.0248 => 0.0233, std.dev.: 0.0007)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: -1.15% (0.1477 => 0.1460, std.dev.: 0.0003)
  MultiSource/Applications/lemon/lemon: -0.08% (1.1794 => 1.1784, std.dev.: 0.0138)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.99% (0.1309 => 0.1296, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.31% (0.0613 => 0.0605, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.03% (0.0663 => 0.0703, std.dev.: 0.0005)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1660 => 1.1648, std.dev.: 0.0018)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.03% (0.0029 => 0.0020, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.53% (0.0594 => 0.0579, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.59% (0.0361 => 0.0330, std.dev.: 0.0013)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.23% (1.6803 => 1.6765, std.dev.: 0.0117)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 42.39% (0.0092 => 0.0131, std.dev.: 0.0037)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.95% (29.7937 => 29.2120, std.dev.: 2.6345)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0009 => 0.0009, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0034)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (26.9213 => 26.5070, std.dev.: 0.2262)

Report Time: 0.53s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130306/50d0c815/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results