[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Wed Mar 6 19:33:42 PST 2013

http://llvm.org/perf/db_default/v4/nts/9169?compare_to=9167&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9169, Order: 176599, Start Time: 2013-03-07 01:46:11, End Time: 2013-03-07 03:34:11
      To: 9167, Order: 176584, Start Time: 2013-03-06 23:43:02, End Time: 2013-03-07 01:25:09
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 23 (31 on baseline)
Performance Improvements: 2 (3 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1048 (1038 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.68% (0.1390 => 0.1594, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.1031 => 1.1832, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.07% (1.1526 => 1.2341, std.dev.: 0.0082)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 6.94% (0.2160 => 0.2310, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.1632 => 1.2396, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.16% (1.1481 => 1.2188, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/sieve: 5.79% (0.2937 => 0.3107, std.dev.: 0.0013)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.59% (0.2757 => 0.2911, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/lists: 5.02% (0.2708 => 0.2844, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 4.88% (0.3382 => 0.3547, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.6025 => 0.6163, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 38.85% (8.4646 => 11.7532, std.dev.: 0.8012)
  SingleSource/Benchmarks/Shootout/heapsort: 32.33% (3.0974 => 4.0988, std.dev.: 0.3612)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 28.12% (3.0870 => 3.9552, std.dev.: 0.2999)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.93% (4.1226 => 4.8204, std.dev.: 0.0070)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.35% (0.3313 => 0.3689, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.97% (22.1638 => 23.2664, std.dev.: 0.2485)
  SingleSource/Regression/C/uint64_to_float: 4.28% (1.6822 => 1.7542, std.dev.: 0.0055)
  MultiSource/Benchmarks/Olden/health/health: 4.25% (0.3292 => 0.3432, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.3107 => 0.3221, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/fp-convert: 3.08% (5.6799 => 5.8550, std.dev.: 0.0579)
  SingleSource/Benchmarks/Shootout/methcall: 2.20% (8.5122 => 8.6995, std.dev.: 0.0158)
  SingleSource/Benchmarks/Shootout/lists: 1.04% (7.2021 => 7.2771, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: -16.76% (1.8720 => 1.5582, std.dev.: 0.0297)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.44% (5.7932 => 5.6516, std.dev.: 0.0033)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.67% (1.1347 => 1.1536, std.dev.: 0.0495)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0001)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1462 => 0.1453, std.dev.: 0.0046)
  MultiSource/Applications/lemon/lemon: 6.87% (1.1416 => 1.2200, std.dev.: 0.0238)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.20% (0.1503 => 0.1506, std.dev.: 0.0184)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.00% (0.0600 => 0.0648, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.06% (0.0254 => 0.0277, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.39% (0.0661 => 0.0632, std.dev.: 0.0036)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.04% (1.1659 => 1.1664, std.dev.: 0.0473)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.60% (0.0522 => 0.0593, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.29% (0.0349 => 0.0341, std.dev.: 0.0009)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.54% (1.6720 => 1.6629, std.dev.: 0.0159)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 4.48% (0.0067 => 0.0070, std.dev.: 0.0030)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -85.71% (0.0007 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.67% (29.3403 => 29.8293, std.dev.: 2.9857)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -90.91% (0.0011 => 0.0001, std.dev.: 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -98.04% (0.0051 => 0.0001, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/Altivec/casts: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.20% (26.7568 => 27.0788, std.dev.: 0.1512)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.12% (0.4125 => 0.4460, std.dev.: 0.0191)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 9.38% (0.2112 => 0.2310, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.73% (1.1209 => 1.2188, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.99% (1.1428 => 1.2341, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.98% (1.0958 => 1.1832, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.96% (1.1699 => 1.2396, std.dev.: 0.0145)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 5.72% (0.3355 => 0.3547, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/lists: 5.69% (0.2691 => 0.2844, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/sieve: 5.32% (0.2950 => 0.3107, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.18% (0.9184 => 0.9660, std.dev.: 0.0132)
  MultiSource/Applications/JM/ldecod/ldecod: 4.91% (7.2467 => 7.6022, std.dev.: 0.0660)
  MultiSource/Applications/lemon/lemon: 4.82% (1.2932 => 1.3555, std.dev.: 0.0107)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.05% (0.4051 => 0.4215, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 3.39% (0.3598 => 0.3720, std.dev.: 0.0037)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 41.78% (8.2895 => 11.7532, std.dev.: 0.8012)
  SingleSource/Benchmarks/Shootout/heapsort: 30.52% (3.1404 => 4.0988, std.dev.: 0.3612)
  SingleSource/Benchmarks/McGill/chomp: 8.51% (1.0339 => 1.1219, std.dev.: 0.0241)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.09% (0.8330 => 0.9004, std.dev.: 0.0208)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.39% (22.0762 => 23.2664, std.dev.: 0.2485)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.12% (6.2349 => 6.5544, std.dev.: 0.0047)
  MultiSource/Benchmarks/Olden/health/health: 4.70% (0.3278 => 0.3432, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.41% (0.3085 => 0.3221, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.24% (0.3539 => 0.3689, std.dev.: 0.0045)
  SingleSource/Regression/C/uint64_to_float: 4.13% (1.6847 => 1.7542, std.dev.: 0.0055)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.76% (57.5400 => 59.7032, std.dev.: 0.0627)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.61% (12.6632 => 13.1201, std.dev.: 0.1169)
  SingleSource/Benchmarks/Misc/fp-convert: 3.08% (5.6800 => 5.8550, std.dev.: 0.0579)
  SingleSource/Benchmarks/Shootout/methcall: 2.78% (8.4644 => 8.6995, std.dev.: 0.0158)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.62% (1.5783 => 1.6196, std.dev.: 0.0076)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.93% (4.4250 => 4.5102, std.dev.: 0.0285)
  SingleSource/Benchmarks/Shootout/fib2: 1.04% (4.9040 => 4.9548, std.dev.: 0.0035)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.7893 => 2.8178, std.dev.: 0.0029)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -41.85% (0.0810 => 0.0471, std.dev.: 0.0007)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -9.86% (2.0100 => 1.8118, std.dev.: 0.0608)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.31% (3.8286 => 3.6635, std.dev.: 0.0071)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 2.20% (1.1288 => 1.1536, std.dev.: 0.0495)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0001)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: -1.62% (0.1477 => 0.1453, std.dev.: 0.0046)
  MultiSource/Applications/lemon/lemon: 3.44% (1.1794 => 1.2200, std.dev.: 0.0238)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.05% (0.1309 => 0.1506, std.dev.: 0.0184)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.0613 => 0.0648, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.68% (0.0663 => 0.0632, std.dev.: 0.0036)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1660 => 1.1664, std.dev.: 0.0473)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.17% (0.0594 => 0.0593, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.54% (0.0361 => 0.0341, std.dev.: 0.0009)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.04% (1.6803 => 1.6629, std.dev.: 0.0159)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -23.91% (0.0092 => 0.0070, std.dev.: 0.0030)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.12% (29.7937 => 29.8293, std.dev.: 2.9857)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.59% (26.9213 => 27.0788, std.dev.: 0.1512)

Report Time: 1.59s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130306/83c3e458/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results