[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Mar 12 07:55:21 PDT 2013


http://llvm.org/perf/db_default/v4/nts/9335?compare_to=9332&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9335, Order: 176862, Start Time: 2013-03-12 13:10:49, End Time: 2013-03-12 14:55:57
      To: 9332, Order: 176858, Start Time: 2013-03-12 11:05:35, End Time: 2013-03-12 12:49:46
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 8 (15 on baseline)
Performance Improvements: 1 (5 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1064 (1052 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.65% (1.5471 => 1.5727, std.dev.: 0.0083)
  MultiSource/Applications/treecc/treecc: 1.35% (2.2216 => 2.2516, std.dev.: 0.0098)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.74% (4.1312 => 4.8229, std.dev.: 0.0722)
  SingleSource/Benchmarks/Misc/flops: 9.69% (8.5494 => 9.3779, std.dev.: 0.0234)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.10% (3.3192 => 3.4552, std.dev.: 0.0297)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.99% (8.7871 => 9.0497, std.dev.: 0.0050)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.50% (1.8262 => 1.8719, std.dev.: 0.0151)
  MultiSource/Applications/viterbi/viterbi: 2.32% (3.4505 => 3.5305, std.dev.: 0.0180)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.68% (3.4544 => 3.3619, std.dev.: 0.0050)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -0.70% (1.1343 => 1.1264, std.dev.: 0.3345)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0248 => 0.0249, std.dev.: 0.0000)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013)
  MultiSource/Applications/ClamAV/clamscan: -0.34% (0.1490 => 0.1485, std.dev.: 0.0333)
  MultiSource/Applications/lemon/lemon: 2.94% (1.1615 => 1.1957, std.dev.: 0.3061)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.74% (0.1388 => 0.1426, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.21% (0.0660 => 0.0619, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.47% (0.0273 => 0.0277, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.16% (0.0637 => 0.0638, std.dev.: 0.0057)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.50% (1.1654 => 1.1712, std.dev.: 0.0860)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.34% (0.0593 => 0.0591, std.dev.: 0.0043)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.88% (0.0347 => 0.0357, std.dev.: 0.0028)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.82% (1.6671 => 1.6808, std.dev.: 0.0114)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 0.77% (0.0130 => 0.0131, std.dev.: 0.0036)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (29.5092 => 29.2806, std.dev.: 2.3382)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -66.67% (0.0003 => 0.0001, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -28.26% (0.0046 => 0.0033, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.37% (26.7632 => 26.3959, std.dev.: 0.2008)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.66% (0.4125 => 0.4276, std.dev.: 0.0270)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: 8.90% (0.1292 => 0.1407, std.dev.: 0.0032)
  MultiSource/Applications/d/make_dparser: 5.61% (3.5353 => 3.7338, std.dev.: 0.0193)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.25% (0.7182 => 0.7559, std.dev.: 0.0123)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.5284 => 1.5727, std.dev.: 0.0083)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.46% (10.6134 => 10.8743, std.dev.: 0.0947)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.41% (23.8286 => 24.4039, std.dev.: 0.2209)
  MultiSource/Applications/treecc/treecc: 1.35% (2.2217 => 2.2516, std.dev.: 0.0098)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 7.50% (2.0512 => 2.2050, std.dev.: 0.0065)
  SingleSource/Benchmarks/McGill/chomp: 7.36% (1.0339 => 1.1100, std.dev.: 0.0109)
  SingleSource/Regression/C/uint64_to_float: 5.15% (1.6847 => 1.7714, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (8.6184 => 9.0497, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.75% (6.2349 => 6.5310, std.dev.: 0.0244)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.62% (57.5400 => 59.6242, std.dev.: 0.1336)
  MultiSource/Applications/viterbi/viterbi: 2.32% (3.4506 => 3.5305, std.dev.: 0.0180)
  SingleSource/Benchmarks/McGill/queens: 1.50% (1.7928 => 1.8197, std.dev.: 0.0009)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -45.19% (0.0810 => 0.0444, std.dev.: 0.0140)
  SingleSource/Benchmarks/McGill/chomp: -11.45% (0.1957 => 0.1733, std.dev.: 0.0069)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.59% (0.3990 => 0.3687, std.dev.: 0.0092)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.45% (3.8286 => 3.6582, std.dev.: 0.0338)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.60% (1.1828 => 1.1639, std.dev.: 0.0059)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -0.21% (1.1288 => 1.1264, std.dev.: 0.3345)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0248 => 0.0249, std.dev.: 0.0000)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013)
  MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1477 => 0.1485, std.dev.: 0.0333)
  MultiSource/Applications/lemon/lemon: 1.38% (1.1794 => 1.1957, std.dev.: 0.3061)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.94% (0.1309 => 0.1426, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.98% (0.0613 => 0.0619, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.77% (0.0663 => 0.0638, std.dev.: 0.0057)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.45% (1.1660 => 1.1712, std.dev.: 0.0860)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.51% (0.0594 => 0.0591, std.dev.: 0.0043)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.11% (0.0361 => 0.0357, std.dev.: 0.0028)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (1.6803 => 1.6808, std.dev.: 0.0114)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 42.39% (0.0092 => 0.0131, std.dev.: 0.0036)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.72% (29.7937 => 29.2806, std.dev.: 2.3382)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.79% (0.0029 => 0.0033, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.95% (26.9213 => 26.3959, std.dev.: 0.2008)

Report Time: 0.57s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130312/df3cf4ee/attachment.html>


More information about the llvm-testresults mailing list