[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Mar 5 09:36:31 PST 2013


http://llvm.org/perf/db_default/v4/nts/9128?compare_to=9126&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9128, Order: 176488, Start Time: 2013-03-05 15:52:31, End Time: 2013-03-05 17:36:58
      To: 9126, Order: 176480, Start Time: 2013-03-05 13:48:48, End Time: 2013-03-05 15:33:42
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

Performance Regressions: 8 (17 on baseline)
Performance Improvements: 3 (9 on baseline)
Existing Failures: 32 (32 on baseline)
Unchanged Tests: 1061 (1046 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.67% (1.4899 => 1.8724, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc/mandel: 10.49% (1.0479 => 1.1578, std.dev.: 0.0202)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.16% (0.3309 => 0.3546, std.dev.: 0.0035)
  SingleSource/Regression/C/uint64_to_float: 5.10% (1.6761 => 1.7616, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout-C++/methcall: 3.49% (8.6919 => 8.9949, std.dev.: 0.0872)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.02% (0.5356 => 0.5518, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.87% (5.7853 => 5.8933, std.dev.: 0.0094)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.36% (2.5652 => 2.6000, std.dev.: 0.0119)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.88% (6.4446 => 6.0658, std.dev.: 0.0904)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.62% (2.3802 => 2.2464, std.dev.: 0.0397)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.26% (5.9266 => 5.8520, std.dev.: 0.0192)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -3.07% (1.1519 => 1.1165, std.dev.: 0.1049)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0058)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: -1.84% (0.1471 => 0.1444, std.dev.: 0.0017)
  MultiSource/Applications/lemon/lemon: 5.38% (1.1403 => 1.2017, std.dev.: 0.1551)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.61% (0.4321 => 0.4477, std.dev.: 0.0247)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.71% (0.1365 => 0.1287, std.dev.: 0.0089)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.64% (0.0638 => 0.0602, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.14% (0.0274 => 0.0238, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.62% (0.0641 => 0.0677, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1646 => 1.1658, std.dev.: 0.0525)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 42.86% (0.0014 => 0.0020, std.dev.: 0.0003)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.80% (0.0563 => 0.0590, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.13% (0.0354 => 0.0350, std.dev.: 0.0004)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.23% (1.6616 => 1.6987, std.dev.: 0.0110)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 117.39% (0.0046 => 0.0100, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (29.1329 => 29.2019, std.dev.: 4.4268)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0051 => 0.0051, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0007 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.82% (26.8020 => 26.3149, std.dev.: 0.3338)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/JM/lencod/lencod: 5.42% (16.7203 => 17.6260, std.dev.: 0.2391)
  MultiSource/Applications/hbd/hbd: 3.87% (1.5307 => 1.5900, std.dev.: 0.0204)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.83% (0.7182 => 0.7457, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.8668 => 1.9104, std.dev.: 0.0059)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.10% (4.8791 => 4.9817, std.dev.: 0.0296)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.92% (1.2600 => 1.2842, std.dev.: 0.0064)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.81% (1.3183 => 1.3421, std.dev.: 0.0052)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 32.80% (0.0314 => 0.0417, std.dev.: 0.0029)
  SingleSource/Benchmarks/McGill/chomp: 8.57% (1.0339 => 1.1225, std.dev.: 0.0151)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.48% (0.5182 => 0.5518, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.41% (2.9511 => 3.1402, std.dev.: 0.0522)
  SingleSource/Benchmarks/Misc/mandel: 6.40% (1.0882 => 1.1578, std.dev.: 0.0202)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.73% (6.2349 => 6.5296, std.dev.: 0.0512)
  SingleSource/Regression/C/uint64_to_float: 4.56% (1.6847 => 1.7616, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.37% (8.6184 => 8.9949, std.dev.: 0.0872)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (57.5400 => 59.7079, std.dev.: 0.7369)
  SingleSource/Benchmarks/Shootout/methcall: 1.48% (8.4644 => 8.5899, std.dev.: 0.0279)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -45.80% (0.0810 => 0.0439, std.dev.: 0.0004)
  MultiSource/Benchmarks/FreeBench/neural/neural: -20.46% (0.2542 => 0.2022, std.dev.: 0.0031)
  SingleSource/Benchmarks/McGill/chomp: -7.15% (0.1957 => 0.1817, std.dev.: 0.0005)
  SingleSource/Benchmarks/Linpack/linpack-pc: -6.40% (0.2751 => 0.2575, std.dev.: 0.0032)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: -12.54% (4.7243 => 4.1318, std.dev.: 0.1097)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.14% (6.4626 => 6.0658, std.dev.: 0.0904)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.39% (3.8286 => 3.6605, std.dev.: 0.0029)
  SingleSource/Benchmarks/Dhrystone/dry: -3.41% (0.5278 => 0.5098, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.22% (4.1146 => 4.0233, std.dev.: 0.0287)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -1.09% (1.1288 => 1.1165, std.dev.: 0.1049)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0058)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: -2.23% (0.1477 => 0.1444, std.dev.: 0.0017)
  MultiSource/Applications/lemon/lemon: 1.89% (1.1794 => 1.2017, std.dev.: 0.1551)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.53% (0.4125 => 0.4477, std.dev.: 0.0247)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.68% (0.1309 => 0.1287, std.dev.: 0.0089)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.0613 => 0.0602, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.77% (0.0276 => 0.0238, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.11% (0.0663 => 0.0677, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1660 => 1.1658, std.dev.: 0.0525)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.93% (0.0027 => 0.0020, std.dev.: 0.0003)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.67% (0.0594 => 0.0590, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.05% (0.0361 => 0.0350, std.dev.: 0.0004)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.10% (1.6803 => 1.6987, std.dev.: 0.0110)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 8.70% (0.0092 => 0.0100, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.99% (29.7937 => 29.2019, std.dev.: 4.4268)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 75.86% (0.0029 => 0.0051, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/casts: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0006 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.25% (26.9213 => 26.3149, std.dev.: 0.3338)

Report Time: 1.26s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130305/7e1b27ad/attachment.html>


More information about the llvm-testresults mailing list