[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Sat Mar 9 07:56:57 PST 2013

http://llvm.org/perf/db_default/v4/nts/9255?compare_to=9252&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9255, Order: 176766, Start Time: 2013-03-09 14:15:26, End Time: 2013-03-09 15:57:29
      To: 9252, Order: 176765, Start Time: 2013-03-09 12:02:38, End Time: 2013-03-09 13:43:36
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 10 (32 on baseline)
Performance Improvements: 6 (16 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1057 (1024 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.85% (0.5157 => 0.5407, std.dev.: 0.0054)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.76% (0.8414 => 0.8562, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.74% (1.0692 => 1.0878, std.dev.: 0.0067)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.59% (1.4880 => 1.8836, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.42% (4.1392 => 4.8189, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.63% (7.1068 => 7.3650, std.dev.: 0.0444)
  SingleSource/Benchmarks/Shootout-C++/methcall: 3.63% (8.6621 => 8.9767, std.dev.: 0.0289)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.21% (1.9407 => 1.9642, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.05% (1.4493 => 1.4645, std.dev.: 0.0018)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.01% (13.0685 => 13.2009, std.dev.: 0.0215)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.43% (0.7546 => 0.7438, std.dev.: 0.0038)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -2.75% (0.4149 => 0.4035, std.dev.: 0.0004)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.24% (2.7768 => 2.7145, std.dev.: 0.0217)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.60% (39.7078 => 39.0734, std.dev.: 0.1790)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.47% (3.6435 => 3.5900, std.dev.: 0.0145)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.14% (5.9211 => 5.8535, std.dev.: 0.0258)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.82% (1.1400 => 1.1493, std.dev.: 0.0031)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0000)
  MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006)
  MultiSource/Applications/ClamAV/clamscan: 1.71% (0.1461 => 0.1486, std.dev.: 0.0007)
  MultiSource/Applications/lemon/lemon: -0.72% (1.1712 => 1.1628, std.dev.: 0.0205)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.18% (0.1309 => 0.1215, std.dev.: 0.0059)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.75% (0.0671 => 0.0666, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.45% (0.0275 => 0.0249, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.08% (0.0718 => 0.0660, std.dev.: 0.0022)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1627 => 1.1589, std.dev.: 0.0546)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.93% (0.0029 => 0.0018, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 107.69% (0.0013 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.58% (0.0570 => 0.0579, std.dev.: 0.0014)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.28% (0.0357 => 0.0358)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (1.6538 => 1.6515, std.dev.: 0.0149)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -34.37% (0.0096 => 0.0063, std.dev.: 0.0030)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.17% (29.1824 => 29.2313, std.dev.: 0.4277)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -98.04% (0.0051 => 0.0001, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/casts: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0007 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.07% (26.4260 => 26.4449, std.dev.: 0.5152)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.37% (0.4125 => 0.4264, std.dev.: 0.0160)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: 8.28% (0.1292 => 0.1399, std.dev.: 0.0039)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.32% (7.0997 => 7.5487, std.dev.: 0.0049)
  MultiSource/Benchmarks/McCat/09-vor/vor: 6.16% (0.3358 => 0.3565, std.dev.: 0.0015)
  MultiSource/Benchmarks/sim/sim: 5.16% (0.3567 => 0.3751, std.dev.: 0.0009)
  MultiSource/Applications/lemon/lemon: 4.96% (1.2932 => 1.3573, std.dev.: 0.0073)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.82% (2.4999 => 2.5955, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.56% (0.7182 => 0.7438, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/05-eks/eks: 3.42% (0.4798 => 0.4962, std.dev.: 0.0009)
  MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3809 => 0.3930, std.dev.: 0.0019)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.16% (23.8286 => 24.5817, std.dev.: 0.1912)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.10% (4.8288 => 4.9785, std.dev.: 0.0299)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (14.7643 => 15.2124, std.dev.: 0.0597)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.82% (4.8791 => 5.0168, std.dev.: 0.0155)
  MultiSource/Applications/minisat/minisat: 2.70% (0.7554 => 0.7758, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.55% (1.8668 => 1.9144, std.dev.: 0.0151)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.28% (10.6134 => 10.8555, std.dev.: 0.0146)
  MultiSource/Benchmarks/Bullet/bullet: 2.02% (33.9296 => 34.6135, std.dev.: 0.2305)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.5532 => 4.6426, std.dev.: 0.0143)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.1555 => 1.1781, std.dev.: 0.0027)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3240 => 1.3452, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.11% (1.2835 => 1.2977, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.09% (1.2537 => 1.2674, std.dev.: 0.0008)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.02% (46.1715 => 46.6429, std.dev.: 0.1229)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 7.79% (2.0512 => 2.2110, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.86% (6.2349 => 6.5381, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.16% (8.6184 => 8.9767, std.dev.: 0.0289)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.56% (57.5400 => 59.5879, std.dev.: 0.0504)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.94% (7.1548 => 7.3650, std.dev.: 0.0444)
  MultiSource/Applications/sqlite3/sqlite3: 1.72% (4.2776 => 4.3513, std.dev.: 0.0159)
  SingleSource/Benchmarks/Shootout/fib2: 1.10% (4.9040 => 4.9578, std.dev.: 0.0033)
  SingleSource/Benchmarks/McGill/queens: 1.04% (1.7928 => 1.8114, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.01% (1.4499 => 1.4645, std.dev.: 0.0018)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -47.53% (0.0810 => 0.0425, std.dev.: 0.0016)
  MultiSource/Benchmarks/FreeBench/neural/neural: -18.37% (0.2542 => 0.2075, std.dev.: 0.0104)
  SingleSource/Benchmarks/McGill/chomp: -7.97% (0.1957 => 0.1801, std.dev.: 0.0028)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -5.39% (0.3990 => 0.3775, std.dev.: 0.0022)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (0.7818 => 0.7595, std.dev.: 0.0057)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.79% (0.5161 => 0.5017, std.dev.: 0.0032)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.00% (0.6155 => 0.6032, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -1.24% (1.5423 => 1.5232, std.dev.: 0.0051)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.05% (2.0100 => 1.7477, std.dev.: 0.0799)
  SingleSource/Benchmarks/Stanford/Puzzle: -9.21% (0.1650 => 0.1498, std.dev.: 0.0041)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -9.19% (1.3761 => 1.2497, std.dev.: 0.0398)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.89% (0.3539 => 0.3295, std.dev.: 0.0006)
  SingleSource/Benchmarks/Dhrystone/dry: -4.72% (0.5278 => 0.5029, std.dev.: 0.0067)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.40% (3.8286 => 3.6603, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (40.0804 => 39.0734, std.dev.: 0.1790)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.41% (1.8732 => 1.8281, std.dev.: 0.0049)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.82% (1.1288 => 1.1493, std.dev.: 0.0031)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0000)
  MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006)
  MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1477 => 0.1486, std.dev.: 0.0007)
  MultiSource/Applications/lemon/lemon: -1.41% (1.1794 => 1.1628, std.dev.: 0.0205)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.18% (0.1309 => 0.1215, std.dev.: 0.0059)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.65% (0.0613 => 0.0666, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.78% (0.0276 => 0.0249, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.45% (0.0663 => 0.0660, std.dev.: 0.0022)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.61% (1.1660 => 1.1589, std.dev.: 0.0546)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.93% (0.0029 => 0.0018, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.53% (0.0594 => 0.0579, std.dev.: 0.0014)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.83% (0.0361 => 0.0358)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.71% (1.6803 => 1.6515, std.dev.: 0.0149)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -31.52% (0.0092 => 0.0063, std.dev.: 0.0030)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.89% (29.7937 => 29.2313, std.dev.: 0.4277)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0006 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.77% (26.9213 => 26.4449, std.dev.: 0.5152)

Report Time: 0.58s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130309/13382b72/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results