[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Sep 17 15:45:03 PDT 2012


http://llvm.org/perf/db_default/v4/nts/3933?compare_to=3931&baseline=3242
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5

Comparing:
     Run: 3933, Order: 164053, Start Time: 2012-09-17 21:35:24, End Time: 2012-09-17 22:46:27
      To: 3931, Order: 164047, Start Time: 2012-09-17 20:08:57, End Time: 2012-09-17 21:19:32
Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03

===============
Tests Summary
===============

New Passes: 0 (10 on baseline)
Performance Regressions: 11 (46 on baseline)
Performance Improvements: 3 (39 on baseline)
Existing Failures: 69 (69 on baseline)
Unchanged Tests: 887 (806 on baseline)
Total Tests: 970

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5536 => 0.5808, std.dev.: 0.0023)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.55% (0.7414 => 0.7677, std.dev.: 0.0098)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.94% (0.4492 => 0.4624, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.8803 => 0.9016, std.dev.: 0.0069)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.51% (1.3805 => 1.4013, std.dev.: 0.0074)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.11% (4.2841 => 4.3316, std.dev.: 0.0146)
  MultiSource/Applications/siod/siod: 1.07% (2.1312 => 2.1539, std.dev.: 0.0052)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/whetstone: 2.49% (2.3403 => 2.3986, std.dev.: 0.0121)
  MultiSource/Benchmarks/llubenchmark/llu: 2.04% (2.0035 => 2.0443, std.dev.: 0.0117)
  SingleSource/Benchmarks/Misc/ffbench: 1.91% (1.3337 => 1.3592, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.6742 => 4.7376, std.dev.: 0.0069)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.57% (16.4050 => 15.3269, std.dev.: 0.2476)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.67% (2.7701 => 2.7238, std.dev.: 0.0123)
  SingleSource/Benchmarks/Shootout/ary3: -1.42% (2.0267 => 1.9980, std.dev.: 0.0039)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/obsequi/Obsequi: -0.76% (0.9902 => 0.9827, std.dev.: 0.0067)
  MultiSource/Applications/sqlite3/sqlite3: 0.30% (0.6009 => 0.6027, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/08-main/main: -0.87% (0.1614 => 0.1600, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.90% (0.1555 => 0.1569, std.dev.: 0.0009)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.05% (0.2987 => 0.3078, std.dev.: 0.0027)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 0.17% (0.2354 => 0.2358, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.79% (0.3145 => 0.3120, std.dev.: 0.0075)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 0.62% (0.2246 => 0.2260, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/mandel: 11.63% (0.0404 => 0.0451, std.dev.: 0.0003)
  SingleSource/UnitTests/2003-05-07-VarArgs: -13.64% (0.0088 => 0.0076, std.dev.: 0.0007)
  SingleSource/UnitTests/2003-08-11-VaListArg: 1.15% (0.0087 => 0.0088, std.dev.: 0.0001)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.07% (0.0238 => 0.0195, std.dev.: 0.0020)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.53% (0.0190 => 0.0191, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0384 => 0.0385, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.67% (0.0297 => 0.0299, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0281 => 0.0281, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.88% (0.0320 => 0.0314, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0178 => 0.0177, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/Altivec/test1: 18.32% (0.0131 => 0.0155, std.dev.: 0.0018)
  SingleSource/UnitTests/Vector/multiplies: -7.82% (0.0243 => 0.0224, std.dev.: 0.0013)
  SingleSource/UnitTests/byval-alignment: -9.69% (0.0320 => 0.0289, std.dev.: 0.0009)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/viterbi/viterbi
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/Regression/C/uint64_to_float
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-07-09-SignedArgs
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011)
  MultiSource/Applications/ClamAV/clamscan: 2.00% (0.1400 => 0.1428, std.dev.: 0.0009)
  MultiSource/Applications/lemon/lemon: -4.67% (1.4899 => 1.4203, std.dev.: 0.0569)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Applications/oggenc/oggenc: 3.43% (0.1488 => 0.1539, std.dev.: 0.0020)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001)
  MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.39% (0.4069 => 0.4085, std.dev.: 0.0161)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.66% (0.1432 => 0.1351, std.dev.: 0.0148)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.46% (0.0613 => 0.0555, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.63% (0.0213 => 0.0201, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.83% (0.0600 => 0.0559, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1495 => 1.1483, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0010 => 0.0010, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0010)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.93% (0.0614 => 0.0596, std.dev.: 0.0015)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.28% (0.0191 => 0.0203, std.dev.: 0.0015)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.7809 => 0.7797, std.dev.: 0.0000)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005)
  SingleSource/Regression/C/uint64_to_float: 0.06% (1.6087 => 1.6096, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-07-10-SignConversions: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -27.27% (0.0121 => 0.0088, std.dev.: 0.0016)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001)
  SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  SingleSource/Benchmarks/Misc/mandel-2
  SingleSource/Benchmarks/Shootout-C++/except
  SingleSource/Regression/C++/EH/ctor_dtor_count
  SingleSource/Regression/C++/EH/ctor_dtor_count-2
  SingleSource/Regression/C++/EH/exception_spec_test
  SingleSource/Regression/C++/EH/function_try_block
  SingleSource/Regression/C++/EH/inlined_cleanup
  SingleSource/Regression/C++/EH/simple_rethrow
  SingleSource/Regression/C++/EH/simple_throw
  SingleSource/Regression/C++/EH/throw_rethrow_test
  SingleSource/Benchmarks/Misc/mandel-2: -27.07% (4.1772 => 3.0463, std.dev.: 0.0410)
  SingleSource/Benchmarks/Shootout-C++/except: 82383.33% (0.0006 => 0.4949, std.dev.: 0.0020)
  SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002)
  SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000)
  SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/throw_rethrow_test: -25.00% (0.0004 => 0.0003, std.dev.: 0.0002)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.34% (0.0745 => 0.0904, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.12% (0.5309 => 0.5634, std.dev.: 0.0027)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.48% (2.1763 => 2.2956, std.dev.: 0.0252)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.87% (0.6410 => 0.6722, std.dev.: 0.0076)
  MultiSource/Applications/minisat/minisat: 4.84% (0.6173 => 0.6472, std.dev.: 0.0022)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.68% (1.1653 => 1.2198, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.47% (0.2552 => 0.2666, std.dev.: 0.0015)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.99% (0.3582 => 0.3725, std.dev.: 0.0021)
  MultiSource/Applications/lemon/lemon: 3.93% (1.0046 => 1.0441, std.dev.: 0.0050)
  MultiSource/Applications/siod/siod: 2.70% (2.0972 => 2.1539, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.7639 => 0.7824, std.dev.: 0.0029)
  MultiSource/Applications/hbd/hbd: 2.37% (1.3268 => 1.3583, std.dev.: 0.0040)
  MultiSource/Applications/d/make_dparser: 1.85% (3.0225 => 3.0785, std.dev.: 0.0207)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.71% (1.1672 => 1.1872, std.dev.: 0.0029)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6069 => 0.6170, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.47% (1.1827 => 1.2001, std.dev.: 0.0046)
  MultiSource/Applications/SPASS/SPASS: 1.44% (13.3238 => 13.5150, std.dev.: 0.0379)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0192)
  SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9980, std.dev.: 0.0039)
  MultiSource/Applications/sgefa/sgefa: 13.99% (0.3746 => 0.4270, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.72% (4.0101 => 4.5603, std.dev.: 0.0054)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.01% (0.0917 => 0.1018, std.dev.: 0.0028)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout/lists: 8.59% (7.0025 => 7.6038, std.dev.: 0.1228)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.23% (0.2857 => 0.3092, std.dev.: 0.0009)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.87% (1.0063 => 1.0855, std.dev.: 0.0166)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (27.1724 => 28.7931, std.dev.: 0.0406)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/fp-convert: 4.49% (15.2242 => 15.9082, std.dev.: 0.0145)
  SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std.dev.: 0.0038)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5367, std.dev.: 0.0026)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8716, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.05% (0.5876 => 0.6055, std.dev.: 0.0014)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.98% (5.1938 => 5.3488, std.dev.: 0.0299)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std.dev.: 0.0052)
  MultiSource/Benchmarks/Olden/power/power: 2.80% (1.4184 => 1.4581, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.71% (4.6127 => 4.7376, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc/ReedSolomon: 2.39% (8.5113 => 8.7149, std.dev.: 0.0697)
  SingleSource/Benchmarks/Misc/whetstone: 2.27% (2.3453 => 2.3986, std.dev.: 0.0121)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.18% (2.6656 => 2.7238, std.dev.: 0.0123)
  MultiSource/Applications/hexxagon/hexxagon: 1.63% (14.4877 => 14.7232, std.dev.: 0.0169)
  MultiSource/Applications/siod/siod: 1.60% (3.5520 => 3.6088, std.dev.: 0.0060)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (2.4455 => 2.4827, std.dev.: 0.0083)
  SingleSource/Benchmarks/Dhrystone/fldry: 1.33% (2.4971 => 2.5303, std.dev.: 0.0058)
  MultiSource/Benchmarks/Olden/bh/bh: 1.13% (2.5166 => 2.5450, std.dev.: 0.0079)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.35% (0.4253 => 0.4153, std.dev.: 0.0021)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.52% (0.3497 => 0.2080, std.dev.: 0.0025)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -22.14% (5.2665 => 4.1003, std.dev.: 0.0612)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.44% (1.1647 => 0.9383, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std.dev.: 0.1363)
  SingleSource/Benchmarks/Shootout-C++/moments: -10.86% (0.1114 => 0.0993, std.dev.: 0.0017)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.42% (62.4126 => 56.5360, std.dev.: 0.0904)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.88% (3.2007 => 2.9485, std.dev.: 0.0434)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -7.30% (2.4457 => 2.2671, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.16% (3.6254 => 3.3658, std.dev.: 0.0037)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.00% (3.4230 => 3.1834, std.dev.: 0.0177)
  SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3515, std.dev.: 0.0054)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4087, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std.dev.: 0.0015)
  SingleSource/Benchmarks/McGill/misr: -4.54% (0.4296 => 0.4101, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.34% (1.7361 => 1.6607, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/ffbench: -3.72% (1.4117 => 1.3592, std.dev.: 0.0035)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.50% (0.4140 => 0.3995, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (9.2503 => 8.9266, std.dev.: 0.0288)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.34% (7.6833 => 7.4266, std.dev.: 0.0424)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.21% (1.1683 => 1.1308, std.dev.: 0.0058)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8284, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std.dev.: 0.0024)
  MultiSource/Applications/aha/aha: -2.74% (3.4286 => 3.3346, std.dev.: 0.0079)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.58% (1.2722 => 1.2394, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.44% (3.7496 => 3.6582, std.dev.: 0.0026)
  MultiSource/Applications/SPASS/SPASS: -2.13% (8.5323 => 8.3503, std.dev.: 0.0581)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.00% (61.1734 => 59.9514, std.dev.: 0.2618)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.94% (2.8964 => 2.8402, std.dev.: 0.0132)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.91% (1.0686 => 1.0482, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4226, std.dev.: 0.0105)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.82% (92.7467 => 91.0577, std.dev.: 0.4804)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2238, std.dev.: 0.0090)
  MultiSource/Benchmarks/sim/sim: -1.71% (3.8907 => 3.8242, std.dev.: 0.0047)
  MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.8739 => 1.8472, std.dev.: 0.0079)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3107, std.dev.: 0.0032)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/obsequi/Obsequi: -1.53% (0.9980 => 0.9827, std.dev.: 0.0067)
  MultiSource/Applications/sqlite3/sqlite3: 0.08% (0.6022 => 0.6027, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/08-main/main: -3.96% (0.1666 => 0.1600, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.97% (0.1554 => 0.1569, std.dev.: 0.0009)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (0.3083 => 0.3078, std.dev.: 0.0027)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -1.50% (0.2394 => 0.2358, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.73% (0.3175 => 0.3120, std.dev.: 0.0075)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.82% (0.2302 => 0.2260, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0003)
  SingleSource/UnitTests/2003-05-07-VarArgs: -14.61% (0.0089 => 0.0076, std.dev.: 0.0007)
  SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.75% (0.0240 => 0.0195, std.dev.: 0.0020)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0390 => 0.0385, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.09% (0.0324 => 0.0314, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/Altivec/test1: -17.99% (0.0189 => 0.0155, std.dev.: 0.0018)
  SingleSource/UnitTests/Vector/multiplies: -10.04% (0.0249 => 0.0224, std.dev.: 0.0013)
  SingleSource/UnitTests/byval-alignment: -11.08% (0.0325 => 0.0289, std.dev.: 0.0009)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/viterbi/viterbi
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/Regression/C/uint64_to_float
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-07-09-SignedArgs
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011)
  MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1429 => 0.1428, std.dev.: 0.0009)
  MultiSource/Applications/lemon/lemon: -5.43% (1.5019 => 1.4203, std.dev.: 0.0569)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Applications/oggenc/oggenc: 2.53% (0.1501 => 0.1539, std.dev.: 0.0020)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001)
  MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.20% (0.4264 => 0.4085, std.dev.: 0.0161)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.52% (0.1344 => 0.1351, std.dev.: 0.0148)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.77% (0.0589 => 0.0555, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0232 => 0.0201, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.52% (0.0639 => 0.0559, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.17% (1.1350 => 1.1483, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 66.67% (0.0006 => 0.0010, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0010)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.44% (0.0637 => 0.0596, std.dev.: 0.0015)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.48% (0.0246 => 0.0203, std.dev.: 0.0015)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.39% (0.7541 => 0.7797, std.dev.: 0.0000)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005)
  SingleSource/Regression/C/uint64_to_float: 4.77% (1.5363 => 1.6096, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-07-10-SignConversions: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 25.71% (0.0070 => 0.0088, std.dev.: 0.0016)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001)
  SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)

Report Time: 1.56s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120917/ed4d2f26/attachment.html>


More information about the llvm-testresults mailing list