[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Sep 18 05:08:45 PDT 2012


http://llvm.org/perf/db_default/v4/nts/3958?compare_to=3956&baseline=3242
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5

Comparing:
     Run: 3958, Order: 164117, Start Time: 2012-09-18 11:00:04, End Time: 2012-09-18 12:10:11
      To: 3956, Order: 164114, Start Time: 2012-09-18 09:32:48, End Time: 2012-09-18 10:44:15
Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03

===============
Tests Summary
===============

New Passes: 0 (10 on baseline)
Performance Regressions: 10 (66 on baseline)
Performance Improvements: 1 (39 on baseline)
Existing Failures: 69 (69 on baseline)
Unchanged Tests: 890 (786 on baseline)
Total Tests: 970

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.55% (0.7712 => 0.8140, std.dev.: 0.0028)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.1936 => 0.2043, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.42% (0.4502 => 0.4701, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5712 => 0.5869, std.dev.: 0.0018)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.68% (3.8891 => 3.9545, std.dev.: 0.0106)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.66% (1.4039 => 1.4272, std.dev.: 0.0022)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (6.2801 => 6.3589, std.dev.: 0.0270)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.19% (1.1967 => 1.2109, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (8.2260 => 8.3112, std.dev.: 0.0230)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: 4.80% (21.3180 => 22.3418, std.dev.: 0.1852)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: -6.26% (3.2999 => 3.0932, std.dev.: 0.0791)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/obsequi/Obsequi: 1.93% (0.9783 => 0.9972, std.dev.: 0.0061)
  MultiSource/Applications/sqlite3/sqlite3: -0.36% (0.6039 => 0.6017, std.dev.: 0.0049)
  MultiSource/Benchmarks/McCat/08-main/main: 1.45% (0.1650 => 0.1674, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1554 => 0.1564, std.dev.: 0.0010)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.56% (0.3063 => 0.3046, std.dev.: 0.0020)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -0.04% (0.2362 => 0.2361, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.35% (0.3163 => 0.3174, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (0.2260 => 0.2235, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/mandel: 1.79% (0.0447 => 0.0455, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-05-07-VarArgs: 87.23% (0.0047 => 0.0088, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-08-11-VaListArg: 3.45% (0.0029 => 0.0030, std.dev.: 0.0028)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.91% (0.0230 => 0.0239, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.96% (0.0115 => 0.0192, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0385 => 0.0384, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.52% (0.0222 => 0.0272, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0282 => 0.0281, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0321 => 0.0322, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: 14.19% (0.0155 => 0.0177, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0191 => 0.0191, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/multiplies: 0.41% (0.0245 => 0.0246, std.dev.: 0.0003)
  SingleSource/UnitTests/byval-alignment: 1.87% (0.0321 => 0.0327, std.dev.: 0.0001)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/viterbi/viterbi
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/Regression/C/uint64_to_float
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-07-09-SignedArgs
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1440 => 0.1431, std.dev.: 0.0014)
  MultiSource/Applications/lemon/lemon: -0.24% (1.4801 => 1.4765, std.dev.: 0.0136)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
  MultiSource/Applications/oggenc/oggenc: 4.10% (0.1487 => 0.1548, std.dev.: 0.0025)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001)
  MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005)
  MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.02% (0.4003 => 0.4244, std.dev.: 0.0090)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.65% (0.1485 => 0.1416, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.94% (0.0609 => 0.0633, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.19% (0.0221 => 0.0183, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.16% (0.0634 => 0.0635, std.dev.: 0.0071)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.1491 => 1.1497, std.dev.: 0.0449)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -93.75% (0.0016 => 0.0001, std.dev.: 0.0011)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 14.29% (0.0021 => 0.0024)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.18% (0.0550 => 0.0595, std.dev.: 0.0015)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.90% (0.0210 => 0.0256, std.dev.: 0.0003)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.7807 => 0.7802, std.dev.: 0.0013)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005)
  SingleSource/Regression/C/uint64_to_float: 0.09% (1.6056 => 1.6071, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2006-01-23-UnionInit: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -36.36% (0.0121 => 0.0077, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001)
  SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  SingleSource/Benchmarks/Misc/mandel-2
  SingleSource/Benchmarks/Shootout-C++/except
  SingleSource/Regression/C++/EH/ctor_dtor_count
  SingleSource/Regression/C++/EH/ctor_dtor_count-2
  SingleSource/Regression/C++/EH/exception_spec_test
  SingleSource/Regression/C++/EH/function_try_block
  SingleSource/Regression/C++/EH/inlined_cleanup
  SingleSource/Regression/C++/EH/simple_rethrow
  SingleSource/Regression/C++/EH/simple_throw
  SingleSource/Regression/C++/EH/throw_rethrow_test
  SingleSource/Benchmarks/Misc/mandel-2: -27.32% (4.1772 => 3.0359, std.dev.: 0.0315)
  SingleSource/Benchmarks/Shootout-C++/except: 82183.33% (0.0006 => 0.4937, std.dev.: 0.0047)
  SingleSource/Regression/C++/EH/ctor_dtor_count: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006)
  SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/simple_rethrow: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001)
  SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.15% (0.0745 => 0.0910, std.dev.: 0.0004)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 8.27% (0.1414 => 0.1531, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.82% (0.6410 => 0.6847, std.dev.: 0.0036)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.09% (2.1763 => 2.3089, std.dev.: 0.0143)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.90% (0.5309 => 0.5622, std.dev.: 0.0057)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.41% (0.7722 => 0.8140, std.dev.: 0.0028)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.16% (0.3582 => 0.3767, std.dev.: 0.0040)
  MultiSource/Applications/lemon/lemon: 4.78% (1.0046 => 1.0526, std.dev.: 0.0012)
  MultiSource/Applications/minisat/minisat: 4.44% (0.6173 => 0.6447, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.2552 => 0.2656, std.dev.: 0.0018)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.97% (1.1653 => 1.2116, std.dev.: 0.0104)
  MultiSource/Applications/kimwitu++/kc: 3.54% (15.3105 => 15.8531, std.dev.: 0.1038)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (1.5150 => 1.5681, std.dev.: 0.0027)
  MultiSource/Applications/hbd/hbd: 2.74% (1.3268 => 1.3631, std.dev.: 0.0067)
  MultiSource/Benchmarks/Bullet/bullet: 2.61% (29.3170 => 30.0808, std.dev.: 0.0387)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (1.1827 => 1.2109, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.38% (0.7639 => 0.7821, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.28% (0.4596 => 0.4701, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5740 => 0.5869, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.15% (0.7226 => 0.7381, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.14% (0.5937 => 0.6064, std.dev.: 0.0009)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.00% (0.5636 => 0.5749, std.dev.: 0.0008)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.93% (3.8796 => 3.9545, std.dev.: 0.0106)
  MultiSource/Applications/Burg/burg: 1.90% (1.1440 => 1.1657, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6069 => 0.6182, std.dev.: 0.0030)
  MultiSource/Applications/d/make_dparser: 1.68% (3.0225 => 3.0733, std.dev.: 0.0030)
  MultiSource/Applications/siod/siod: 1.67% (2.0972 => 2.1322, std.dev.: 0.0059)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (6.2546 => 6.3589, std.dev.: 0.0270)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (1.0689 => 1.0856, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (4.0318 => 4.0836, std.dev.: 0.0072)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (8.2186 => 8.3228, std.dev.: 0.0349)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.09% (4.2616 => 4.3080, std.dev.: 0.0069)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Bubblesort: 47.15% (0.0263 => 0.0387, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0007)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.75% (0.0766 => 0.0902, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std.dev.: 0.0235)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.70% (4.0101 => 4.5595, std.dev.: 0.0717)
  MultiSource/Applications/sgefa/sgefa: 13.16% (0.3746 => 0.4239, std.dev.: 0.0024)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std.dev.: 0.0020)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.22% (1.0063 => 1.1091, std.dev.: 0.0337)
  SingleSource/Benchmarks/McGill/chomp: 9.62% (1.0194 => 1.1175, std.dev.: 0.0138)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.07% (0.1433 => 0.1563, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6123, std.dev.: 0.0962)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.98% (0.2857 => 0.3085, std.dev.: 0.0069)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (27.1724 => 28.8085, std.dev.: 0.0160)
  MultiSource/Benchmarks/nbench/nbench: 5.52% (21.1721 => 22.3418, std.dev.: 0.1852)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.46% (40.4792 => 42.6884, std.dev.: 0.2454)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (0.3301 => 0.3471, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.89% (4.2129 => 4.4189, std.dev.: 0.0311)
  SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/fp-convert: 4.14% (15.2242 => 15.8552, std.dev.: 0.0573)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (6.6312 => 6.8720, std.dev.: 0.0003)
  MultiSource/Benchmarks/Olden/power/power: 3.26% (1.4184 => 1.4647, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.20% (0.5587 => 0.5766, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/ReedSolomon: 2.87% (8.5113 => 8.7555, std.dev.: 0.0388)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.61% (5.1938 => 5.3294, std.dev.: 0.0441)
  SingleSource/Benchmarks/Shootout-C++/hash: 2.19% (0.6308 => 0.6446, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.13% (0.5876 => 0.6001, std.dev.: 0.0024)
  MultiSource/Applications/hexxagon/hexxagon: 1.73% (14.4877 => 14.7387, std.dev.: 0.0430)
  MultiSource/Applications/siod/siod: 1.59% (3.5520 => 3.6084, std.dev.: 0.0115)
  SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (2.4971 => 2.5308, std.dev.: 0.0022)
  MultiSource/Benchmarks/Bullet/bullet: 1.32% (6.9722 => 7.0643, std.dev.: 0.0245)
  SingleSource/Benchmarks/Dhrystone/dry: 1.05% (2.4013 => 2.4266, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.5166 => 2.5424, std.dev.: 0.0081)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/spiff/spiff: -2.46% (0.7738 => 0.7548, std.dev.: 0.0022)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.06% (0.3497 => 0.2096, std.dev.: 0.0016)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -22.43% (5.2665 => 4.0852, std.dev.: 0.0845)
  SingleSource/Benchmarks/Shootout-C++/ary3: -20.61% (1.7473 => 1.3872, std.dev.: 0.0098)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.34% (1.1647 => 0.9394, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0005)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.45% (62.4126 => 56.5135, std.dev.: 0.0783)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.13% (3.2007 => 2.9404, std.dev.: 0.0095)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -7.99% (2.4457 => 2.2504, std.dev.: 0.0235)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.25% (3.6254 => 3.3624, std.dev.: 0.0094)
  SingleSource/Benchmarks/Misc/richards_benchmark: -6.39% (1.4441 => 1.3518, std.dev.: 0.0028)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.32% (3.4230 => 3.2068, std.dev.: 0.0090)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7933, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/fibo: -4.92% (4.6355 => 4.4073, std.dev.: 0.0011)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/ffbench: -4.36% (1.4117 => 1.3502, std.dev.: 0.0191)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -3.89% (1.2959 => 1.2455, std.dev.: 0.0143)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.65% (1.7361 => 1.6727, std.dev.: 0.0083)
  SingleSource/Benchmarks/Shootout-C++/methcall: -3.24% (9.2503 => 8.9508, std.dev.: 0.0273)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4499, std.dev.: 0.0410)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8291, std.dev.: 0.0001)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.81% (1.1683 => 1.1355, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.80% (3.7496 => 3.6445, std.dev.: 0.0189)
  SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2856, std.dev.: 0.0046)
  SingleSource/Benchmarks/McGill/misr: -2.72% (0.4296 => 0.4179, std.dev.: 0.0004)
  MultiSource/Applications/aha/aha: -2.27% (3.4286 => 3.3507, std.dev.: 0.0176)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.08% (1.0686 => 1.0464, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.00% (61.1734 => 59.9476, std.dev.: 0.2321)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.91% (3.4876 => 3.4211, std.dev.: 0.0025)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.72% (92.7467 => 91.1508, std.dev.: 0.1870)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2286, std.dev.: 0.0575)
  MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0926 => 1.0764, std.dev.: 0.0006)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.3569 => 2.3223, std.dev.: 0.0112)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.40% (16.5617 => 16.3298, std.dev.: 0.0260)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3112, std.dev.: 0.0093)
  SingleSource/Benchmarks/Misc/oourafft: -1.31% (3.8200 => 3.7698, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.30% (1.8739 => 1.8495, std.dev.: 0.0027)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/obsequi/Obsequi: -0.08% (0.9980 => 0.9972, std.dev.: 0.0061)
  MultiSource/Applications/sqlite3/sqlite3: -0.08% (0.6022 => 0.6017, std.dev.: 0.0049)
  MultiSource/Benchmarks/McCat/08-main/main: 0.48% (0.1666 => 0.1674, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1554 => 0.1564, std.dev.: 0.0010)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.20% (0.3083 => 0.3046, std.dev.: 0.0020)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -1.38% (0.2394 => 0.2361, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3175 => 0.3174, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -2.91% (0.2302 => 0.2235, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/mandel: 1.34% (0.0449 => 0.0455, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0028)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.54% (0.0390 => 0.0384, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.63% (0.0301 => 0.0272, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0324 => 0.0322, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0249 => 0.0246, std.dev.: 0.0003)
  SingleSource/UnitTests/byval-alignment: 0.62% (0.0325 => 0.0327, std.dev.: 0.0001)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/viterbi/viterbi
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/Regression/C/uint64_to_float
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-07-09-SignedArgs
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1429 => 0.1431, std.dev.: 0.0014)
  MultiSource/Applications/lemon/lemon: -1.69% (1.5019 => 1.4765, std.dev.: 0.0136)
  MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001)
  MultiSource/Applications/oggenc/oggenc: 3.13% (0.1501 => 0.1548, std.dev.: 0.0025)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001)
  MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005)
  MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.47% (0.4264 => 0.4244, std.dev.: 0.0090)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.36% (0.1344 => 0.1416, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.47% (0.0589 => 0.0633, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.12% (0.0232 => 0.0183, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.63% (0.0639 => 0.0635, std.dev.: 0.0071)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.1350 => 1.1497, std.dev.: 0.0449)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0011)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.0637 => 0.0595, std.dev.: 0.0015)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (0.0246 => 0.0256, std.dev.: 0.0003)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.46% (0.7541 => 0.7802, std.dev.: 0.0013)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005)
  SingleSource/Regression/C/uint64_to_float: 4.61% (1.5363 => 1.6071, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2006-01-23-UnionInit: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 10.00% (0.0070 => 0.0077, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001)
  SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001)

Report Time: 1.14s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120918/7d608637/attachment.html>


More information about the llvm-testresults mailing list