[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 21 03:55:39 PDT 2012


http://llvm.org/perf/db_default/v4/nts/4096?compare_to=4093&baseline=3242
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5

Comparing:
     Run: 4096, Order: 164366, Start Time: 2012-09-21 09:47:01, End Time: 2012-09-21 10:57:08
      To: 4093, Order: 164365, Start Time: 2012-09-21 08:19:36, End Time: 2012-09-21 09:31:13
Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (10 on baseline)
Performance Regressions: 14 (56 on baseline)
Performance Improvements: 1 (38 on baseline)
Existing Failures: 70 (69 on baseline)
Unchanged Tests: 885 (796 on baseline)
Total Tests: 970

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.79% (0.7747 => 0.7963, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.94% (0.8920 => 0.9093, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.70% (0.7282 => 0.7406, std.dev.: 0.0030)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (0.7988 => 0.8110, std.dev.: 0.0042)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.48% (4.3151 => 4.3789, std.dev.: 0.0091)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.46% (1.1908 => 1.2082, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.41% (1.4228 => 1.4429, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.17% (4.2519 => 4.3017, std.dev.: 0.0184)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: 8.99% (3.3972 => 3.7026, std.dev.: 0.0742)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.55% (1.3364 => 1.3972, std.dev.: 0.0205)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.67% (0.5911 => 0.6069, std.dev.: 0.0032)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.31% (13.1001 => 13.4024, std.dev.: 0.0887)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.23% (2.8478 => 2.9113, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.58% (1.7079 => 1.7348, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.20% (1.8574 => 1.8352, std.dev.: 0.0073)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/obsequi/Obsequi: -0.65% (0.9933 => 0.9868, std.dev.: 0.0209)
  MultiSource/Applications/sqlite3/sqlite3: 0.23% (0.6049 => 0.6063, std.dev.: 0.0008)
  MultiSource/Benchmarks/McCat/08-main/main: 0.54% (0.1658 => 0.1667, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.32% (0.1555 => 0.1560, std.dev.: 0.0011)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.57% (0.3129 => 0.3080, std.dev.: 0.0018)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -0.21% (0.2377 => 0.2372, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (0.3226 => 0.3174, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.78% (0.2253 => 0.2293, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/mandel: -9.43% (0.0456 => 0.0413, std.dev.: 0.0021)
  SingleSource/UnitTests/2003-05-07-VarArgs: 15.79% (0.0076 => 0.0088, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0091 => 0.0091)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.44% (0.0225 => 0.0244, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.09% (0.0191 => 0.0195, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.04% (0.0384 => 0.0388, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.35% (0.0297 => 0.0301, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.79% (0.0280 => 0.0285, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.82% (0.0321 => 0.0267, std.dev.: 0.0028)
  SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: 1.57% (0.0191 => 0.0194, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/multiplies: - (0.0250 => 0.0250, std.dev.: 0.0003)
  SingleSource/UnitTests/byval-alignment: -7.67% (0.0326 => 0.0301, std.dev.: 0.0012)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/viterbi/viterbi
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Prolangs-C++/city/city
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/Regression/C/uint64_to_float
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-07-09-SignedArgs
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1451 => 0.1455, std.dev.: 0.0006)
  MultiSource/Applications/lemon/lemon: -3.45% (1.5320 => 1.4792, std.dev.: 0.0230)
  MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001)
  MultiSource/Applications/oggenc/oggenc: 2.89% (0.1451 => 0.1493, std.dev.: 0.0001)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001)
  MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.48% (0.4059 => 0.3999, std.dev.: 0.0205)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.29% (0.1361 => 0.1433, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 20.33% (0.0541 => 0.0651, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.39% (0.0271 => 0.0232, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.67% (0.0647 => 0.0565, std.dev.: 0.0039)
  MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0047 => 0.0047, std.dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1296 => 1.1286, std.dev.: 0.0078)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.81% (0.0637 => 0.0600, std.dev.: 0.0020)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.98% (0.0264 => 0.0235, std.dev.: 0.0012)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.7650 => 0.7661, std.dev.: 0.0093)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001)
  SingleSource/Regression/C/uint64_to_float: 0.14% (1.5989 => 1.6012, std.dev.: 0.0096)
  SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/Prolangs-C++/city/city
  MultiSource/Benchmarks/Prolangs-C++/city/city: -81.99% (0.0261 => 0.0047, std.dev.: 0.0000)

New Passes - Execution Time
---------------------------
  SingleSource/Benchmarks/Misc/mandel-2
  SingleSource/Benchmarks/Shootout-C++/except
  SingleSource/Regression/C++/EH/ctor_dtor_count
  SingleSource/Regression/C++/EH/ctor_dtor_count-2
  SingleSource/Regression/C++/EH/exception_spec_test
  SingleSource/Regression/C++/EH/function_try_block
  SingleSource/Regression/C++/EH/inlined_cleanup
  SingleSource/Regression/C++/EH/simple_rethrow
  SingleSource/Regression/C++/EH/simple_throw
  SingleSource/Regression/C++/EH/throw_rethrow_test
  SingleSource/Benchmarks/Misc/mandel-2: -27.07% (4.1772 => 3.0465, std.dev.: 0.0452)
  SingleSource/Benchmarks/Shootout-C++/except: 82316.67% (0.0006 => 0.4945, std.dev.: 0.0070)
  SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000)
  SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002)
  SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006)
  SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.61% (0.0745 => 0.0906, std.dev.: 0.0005)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 7.57% (0.1414 => 0.1521, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.15% (0.6410 => 0.6868, std.dev.: 0.0063)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.57% (2.1763 => 2.3193, std.dev.: 0.0130)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.88% (0.5309 => 0.5621, std.dev.: 0.0074)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.7722 => 0.8110, std.dev.: 0.0042)
  MultiSource/Applications/lemon/lemon: 5.00% (1.0046 => 1.0548, std.dev.: 0.0104)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.58% (0.2552 => 0.2669, std.dev.: 0.0036)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.58% (0.3582 => 0.3746, std.dev.: 0.0013)
  MultiSource/Applications/lambda-0_1_3/lambda: 4.08% (0.6915 => 0.7197, std.dev.: 0.0002)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.04% (1.1653 => 1.2124, std.dev.: 0.0030)
  MultiSource/Applications/kimwitu++/kc: 3.58% (15.3105 => 15.8591, std.dev.: 0.1486)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.56% (1.5150 => 1.5690, std.dev.: 0.0057)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.51% (1.1672 => 1.2082, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.13% (0.3901 => 0.4023, std.dev.: 0.0041)
  MultiSource/Benchmarks/Bullet/bullet: 2.89% (29.3170 => 30.1629, std.dev.: 0.0495)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.70% (0.7639 => 0.7845, std.dev.: 0.0075)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.7226 => 0.7406, std.dev.: 0.0030)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.30% (0.7784 => 0.7963, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.24% (1.4113 => 1.4429, std.dev.: 0.0046)
  MultiSource/Applications/Burg/burg: 2.16% (1.1440 => 1.1687, std.dev.: 0.0058)
  MultiSource/Applications/d/make_dparser: 2.07% (3.0225 => 3.0852, std.dev.: 0.0164)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.06% (6.2546 => 6.3835, std.dev.: 0.0404)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.01% (1.2021 => 1.2263, std.dev.: 0.0031)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.96% (0.6069 => 0.6188, std.dev.: 0.0019)
  MultiSource/Benchmarks/nbench/nbench: 1.62% (1.0821 => 1.0996, std.dev.: 0.0016)
  MultiSource/Applications/SPASS/SPASS: 1.54% (13.3238 => 13.5290, std.dev.: 0.0583)
  MultiSource/Applications/siod/siod: 1.53% (2.0972 => 2.1292, std.dev.: 0.0119)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.24% (4.0318 => 4.0819, std.dev.: 0.0179)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0008)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.40% (0.0766 => 0.0884, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout/ary3: 14.67% (1.7426 => 1.9983, std.dev.: 0.0218)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.59% (4.0101 => 4.5552, std.dev.: 0.0771)
  SingleSource/Benchmarks/Stanford/Puzzle: 11.30% (0.1433 => 0.1595, std.dev.: 0.0009)
  SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0036)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout/lists: 8.53% (7.0025 => 7.5995, std.dev.: 0.0287)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.12% (0.2857 => 0.3089, std.dev.: 0.0038)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.94% (1.0063 => 1.0761, std.dev.: 0.0125)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/fp-convert: 4.16% (15.2242 => 15.8579, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/dt: 4.12% (0.9851 => 1.0257, std.dev.: 0.0013)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5368, std.dev.: 0.0022)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (6.6312 => 6.8736, std.dev.: 0.0093)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.28% (0.5876 => 0.6069, std.dev.: 0.0032)
  MultiSource/Applications/hexxagon/hexxagon: 2.88% (14.4877 => 14.9045, std.dev.: 0.0365)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.75% (2.6656 => 2.7390, std.dev.: 0.0069)
  MultiSource/Benchmarks/sim/sim: 2.71% (3.8907 => 3.9963, std.dev.: 0.0102)
  SingleSource/Benchmarks/Misc/ReedSolomon: 2.46% (8.5113 => 8.7209, std.dev.: 0.0256)
  MultiSource/Applications/siod/siod: 2.27% (3.5520 => 3.6327, std.dev.: 0.0258)
  SingleSource/Benchmarks/Dhrystone/dry: 1.82% (2.4013 => 2.4449, std.dev.: 0.0101)
  MultiSource/Applications/lua/lua: 1.32% (29.5232 => 29.9134, std.dev.: 0.0816)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.16% (2.4455 => 2.4738, std.dev.: 0.0096)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.04% (1.6110 => 1.6278, std.dev.: 0.0017)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/spiff/spiff: -1.87% (0.7738 => 0.7593, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0003)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -22.26% (5.2665 => 4.0940, std.dev.: 0.0949)
  SingleSource/Benchmarks/Shootout-C++/ary3: -20.26% (1.7473 => 1.3933, std.dev.: 0.0046)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.43% (1.1647 => 0.9617, std.dev.: 0.0011)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.34% (15.8312 => 13.4024, std.dev.: 0.0887)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.87% (0.0917 => 0.0799, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0328)
  MultiSource/Applications/sgefa/sgefa: -11.19% (0.3746 => 0.3327, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout-C++/moments: -10.14% (0.1114 => 0.1001, std.dev.: 0.0003)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.60% (1.4034 => 1.2827, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.79% (3.2007 => 2.9514, std.dev.: 0.0239)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3767, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/fibo: -6.54% (4.6355 => 4.3323, std.dev.: 0.0047)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0179)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.18% (7.6833 => 7.2085, std.dev.: 0.0281)
  SingleSource/Benchmarks/Misc/richards_benchmark: -6.18% (1.4441 => 1.3549, std.dev.: 0.0127)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7962, std.dev.: 0.0037)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.65% (3.4230 => 3.2296, std.dev.: 0.0066)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9234, std.dev.: 0.2014)
  SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1858, std.dev.: 0.0126)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.87% (61.1734 => 58.8072, std.dev.: 0.8519)
  SingleSource/Benchmarks/McGill/misr: -3.58% (0.4296 => 0.4142, std.dev.: 0.0033)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -3.33% (1.2959 => 1.2528, std.dev.: 0.0126)
  SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (9.2503 => 8.9437, std.dev.: 0.0682)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.17% (45.4683 => 44.0290, std.dev.: 0.4200)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.83% (3.9413 => 3.8296, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.77% (3.7496 => 3.6456, std.dev.: 0.0215)
  SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std.dev.: 0.0277)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.11% (1.1683 => 1.1437, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.07% (1.8739 => 1.8352, std.dev.: 0.0073)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.05% (92.7467 => 90.8418, std.dev.: 0.0894)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (9.3855 => 9.2193, std.dev.: 0.0262)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0002)
  MultiSource/Benchmarks/FreeBench/neural/neural: -1.63% (1.0926 => 1.0748, std.dev.: 0.0005)
  SingleSource/Benchmarks/Dhrystone/fldry: -1.41% (2.4971 => 2.4619, std.dev.: 0.0039)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3065, std.dev.: 0.0286)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/obsequi/Obsequi: -1.12% (0.9980 => 0.9868, std.dev.: 0.0209)
  MultiSource/Applications/sqlite3/sqlite3: 0.68% (0.6022 => 0.6063, std.dev.: 0.0008)
  MultiSource/Benchmarks/McCat/08-main/main: 0.06% (0.1666 => 0.1667, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.39% (0.1554 => 0.1560, std.dev.: 0.0011)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (0.3083 => 0.3080, std.dev.: 0.0018)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -0.92% (0.2394 => 0.2372, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3175 => 0.3174, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -0.39% (0.2302 => 0.2293, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/mandel: -8.02% (0.0449 => 0.0413, std.dev.: 0.0021)
  SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.59% (0.0324 => 0.0267, std.dev.: 0.0028)
  SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0003)
  SingleSource/UnitTests/byval-alignment: -7.38% (0.0325 => 0.0301, std.dev.: 0.0012)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/viterbi/viterbi
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/Regression/C/uint64_to_float
  SingleSource/UnitTests/2003-05-07-VarArgs
  SingleSource/UnitTests/2003-07-09-SignedArgs
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2003-08-11-VaListArg
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/multiplies
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: 1.82% (0.1429 => 0.1455, std.dev.: 0.0006)
  MultiSource/Applications/lemon/lemon: -1.51% (1.5019 => 1.4792, std.dev.: 0.0230)
  MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001)
  MultiSource/Applications/oggenc/oggenc: -0.53% (0.1501 => 0.1493, std.dev.: 0.0001)
  MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001)
  MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.21% (0.4264 => 0.3999, std.dev.: 0.0205)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.62% (0.1344 => 0.1433, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.53% (0.0589 => 0.0651, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0232 => 0.0232, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.58% (0.0639 => 0.0565, std.dev.: 0.0039)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1286, std.dev.: 0.0078)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.81% (0.0637 => 0.0600, std.dev.: 0.0020)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.47% (0.0246 => 0.0235, std.dev.: 0.0012)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.59% (0.7541 => 0.7661, std.dev.: 0.0093)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001)
  SingleSource/Regression/C/uint64_to_float: 4.22% (1.5363 => 1.6012, std.dev.: 0.0096)
  SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)

Report Time: 1.23s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120921/a66bb894/attachment.html>


More information about the llvm-testresults mailing list