[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Sep 25 18:41:18 PDT 2012
http://llvm.org/perf/db_default/v4/nts/4245?compare_to=4243&baseline=3242
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5
Comparing:
Run: 4245, Order: 164651, Start Time: 2012-09-26 00:27:40, End Time: 2012-09-26 01:42:51
To: 4243, Order: 164630, Start Time: 2012-09-25 21:19:21, End Time: 2012-09-25 22:35:04
Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03
===============
Tests Summary
===============
New Failures: 0 (4 on baseline)
New Passes: 0 (10 on baseline)
Performance Regressions: 6 (73 on baseline)
Performance Improvements: 2 (46 on baseline)
Existing Failures: 73 (69 on baseline)
Unchanged Tests: 889 (768 on baseline)
Total Tests: 970
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Applications/kimwitu++/kc: 1.08% (16.1660 => 16.3413, std.dev.: 0.0322)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.61% (0.5904 => 0.6117, std.dev.: 0.0060)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.48% (42.8517 => 44.3417, std.dev.: 0.3429)
SingleSource/Benchmarks/Shootout-C++/lists1: 3.41% (0.5805 => 0.6003, std.dev.: 0.0073)
MultiSource/Applications/minisat/minisat: 1.46% (6.2564 => 6.3477, std.dev.: 0.0263)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.40% (1.8300 => 1.8557, std.dev.: 0.0028)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/McGill/chomp: -1.99% (1.0421 => 1.0214, std.dev.: 0.0057)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.73% (1.4522 => 1.4271, std.dev.: 0.0081)
Existing Failures - Compile Time
--------------------------------
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/sqlite3/sqlite3
MultiSource/Benchmarks/McCat/08-main/main
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
SingleSource/Benchmarks/CoyoteBench/fftbench
SingleSource/Benchmarks/Misc-C++-EH/spirit
SingleSource/Benchmarks/Misc-C++/Large/ray
SingleSource/Benchmarks/Misc/mandel
SingleSource/UnitTests/2003-05-07-VarArgs
SingleSource/UnitTests/2003-08-11-VaListArg
SingleSource/UnitTests/2009-04-16-BitfieldInitialization
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
SingleSource/UnitTests/Vector/Altivec/alti_expandfft
SingleSource/UnitTests/Vector/Altivec/alti_isamax
SingleSource/UnitTests/Vector/Altivec/alti_sdot
SingleSource/UnitTests/Vector/Altivec/alti_stepfft
SingleSource/UnitTests/Vector/Altivec/casts
SingleSource/UnitTests/Vector/Altivec/test1
SingleSource/UnitTests/Vector/multiplies
SingleSource/UnitTests/byval-alignment
MultiSource/Applications/obsequi/Obsequi: -0.58% (1.0039 => 0.9981, std.dev.: 0.0081)
MultiSource/Applications/sqlite3/sqlite3: -1.10% (0.5885 => 0.5820, std.dev.: 0.0078)
MultiSource/Benchmarks/McCat/08-main/main: -0.44% (0.1589 => 0.1582, std.dev.: 0.0034)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.80% (0.1251 => 0.1286, std.dev.: 0.0038)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.20% (0.2927 => 0.2933, std.dev.: 0.0042)
SingleSource/Benchmarks/CoyoteBench/fftbench: 3.03% (0.2146 => 0.2211, std.dev.: 0.0050)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.33% (0.2988 => 0.2998, std.dev.: 0.0041)
SingleSource/Benchmarks/Misc-C++/Large/ray: 1.64% (0.2068 => 0.2102, std.dev.: 0.0010)
SingleSource/Benchmarks/Misc/mandel: 0.71% (0.0280 => 0.0282, std.dev.: 0.0003)
SingleSource/UnitTests/2003-05-07-VarArgs: -48.75% (0.0080 => 0.0041, std.dev.: 0.0023)
SingleSource/UnitTests/2003-08-11-VaListArg: 23.29% (0.0073 => 0.0090, std.dev.: 0.0001)
SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.60% (0.0077 => 0.0075, std.dev.: 0.0003)
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.72% (0.0144 => 0.0194, std.dev.: 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0004)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.87% (0.0267 => 0.0272, std.dev.: 0.0014)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0285 => 0.0284, std.dev.: 0.0002)
SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -22.94% (0.0327 => 0.0252, std.dev.: 0.0031)
SingleSource/UnitTests/Vector/Altivec/casts: -43.89% (0.0180 => 0.0101, std.dev.: 0.0038)
SingleSource/UnitTests/Vector/Altivec/test1: -25.26% (0.0194 => 0.0145, std.dev.: 0.0022)
SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0250 => 0.0253, std.dev.: 0.0001)
SingleSource/UnitTests/byval-alignment: 49.37% (0.0079 => 0.0118, std.dev.: 0.0005)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/JM/lencod/lencod
MultiSource/Applications/lemon/lemon
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/oggenc/oggenc
MultiSource/Applications/sqlite3/sqlite3
MultiSource/Applications/viterbi/viterbi
MultiSource/Benchmarks/Bullet/bullet
MultiSource/Benchmarks/McCat/08-main/main
MultiSource/Benchmarks/McCat/09-vor/vor
MultiSource/Benchmarks/McCat/12-IOtest/iotest
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
MultiSource/Benchmarks/MiBench/security-sha/security-sha
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Ptrdist/anagram/anagram
MultiSource/Benchmarks/Ptrdist/bc/bc
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
MultiSource/Benchmarks/mediabench/g721/g721encode/encode
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
SingleSource/Benchmarks/BenchmarkGame/puzzle
SingleSource/Benchmarks/CoyoteBench/fftbench
SingleSource/Benchmarks/Misc-C++-EH/spirit
SingleSource/Benchmarks/Misc-C++/Large/ray
SingleSource/Benchmarks/Misc/mandel
SingleSource/Regression/C/2003-05-21-UnionBitfields
SingleSource/Regression/C/2003-05-21-UnionTest
SingleSource/Regression/C/uint64_to_float
SingleSource/UnitTests/2003-05-07-VarArgs
SingleSource/UnitTests/2003-07-09-SignedArgs
SingleSource/UnitTests/2003-07-10-SignConversions
SingleSource/UnitTests/2003-08-11-VaListArg
SingleSource/UnitTests/2005-07-15-Bitfield-ABI
SingleSource/UnitTests/2006-01-23-UnionInit
SingleSource/UnitTests/2007-04-10-BitfieldTest
SingleSource/UnitTests/2009-04-16-BitfieldInitialization
SingleSource/UnitTests/SignlessTypes/Large/cast
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
SingleSource/UnitTests/Vector/Altivec/alti_expandfft
SingleSource/UnitTests/Vector/Altivec/alti_isamax
SingleSource/UnitTests/Vector/Altivec/alti_sdot
SingleSource/UnitTests/Vector/Altivec/alti_stepfft
SingleSource/UnitTests/Vector/Altivec/casts
SingleSource/UnitTests/Vector/Altivec/test1
SingleSource/UnitTests/Vector/multiplies
SingleSource/UnitTests/byval-alignment
MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005)
MultiSource/Applications/ClamAV/clamscan: -4.16% (0.1444 => 0.1384, std.dev.: 0.0028)
MultiSource/Applications/JM/lencod/lencod: -1.79% (0.2293 => 0.2252, std.dev.: 0.0082)
MultiSource/Applications/lemon/lemon: 2.81% (1.4380 => 1.4784, std.dev.: 0.0277)
MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
MultiSource/Applications/oggenc/oggenc: 0.74% (0.1480 => 0.1491, std.dev.: 0.0011)
MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001)
MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005)
MultiSource/Benchmarks/Bullet/bullet: -3.03% (0.6065 => 0.5881, std.dev.: 0.0005)
MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/McCat/09-vor/vor: 0.49% (26.6160 => 26.7453, std.dev.: 0.1606)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.30% (0.4010 => 0.4062, std.dev.: 0.0060)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.79% (0.1378 => 0.1444, std.dev.: 0.0008)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.53% (0.0524 => 0.0532, std.dev.: 0.0036)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.32% (0.0205 => 0.0190, std.dev.: 0.0029)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.92% (0.0591 => 0.0626, std.dev.: 0.0021)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.1280 => 1.1235, std.dev.: 0.0064)
MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0015 => 0.0015, std.dev.: 0.0004)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0000)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.79% (0.0542 => 0.0633, std.dev.: 0.0007)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.55% (0.0154 => 0.0161, std.dev.: 0.0023)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.09% (0.7650 => 0.7657, std.dev.: 0.0056)
SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001)
SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001)
SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001)
SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001)
SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005)
SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002)
SingleSource/Regression/C/uint64_to_float: 0.20% (1.7061 => 1.7095, std.dev.: 0.0104)
SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001)
SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005)
SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005)
SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001)
SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000)
SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005)
SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005)
SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001)
SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121)
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001)
SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Applications/JM/lencod/lencod
MultiSource/Benchmarks/Bullet/bullet
MultiSource/Benchmarks/McCat/09-vor/vor
MultiSource/Benchmarks/Ptrdist/bc/bc
MultiSource/Applications/JM/lencod/lencod: -96.66% (6.7458 => 0.2252, std.dev.: 0.0082)
MultiSource/Benchmarks/Bullet/bullet: -91.57% (6.9722 => 0.5881, std.dev.: 0.0005)
MultiSource/Benchmarks/McCat/09-vor/vor: 21521.10% (0.1237 => 26.7453, std.dev.: 0.1606)
MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005)
New Passes - Execution Time
---------------------------
SingleSource/Benchmarks/Misc/mandel-2
SingleSource/Benchmarks/Shootout-C++/except
SingleSource/Regression/C++/EH/ctor_dtor_count
SingleSource/Regression/C++/EH/ctor_dtor_count-2
SingleSource/Regression/C++/EH/exception_spec_test
SingleSource/Regression/C++/EH/function_try_block
SingleSource/Regression/C++/EH/inlined_cleanup
SingleSource/Regression/C++/EH/simple_rethrow
SingleSource/Regression/C++/EH/simple_throw
SingleSource/Regression/C++/EH/throw_rethrow_test
SingleSource/Benchmarks/Misc/mandel-2: -26.66% (4.1772 => 3.0637, std.dev.: 0.0513)
SingleSource/Benchmarks/Shootout-C++/except: 82583.33% (0.0006 => 0.4961, std.dev.: 0.0081)
SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006)
SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006)
SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006)
SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006)
SingleSource/Regression/C++/EH/inlined_cleanup: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001)
SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002)
SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006)
SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000)
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.43% (0.0745 => 0.0927, std.dev.: 0.0012)
MultiSource/Benchmarks/PAQ8p/paq8p: 10.58% (2.1763 => 2.4066, std.dev.: 0.0182)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.75% (0.1159 => 0.1272, std.dev.: 0.0023)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.14% (0.6410 => 0.6996, std.dev.: 0.0034)
MultiSource/Benchmarks/Fhourstones/fhourstones: 8.77% (0.1414 => 0.1538, std.dev.: 0.0028)
SingleSource/Benchmarks/Misc-C++/bigfib: 7.93% (0.5309 => 0.5730, std.dev.: 0.0016)
MultiSource/Applications/lemon/lemon: 7.45% (1.0046 => 1.0794, std.dev.: 0.0062)
MultiSource/Applications/kimwitu++/kc: 6.73% (15.3105 => 16.3413, std.dev.: 0.0322)
MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.2552 => 0.2720, std.dev.: 0.0026)
MultiSource/Applications/SIBsim4/SIBsim4: 6.57% (1.1653 => 1.2419, std.dev.: 0.0057)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.56% (0.3582 => 0.3817, std.dev.: 0.0039)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.39% (1.5150 => 1.6118, std.dev.: 0.0046)
MultiSource/Applications/minisat/minisat: 6.29% (0.6173 => 0.6561, std.dev.: 0.0038)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.20% (0.3901 => 0.4104, std.dev.: 0.0060)
SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.04% (0.2797 => 0.2938, std.dev.: 0.0007)
MultiSource/Applications/lambda-0_1_3/lambda: 4.66% (0.6915 => 0.7237, std.dev.: 0.0032)
MultiSource/Applications/d/make_dparser: 4.58% (3.0225 => 3.1609, std.dev.: 0.0251)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.7639 => 0.7986, std.dev.: 0.0051)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.53% (0.6069 => 0.6344, std.dev.: 0.0025)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.35% (1.1672 => 1.2180, std.dev.: 0.0120)
MultiSource/Applications/oggenc/oggenc: 4.32% (4.7455 => 4.9503, std.dev.: 0.0051)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.19% (1.2021 => 1.2525, std.dev.: 0.0159)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.14% (0.2654 => 0.2764, std.dev.: 0.0008)
MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3217 => 0.3350, std.dev.: 0.0021)
MultiSource/Applications/SPASS/SPASS: 4.08% (13.3238 => 13.8668, std.dev.: 0.0332)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.98% (0.4248 => 0.4417, std.dev.: 0.0020)
SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.3062 => 0.3182, std.dev.: 0.0046)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.87% (12.6413 => 13.1306, std.dev.: 0.1349)
MultiSource/Applications/siod/siod: 3.84% (2.0972 => 2.1778, std.dev.: 0.0096)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.80% (1.1827 => 1.2277, std.dev.: 0.0090)
MultiSource/Applications/Burg/burg: 3.71% (1.1440 => 1.1864, std.dev.: 0.0121)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (6.2546 => 6.4862, std.dev.: 0.0609)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.56% (3.0758 => 3.1852, std.dev.: 0.0131)
MultiSource/Benchmarks/sim/sim: 3.53% (0.3084 => 0.3193, std.dev.: 0.0008)
MultiSource/Applications/JM/lencod/lencod: 3.42% (14.7256 => 15.2292, std.dev.: 0.0049)
MultiSource/Applications/hbd/hbd: 3.37% (1.3268 => 1.3715, std.dev.: 0.0017)
MultiSource/Benchmarks/Bullet/bullet: 3.33% (29.3170 => 30.2946, std.dev.: 0.2713)
MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (8.2186 => 8.4912, std.dev.: 0.0545)
MultiSource/Benchmarks/nbench/nbench: 3.26% (1.0821 => 1.1174, std.dev.: 0.0125)
MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.0689 => 1.1016, std.dev.: 0.0068)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.05% (0.8569 => 0.8830, std.dev.: 0.0054)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.93% (2.0317 => 2.0912, std.dev.: 0.0097)
MultiSource/Applications/lua/lua: 2.90% (3.5980 => 3.7022, std.dev.: 0.0114)
MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.4908 => 6.6681, std.dev.: 0.0058)
MultiSource/Applications/treecc/treecc: 2.28% (1.8798 => 1.9227, std.dev.: 0.0138)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.92% (8.2559 => 8.4141, std.dev.: 0.0575)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.55% (4.2815 => 4.3478, std.dev.: 0.0242)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Stanford/Bubblesort: 49.05% (0.0263 => 0.0392, std.dev.: 0.0004)
SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0026)
SingleSource/Benchmarks/Shootout-C++/matrix: 22.16% (3.4629 => 4.2304, std.dev.: 0.0145)
SingleSource/Benchmarks/Shootout/ary3: 15.21% (1.7426 => 2.0076, std.dev.: 0.0382)
SingleSource/Benchmarks/Stanford/Puzzle: 13.75% (0.1433 => 0.1630, std.dev.: 0.0003)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.28% (4.0101 => 4.5426, std.dev.: 0.0485)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.67% (0.0917 => 0.1024, std.dev.: 0.0026)
SingleSource/Benchmarks/McGill/queens: 10.97% (1.6261 => 1.8045, std.dev.: 0.0008)
SingleSource/Benchmarks/Shootout/lists: 9.22% (7.0025 => 7.6480, std.dev.: 0.0554)
MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0004)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.21% (0.3301 => 0.3539, std.dev.: 0.0022)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.45% (40.4792 => 42.2786, std.dev.: 0.2246)
SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std.dev.: 0.0023)
SingleSource/Benchmarks/Misc/fp-convert: 4.16% (15.2242 => 15.8580, std.dev.: 0.0412)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.10% (0.5876 => 0.6117, std.dev.: 0.0060)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.78% (3.4080 => 3.5369, std.dev.: 0.0020)
MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8922, std.dev.: 0.0517)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.74% (0.5587 => 0.5740, std.dev.: 0.0017)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.69% (6.6312 => 6.8098, std.dev.: 0.0011)
MultiSource/Applications/siod/siod: 2.67% (3.5520 => 3.6467, std.dev.: 0.0051)
SingleSource/Benchmarks/Misc/ReedSolomon: 2.37% (8.5113 => 8.7132, std.dev.: 0.0781)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.26% (2.6656 => 2.7258, std.dev.: 0.0163)
SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.21% (4.6127 => 4.7148, std.dev.: 0.0370)
MultiSource/Applications/minisat/minisat: 1.98% (6.2244 => 6.3477, std.dev.: 0.0263)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (2.4455 => 2.4849, std.dev.: 0.0039)
MultiSource/Benchmarks/Olden/power/power: 1.15% (1.4184 => 1.4347, std.dev.: 0.0022)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.63% (0.2996 => 0.1659, std.dev.: 0.0042)
SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0006)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.83% (1.4189 => 1.1376, std.dev.: 0.0082)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.09% (1.4113 => 1.1419, std.dev.: 0.0102)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.38% (0.3497 => 0.2050, std.dev.: 0.0041)
SingleSource/Benchmarks/CoyoteBench/lpbench: -20.18% (5.2665 => 4.2038, std.dev.: 0.0345)
SingleSource/Benchmarks/Shootout-C++/ary3: -19.86% (1.7473 => 1.4002, std.dev.: 0.0093)
MultiSource/Benchmarks/FreeBench/mason/mason: -17.15% (0.5004 => 0.4146, std.dev.: 0.0049)
SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.19% (1.7361 => 1.4723, std.dev.: 0.0059)
SingleSource/Benchmarks/Shootout/sieve: -12.11% (8.1594 => 7.1710, std.dev.: 0.0271)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.70% (15.8312 => 13.9787, std.dev.: 0.3607)
MultiSource/Applications/sgefa/sgefa: -11.32% (0.3746 => 0.3322, std.dev.: 0.0009)
SingleSource/Benchmarks/Shootout-C++/moments: -9.87% (0.1114 => 0.1004, std.dev.: 0.0002)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.66% (1.1647 => 1.0522, std.dev.: 0.0008)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.54% (3.2007 => 2.9275, std.dev.: 0.0265)
SingleSource/Benchmarks/Misc/flops: -8.42% (9.5474 => 8.7439, std.dev.: 0.0044)
MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0016)
MultiSource/Applications/lambda-0_1_3/lambda: -6.93% (7.6833 => 7.1506, std.dev.: 0.0142)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3765, std.dev.: 0.0069)
SingleSource/Benchmarks/Shootout-C++/fibo: -6.47% (4.6355 => 4.3357, std.dev.: 0.0122)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.46% (2.0027 => 1.8733, std.dev.: 0.0145)
MultiSource/Benchmarks/FreeBench/distray/distray: -6.34% (0.2664 => 0.2495, std.dev.: 0.0013)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7953, std.dev.: 0.0009)
SingleSource/Benchmarks/Misc/richards_benchmark: -5.78% (1.4441 => 1.3607, std.dev.: 0.0122)
MultiSource/Applications/SIBsim4/SIBsim4: -5.44% (3.4230 => 3.2368, std.dev.: 0.0115)
SingleSource/Benchmarks/Shootout/fib2: -4.91% (4.4195 => 4.2023, std.dev.: 0.0090)
MultiSource/Benchmarks/Olden/bh/bh: -4.91% (2.5166 => 2.3931, std.dev.: 0.0235)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.49% (0.4564 => 0.4359, std.dev.: 0.0008)
MultiSource/Benchmarks/mafft/pairlocalalign: -4.20% (62.4126 => 59.7927, std.dev.: 0.1721)
MultiSource/Benchmarks/Fhourstones/fhourstones: -3.59% (1.2959 => 1.2494, std.dev.: 0.0124)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.57% (1.2722 => 1.2268, std.dev.: 0.0007)
SingleSource/Benchmarks/McGill/misr: -3.38% (0.4296 => 0.4151, std.dev.: 0.0014)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.06% (3.9413 => 3.8205, std.dev.: 0.0050)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.96% (3.7496 => 3.6385, std.dev.: 0.0204)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.87% (0.4140 => 0.4021, std.dev.: 0.0002)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.48% (45.4683 => 44.3417, std.dev.: 0.3429)
SingleSource/Benchmarks/Shootout-C++/methcall: -2.40% (9.2503 => 9.0286, std.dev.: 0.0126)
MultiSource/Benchmarks/FreeBench/neural/neural: -2.27% (1.0926 => 1.0678, std.dev.: 0.0028)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.14% (1.1683 => 1.1433, std.dev.: 0.0018)
MultiSource/Applications/aha/aha: -1.97% (3.4286 => 3.3610, std.dev.: 0.0080)
MultiSource/Benchmarks/sim/sim: -1.79% (3.8907 => 3.8209, std.dev.: 0.0119)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2242, std.dev.: 0.0150)
SingleSource/Benchmarks/Shootout-C++/hash2: -1.63% (3.4876 => 3.4306, std.dev.: 0.0087)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0024)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.51% (61.1734 => 60.2485, std.dev.: 0.3257)
SingleSource/Benchmarks/CoyoteBench/huffbench: -1.28% (25.6658 => 25.3367, std.dev.: 0.0697)
Existing Failures - Compile Time
--------------------------------
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/sqlite3/sqlite3
MultiSource/Benchmarks/McCat/08-main/main
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
SingleSource/Benchmarks/CoyoteBench/fftbench
SingleSource/Benchmarks/Misc-C++-EH/spirit
SingleSource/Benchmarks/Misc-C++/Large/ray
SingleSource/Benchmarks/Misc/mandel
SingleSource/UnitTests/2003-05-07-VarArgs
SingleSource/UnitTests/2003-08-11-VaListArg
SingleSource/UnitTests/2009-04-16-BitfieldInitialization
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
SingleSource/UnitTests/Vector/Altivec/alti_expandfft
SingleSource/UnitTests/Vector/Altivec/alti_isamax
SingleSource/UnitTests/Vector/Altivec/alti_sdot
SingleSource/UnitTests/Vector/Altivec/alti_stepfft
SingleSource/UnitTests/Vector/Altivec/casts
SingleSource/UnitTests/Vector/Altivec/test1
SingleSource/UnitTests/Vector/multiplies
SingleSource/UnitTests/byval-alignment
MultiSource/Applications/obsequi/Obsequi: 0.01% (0.9980 => 0.9981, std.dev.: 0.0081)
MultiSource/Applications/sqlite3/sqlite3: -3.35% (0.6022 => 0.5820, std.dev.: 0.0078)
MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.1666 => 0.1582, std.dev.: 0.0034)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -17.25% (0.1554 => 0.1286, std.dev.: 0.0038)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.87% (0.3083 => 0.2933, std.dev.: 0.0042)
SingleSource/Benchmarks/CoyoteBench/fftbench: -7.64% (0.2394 => 0.2211, std.dev.: 0.0050)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.57% (0.3175 => 0.2998, std.dev.: 0.0041)
SingleSource/Benchmarks/Misc-C++/Large/ray: -8.69% (0.2302 => 0.2102, std.dev.: 0.0010)
SingleSource/Benchmarks/Misc/mandel: -37.19% (0.0449 => 0.0282, std.dev.: 0.0003)
SingleSource/UnitTests/2003-05-07-VarArgs: -53.93% (0.0089 => 0.0041, std.dev.: 0.0023)
SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001)
SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -68.75% (0.0240 => 0.0075, std.dev.: 0.0003)
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0004)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.63% (0.0301 => 0.0272, std.dev.: 0.0014)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0002)
SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -22.22% (0.0324 => 0.0252, std.dev.: 0.0031)
SingleSource/UnitTests/Vector/Altivec/casts: -42.94% (0.0177 => 0.0101, std.dev.: 0.0038)
SingleSource/UnitTests/Vector/Altivec/test1: -23.28% (0.0189 => 0.0145, std.dev.: 0.0022)
SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0001)
SingleSource/UnitTests/byval-alignment: -63.69% (0.0325 => 0.0118, std.dev.: 0.0005)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/oggenc/oggenc
MultiSource/Applications/sqlite3/sqlite3
MultiSource/Applications/viterbi/viterbi
MultiSource/Benchmarks/McCat/08-main/main
MultiSource/Benchmarks/McCat/12-IOtest/iotest
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
MultiSource/Benchmarks/MiBench/security-sha/security-sha
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Ptrdist/anagram/anagram
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
MultiSource/Benchmarks/mediabench/g721/g721encode/encode
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
SingleSource/Benchmarks/BenchmarkGame/puzzle
SingleSource/Benchmarks/CoyoteBench/fftbench
SingleSource/Benchmarks/Misc-C++-EH/spirit
SingleSource/Benchmarks/Misc-C++/Large/ray
SingleSource/Benchmarks/Misc/mandel
SingleSource/Regression/C/2003-05-21-UnionBitfields
SingleSource/Regression/C/2003-05-21-UnionTest
SingleSource/Regression/C/uint64_to_float
SingleSource/UnitTests/2003-05-07-VarArgs
SingleSource/UnitTests/2003-07-09-SignedArgs
SingleSource/UnitTests/2003-07-10-SignConversions
SingleSource/UnitTests/2003-08-11-VaListArg
SingleSource/UnitTests/2005-07-15-Bitfield-ABI
SingleSource/UnitTests/2006-01-23-UnionInit
SingleSource/UnitTests/2007-04-10-BitfieldTest
SingleSource/UnitTests/2009-04-16-BitfieldInitialization
SingleSource/UnitTests/SignlessTypes/Large/cast
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
SingleSource/UnitTests/Vector/Altivec/alti_expandfft
SingleSource/UnitTests/Vector/Altivec/alti_isamax
SingleSource/UnitTests/Vector/Altivec/alti_sdot
SingleSource/UnitTests/Vector/Altivec/alti_stepfft
SingleSource/UnitTests/Vector/Altivec/casts
SingleSource/UnitTests/Vector/Altivec/test1
SingleSource/UnitTests/Vector/multiplies
SingleSource/UnitTests/byval-alignment
MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005)
MultiSource/Applications/ClamAV/clamscan: -3.15% (0.1429 => 0.1384, std.dev.: 0.0028)
MultiSource/Applications/lemon/lemon: -1.56% (1.5019 => 1.4784, std.dev.: 0.0277)
MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001)
MultiSource/Applications/oggenc/oggenc: -0.67% (0.1501 => 0.1491, std.dev.: 0.0011)
MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001)
MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005)
MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.74% (0.4264 => 0.4062, std.dev.: 0.0060)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.44% (0.1344 => 0.1444, std.dev.: 0.0008)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.68% (0.0589 => 0.0532, std.dev.: 0.0036)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.10% (0.0232 => 0.0190, std.dev.: 0.0029)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.03% (0.0639 => 0.0626, std.dev.: 0.0021)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.01% (1.1350 => 1.1235, std.dev.: 0.0064)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0004)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0000)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.63% (0.0637 => 0.0633, std.dev.: 0.0007)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.55% (0.0246 => 0.0161, std.dev.: 0.0023)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0056)
SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001)
SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001)
SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001)
SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001)
SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005)
SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002)
SingleSource/Regression/C/uint64_to_float: 11.27% (1.5363 => 1.7095, std.dev.: 0.0104)
SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001)
SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005)
SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005)
SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001)
SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000)
SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005)
SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005)
SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001)
SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121)
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001)
SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001)
SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
Report Time: 1.22s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120925/29d3ed51/attachment.html>
More information about the llvm-testresults
mailing list